Earlier  
Posted Nick Remark
#openstack-nova - 2017-03-15
11:39:04 rpodolyaka arslanq: hmm, this sounds similar to https://bugs.launchpad.net/nova/+bug/1441054
11:39:04 openstack Launchpad bug 1441054 in OpenStack Compute (nova) "live-migration --block-migrate fails with default libvirt flags" [Medium,Invalid] - Assigned to Mathieu Rohon (mathieu-rohon)
11:39:35 rpodolyaka arslanq: I remember there were some issues with block migration on some versions of libvirtd
11:40:01 rpodolyaka arslanq: specifically, we could not block migrate instances with block devices attached (e.g. config drives)
11:40:14 mdbooth mnestratov: Moving this into the BDM makes it unambiguous. It opens up the possibility of safely having a heterogenous storage config.
11:40:17 rpodolyaka arslanq: but, unfortunately, I do not remember details :(
11:40:20 arslanq rpodolyaka: Note: i don't have shared storage.....
11:40:36 mdbooth It means operators can change storage config after deployment without breaking all their existing instances.
11:40:38 rpodolyaka arslanq: anyway, this must have been fixed in the latest versions of libvirt/qemu
11:41:12 mdbooth It means migrating between hosts with different storage becomes unambiguous.
11:41:44 arslanq rpodolyaka: right now i am on openstack newton branch. Can i get some proper document of this issue? It will be very helpful for me.
11:42:12 mdbooth mnestratov: There are a bunch of advantages beyond just your use case.
11:42:31 mdbooth Whilst also fixing some edge cases where we currently have to skirt around security issues.
11:43:17 mnestratov mdbooth: what would you say if we will not introduce a new config parameter but instead just change the behavior. Like if images_type is none or default then image backend is chosen according to image disk_format metadata and stored in instance' BDM
11:44:37 mdbooth mnestratov: The behaviour should be that if it's present in instance BDM, that should always be used. We should only consult a config/whatever if it's not present, and then we should use that to set it in the bdm.
11:44:53 jaypipes morning folks
11:45:18 mdbooth mnestratov: That gets around the issue of changing config/different config between hosts.
11:45:27 mdbooth jaypipes: morning
11:45:27 jaypipes alex_xu, melwitt, dansmith, Vek: review bait: https://review.openstack.org/399679
11:45:55 mnestratov mdbooth: it demands changing the way you boot your instances
11:46:12 jaypipes mdbooth: hey, morning. so how's it going with the libvirt storage pools patch series? haven't looked at it in a month or so. Need to get back on that.
11:46:15 arslanq rpodolyaka: i have the following libvirt version: libvirtd (libvirt) 2.0.0
11:46:23 mdbooth jaypipes: I haven't done anything with it in that time, tbh.
11:46:40 jaypipes mdbooth: you planning to? or other priorities getting in the way?
11:46:44 mdbooth jaypipes: I need to make a new start on it. It's still on my list, though.
11:46:47 cdent I'm not coping well with jaypipes being 4 hours off instead of the usual 5. It's making me all confused and discombobulated.
11:46:50 mdbooth Yeah, just other priorities :(
11:47:09 jaypipes rpodolyaka: so, you finish the placement client plugin in OSC yet? :P
11:47:22 jaypipes cdent: :)
11:59:15 mdbooth lyarwood: Patch 1 done. I should hopefully pick up the pace a bit with growing context :)
12:07:56 mnestratov mdbooth: one more concern about ignoring images_type parameter. If we implement multibackend support, then it would be hard to report free disk space to scheduler. Is there a way to report free space for all supported backends?
12:13:26 mdbooth mnestratov: Free space needs to be reported per backend anyway.
12:14:55 openstackgerrit Stephen Finucane proposed openstack/nova-specs master: Fix formatting errors and warnings https://review.openstack.org/407364
12:14:56 openstackgerrit Stephen Finucane proposed openstack/nova-specs master: tox: Build docs with Python 2.7 https://review.openstack.org/445906
12:14:56 openstackgerrit Stephen Finucane proposed openstack/nova-specs master: Treat doc build warnings as errors https://review.openstack.org/439883
12:15:12 sfinucan johnthetubaguy: mriedem had. I've put them in a series now ^
12:15:37 sfinucan bauzas: Easy +2s for your newfound spec powers above ^ :)
12:17:31 johnthetubaguy sfinucan: sweet, I want to see jenkins +2 all that first
12:17:49 johnthetubaguy sfinucan: did that last patch miss a link it your commit message?
12:18:07 arslanq rpodolyaka: I just tries this manually and i came to know that this happens only when i block migrate. "Live Migration failure: Operation not supported: qemu does not support drive-mirror command"
12:18:29 openstackgerrit Stephen Finucane proposed openstack/nova-specs master: tox: Build docs with Python 2.7 https://review.openstack.org/445906
12:18:52 sfinucan johnthetubaguy: Oops. Fixed
12:19:08 arslanq rpodolyaka: when i just use live migration it says that live migration is not possible without shared storage.
12:21:00 mdbooth I've stared at this long enough now that I assume I've just become blind to a typo or something. Could any who's got a second tell me what's causing the TypeError here: http://logs.openstack.org/42/445142/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/07e282a/logs/screen-n-api.txt.gz?level=ERROR
12:21:35 mdbooth Thank you #openstack-nova for helping me spot that typo
12:21:43 mdbooth You can ignore the above
12:24:17 mdbooth Also, mock-- for hiding an incorrect use of an interface
12:24:29 johnthetubaguy lyarwood: mdbooth: did you see the discussion over here: https://bugs.launchpad.net/nova/+bug/1672624
12:24:29 openstack Launchpad bug 1672624 in OpenStack Compute (nova) "Ceph volumes attached to local deleted instance could not be correctly handled" [Undecided,New]
12:25:11 mdbooth johnthetubaguy: I didn't. Can look after lunch, though.
12:26:49 openstackgerrit Matthew Booth proposed openstack/nova master: Make server_external_events use an optimal number of db queries https://review.openstack.org/445142
12:28:36 mdbooth johnthetubaguy: Do we want to have api punt 'local_delete' to conductor and have it be a bit more thorough?
12:28:43 mnestratov mdbooth: yeah I know, but IFAIK it's impossible now
12:29:58 mdbooth johnthetubaguy: That's very similar to the evacuate use case where you want to cleanup a volume attachment when the compute host isn't available.
12:30:21 mdbooth biab
12:38:35 openstackgerrit Stephen Finucane proposed openstack/nova-specs master: Add extra-specs-image-meta-conflicts spec https://review.openstack.org/382382
12:40:49 lyarwood johnthetubaguy: just back from lunch, that isn't a bug for me, more of an operator failure tbh. ./me adds a note to the bug
12:41:32 johnthetubaguy lyarwood: hmm, curious what you mean by that
12:42:23 lyarwood johnthetubaguy: while the compute service is down the original instance / domain is still active and connected to the backing rbd volume
12:42:37 lyarwood johnthetubaguy: so any attempt to remove the volume from the rbd pool is going to fail
12:42:49 johnthetubaguy lyarwood: ah, yes, it should do, good point
12:43:01 johnthetubaguy lyarwood: you have to wait for clean up on the compute node, which they haven't done
12:43:14 lyarwood johnthetubaguy: that or manually fence it
12:43:21 lyarwood johnthetubaguy: get it into a known state
12:45:29 johnthetubaguy lyarwood: yeah, we might need better tooling for that long term, post cinder API fix ups
12:45:47 alex_xu nova api meeting is 15 mins at openstack-meeting-4
12:45:57 johnthetubaguy alex_xu: yeah, I should get me some lunch quickly!
12:46:08 alex_xu johnthetubaguy: :)
12:47:29 alex_xu johnthetubaguy: maybe we can move the meeting early 15mins, then you can get a better lunch
12:48:46 johnthetubaguy alex_xu: nah, that just means I am hungry during the meeting
12:49:04 alex_xu :)
12:50:59 alex_xu johnthetubaguy: sdague experiment for removing stevedore https://review.openstack.org/#/c/445864/
12:55:47 sdague alex_xu: that looks really neat
12:57:29 alex_xu sdague: thanks, make me have more confidence
12:57:30 sdague alex_xu: and *so* much more clear
12:59:06 alex_xu sdague: just follow the placement api pattern, explicitly list the routes
13:00:16 alex_xu nova api meeting is running
13:12:09 openstackgerrit Mikhail Feoktistov proposed openstack/nova master: Add is_vz_container function https://review.openstack.org/445947
13:26:22 openstackgerrit Rafael Folco proposed openstack/nova master: DELETE all inventory for a resource provider https://review.openstack.org/416669
13:26:23 openstackgerrit Rafael Folco proposed openstack/nova master: [placement] Raising http codes on old microversion https://review.openstack.org/444497
13:28:34 rpodolyaka jaypipes: heh, you'll be the first one to know, when the placement client plugin is done ;)
13:29:50 dansmith gibi: can you look at this? https://review.openstack.org/#/c/445697/
13:30:13 dansmith gibi: I found another case where we were lazy-loading that from an instance on compute and so I think we probably want to go a little more aggressive on it
13:32:25 jaypipes rfolco: quick request on https://review.openstack.org/#/c/444497/. if you could handle that, I'll re-review quickly.
13:33:02 jaypipes rfolco: besides that, I think we should be able to merge your two patches in that series today.
13:33:22 rfolco jaypipes.requests --> priority -1
13:33:27 cdent i concur, dr pipes
13:33:39 jaypipes rfolco: :)
13:34:22 stvnoyes1 i was writing a tempest test for swap disk (update volume attachment). The test runs ok on a running server, but I get a libvirt exception (Domain not found: no domain with matching uuid) when run against a stopped server. Is swap not supported on a stopped server? I didn't see anything in the doc about a restriction like that. thanks...
13:36:08 mdbooth stvnoyes1: It is not supported, no.
13:36:41 jaypipes stvnoyes1: when you say "you get a libvirt error", are you saying that that libvirt error is returned to you as a *user*, or that you see that error in the nova-compute log file?
13:36:56 stvnoyes1 in the log
13:37:14 mdbooth johnthetubaguy: ^^^ Incidentally, what stvnoyes1 said is why I was talking about the 'did_copy' response in the swap_volume callback to cinder
13:38:07 johnthetubaguy mdbooth: ack, makes sense, but we can't fix everything in one go
13:38:35 mdbooth johnthetubaguy: Yep, but if we could stick it in the api then we can fix it later more easily.
13:38:42 mriedem jaypipes: if you haven't seen yet, i had some questions in your ironic get_inventory patch
13:38:50 mriedem only thing i have left to review there is the RT functional test
13:38:57 jaypipes mriedem: yup, thanks much for your review and questions. answering now.
13:39:59 mriedem fwiw dansmith explained a bit of earlier conversations to me last night
13:40:30 jaypipes mriedem: dansmith is good like that. :)

Earlier   Later