| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-08-10 | |||
| 14:49:21 | openstack | bug 1679750 in OpenStack Compute (nova) "Allocations are not cleaned up in placement for instance 'local delete' case" [Medium,In progress] https://launchpad.net/bugs/1679750 | |
| 14:49:22 | mriedem | but slightly different | |
| 14:49:28 | gibi | mriedem: OK, I will report it | |
| 14:49:37 | mriedem | bug 1679750 is about how we don't remove the allocations when we delete the instance and the compute is down | |
| 14:49:54 | mriedem | in your case, the instance isn't deleted, it's evacuated, and we just don't cleanup the allocations from the original host when it comes back up | |
| 14:50:26 | mriedem | bauzas: services are per-cell | |
| 14:50:28 | mriedem | so it's not an upcall | |
| 14:50:50 | gibi | mriedem: thank for the pointers | |
| 14:50:51 | mriedem | bauzas: this is why we needed to expose the service uuids out of the API in 2.53 | |
| 14:51:01 | mriedem | to identify nova-compute 1 from nova-compute 1 in cell A and cell B | |
| 14:51:58 | bauzas | mriedem: so it only verifies if all the local-cell computes are having that version, right? | |
| 14:52:19 | bauzas | mriedem: since we're in a local compute | |
| 14:52:42 | mriedem | yes | |
| 14:52:53 | mriedem | moves are also restricted to the cell that the instance already lives in | |
| 14:53:12 | ioggstream | bauzas: https://bugzilla.redhat.com/show_bug.cgi?id=1447798 thx++ | |
| 14:53:13 | openstack | bugzilla.redhat.com bug 1447798 in python-openstackclient "soft-anti-affinity is not accepted by python-openstackclient but is with python-novaclient" [High,New] - Assigned to jruzicka | |
| 14:53:13 | ioggstream | fyi | |
| 14:53:23 | mriedem | https://review.openstack.org/#/c/491012/12/nova/compute/resource_tracker.py@1166 | |
| 14:53:43 | mriedem | ioggstream: i don't think osc is handling nova microversions | |
| 14:53:46 | bauzas | mriedem: correct, so it's probably not a problem | |
| 14:53:50 | mriedem | and the soft affinity policy rules were in a microversion | |
| 14:54:06 | mriedem | bauzas: yes of all the problems we could have with this series of changes, that's one i'm not worried about :) | |
| 14:54:15 | bauzas | fortunately because we don't support multi-cell moves | |
| 14:54:20 | bauzas | okay | |
| 14:54:23 | bauzas | gtk :) | |
| 14:54:26 | mriedem | and likely won't for a long time | |
| 14:54:40 | ioggstream | mriedem: you mean osc challenges the server for the supported options? | |
| 14:55:13 | mriedem | ioggstream: no, i mean i believe osc only ever requests compute API things with 2.1 | |
| 14:55:39 | mriedem | and the soft affinity group policy was added in 2.15 https://docs.openstack.org/nova/latest/reference/api-microversion-history#id13 | |
| 14:56:04 | mriedem | so if you're using osc and try to create a server group with policy 'soft-anti-affinity' using microversion 2.1, it's going to fail with a 400 | |
| 14:56:08 | mriedem | saying it doesn't know what that policy is | |
| 14:56:30 | gibi | mriedem: I filed https://bugs.launchpad.net/nova/+bug/1709902 | |
| 14:56:32 | openstack | Launchpad bug 1709902 in OpenStack Compute (nova) "source host allocation not cleaned up in placement after evacuation" [Undecided,New] | |
| 14:56:50 | ioggstream | mriedem: ok, I didn't know the microversion stuff, let me read about it | |
| 14:56:54 | mriedem | ioggstream: you might be able to pass an --openstack-compute-version or something option to osc cli, idk | |
| 14:58:28 | openstackgerrit | Eric Fried proposed openstack/nova master: Use ksa adapter for placement conf & requests https://review.openstack.org/492247 | |
| 14:59:05 | ioggstream | mriedem: I'll check and let you know, thx++ | |
| 14:59:39 | openstackgerrit | Dmitry Tantsur proposed openstack/nova master: Deprecate bare metal filters https://review.openstack.org/492563 | |
| 14:59:41 | dtantsur | edleafe: ^^^ | |
| 15:00:16 | edleafe | dtantsur: get a faster machine! :) | |
| 15:03:57 | bauzas | mriedem: do you agree with my comment on https://review.openstack.org/#/c/491012/12/nova/compute/resource_tracker.py@1073 and if so, possibly me passing a new revision ? | |
| 15:05:06 | mriedem | dtantsur: heh yeah you need more VCPUs | |
| 15:05:27 | dtantsur | LOOL | |
| 15:05:50 | bauzas | t470s FTW | |
| 15:06:00 | openstackgerrit | Eric Fried proposed openstack/nova master: Use ksa adapter for placement conf & requests https://review.openstack.org/492247 | |
| 15:06:00 | openstackgerrit | Eric Fried proposed openstack/nova master: nova.utils.get_ksa_adapter() https://review.openstack.org/488137 | |
| 15:06:18 | mriedem | bauzas: given the amount of shit we log continually all the time, like lazy-loading pci request and pci devices for every claim, then i'd say leave that for a follow up patch | |
| 15:06:26 | openstackgerrit | Eric Fried proposed openstack/nova master: Get auth from context for glance endpoint https://review.openstack.org/490057 | |
| 15:06:30 | bauzas | mriedem: ok, firing it up | |
| 15:06:39 | bauzas | and then I'll +W that one | |
| 15:07:55 | bauzas | (story-telling, if you remember my current laptop, you'll understand how much I'll enjoy to have a new Enter key w/ my new laptop :D ) | |
| 15:08:24 | dtantsur | bauzas: I have t460s. too old for nova, I guess :D | |
| 15:08:58 | mriedem | bauzas: if you're going to +W anyway, just do it now | |
| 15:09:01 | mriedem | with the gate time as it is | |
| 15:09:08 | bauzas | mriedem: sure | |
| 15:09:09 | mriedem | i don't really want to be doing rc1 at midnight | |
| 15:09:25 | mriedem | midnight is matty's time | |
| 15:09:47 | dtantsur | oh, rc1.. does this ironic-related stuff have a chance to get in? | |
| 15:10:23 | bauzas | mriedem: yeah I should consider relocating to Hawaii | |
| 15:10:27 | bauzas | given the TZ | |
| 15:10:47 | bauzas | or French Polynesia, that could help too | |
| 15:10:57 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: test server evacuation with placement https://review.openstack.org/492548 | |
| 15:11:10 | mriedem | gibi: per your bug, i'm curious why TestLocalDeleteAllocations isn't failing then | |
| 15:11:34 | mriedem | oh i know why | |
| 15:11:36 | mriedem | it's deleted | |
| 15:11:45 | mriedem | and when the RT gets InstanceNotFound, it deletes the allocations | |
| 15:12:13 | jaypipes | is it just me or is the gate getting better... | |
| 15:12:16 | mriedem | dtantsur: i've been leaning on dansmith for that change | |
| 15:12:21 | mriedem | dtantsur: but he's out the rest of the week | |
| 15:12:28 | mriedem | dtantsur: so it's likely rc2 at this point | |
| 15:12:43 | dtantsur | yeah, it's fine, as long as it gets into Pike at all | |
| 15:12:51 | mriedem | jaypipes: except for the slow nodes and timeouts, it's not bad | |
| 15:14:28 | mriedem | gibi: i wonder why https://review.openstack.org/#/c/492548/ keeps saying it can't merge? | |
| 15:14:34 | mriedem | but don't rebase the entire series... | |
| 15:15:00 | gibi | mriedem: I think it is because I adding the test at the end of the test_server.py | |
| 15:15:23 | jaypipes | mriedem, bauzas, sdague: should be simple review: https://review.openstack.org/#/c/491822/ | |
| 15:15:31 | gibi | mriedem: but I can try locally | |
| 15:16:19 | gibi | mriedem: yes, the evac patch conflicts on the file ending | |
| 15:16:23 | gibi | mriedem: master has test_resize_not_enough_resource at the end | |
| 15:16:35 | gibi | mriedem: but Jay's branch doesn't contain that | |
| 15:17:19 | gibi | mriedem: I will have no time today to do the evac fix in the init_host so if this is important somebody can take over. But tomorrow I can continue | |
| 15:17:53 | openstackgerrit | Sylvain Bauza proposed openstack/nova master: Make compute log less verbose with allocs autocorrection https://review.openstack.org/492571 | |
| 15:18:09 | bauzas | mriedem: HTH ^ | |
| 15:18:14 | openstackgerrit | Dmitry Tantsur proposed openstack/nova master: Deprecate bare metal filters https://review.openstack.org/492563 | |
| 15:19:34 | dtantsur | bauzas, mriedem, easy win for your review stats ^^ (like if you needed more, heh) | |
| 15:21:16 | gibi | mriedem, dansmith: I think this is ready to go in, Jay was +2 already but I needed to rebase: https://review.openstack.org/#/c/491529/ | |
| 15:22:06 | jaypipes | gibi: hey, there's an urgent request for your assistance here: http://lists.openstack.org/pipermail/openstack/2017-August/045339.html | |
| 15:26:02 | gibi | jaypipes: seems like s spam :) | |
| 15:27:11 | mriedem | bauzas: sdague: melwitt: i triaged https://bugs.launchpad.net/nova/+bug/1709594 | |
| 15:27:13 | openstack | Launchpad bug 1709594 in OpenStack Compute (nova) "live-migration without '--block-migrate" failed with "No sql_connection parameter is established"" [High,Triaged] | |
| 15:27:18 | mriedem | it's a superconductor issue, | |
| 15:27:27 | mriedem | the xenapi driver tries to get host aggregates during a live migration, | |
| 15:27:32 | mriedem | and the aggregates are in the API DB now, | |
| 15:27:36 | jaypipes | gibi: was just joking you. | |
| 15:27:43 | mriedem | so this is an upcall attempt from the compute service, in a cell with no access to the api db | |
| 15:28:07 | gibi | jaypipes: ohh. OK. You got me :) | |
| 15:34:04 | mriedem | gibi: i think we could deal with the source allocation cleanup bug as a backport | |
| 15:39:35 | gibi | mriedem: ack | |
| 15:41:11 | mriedem | it's only a problem unless the compute comes back online | |
| 15:41:21 | mriedem | s/unless/until/ | |