| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-07-23 | |||
| 10:20:55 | bauzas | cdent: can you please refresh my mind ? | |
| 10:21:13 | bauzas | cdent: we stopped auto-healing allocations from the RT since Queens, right? | |
| 10:21:28 | cdent | yes, that's how I remember it | |
| 10:21:51 | bauzas | cdent: on a RH BZ, some customer got some phantom allocations | |
| 10:22:12 | bauzas | cdent: so I wonder how their allocations were created | |
| 10:22:27 | bauzas | but the related instance wasn't there | |
| 10:23:51 | cdent | I have a vague memory of some bugs with cleaning up allocations under certain failure conditions. Do you know whether it was a normal server create or a migration? | |
| 10:24:05 | bauzas | no sorry | |
| 10:24:20 | bauzas | I think it was a server create | |
| 10:24:25 | bauzas | but I'm not sure | |
| 10:27:48 | cdent | any chance they deleted the compute service? any of these bugs look relevant? | |
| 10:27:49 | cdent | https://bugs.launchpad.net/nova/+bug/1756179 | |
| 10:27:50 | openstack | Launchpad bug 1756179 in OpenStack Compute (nova) queens "deleting a nova-compute service leaves orphaned records in placement and host mapping" [Medium,Fix committed] - Assigned to Surya Seetharaman (tssurya) | |
| 10:27:54 | cdent | https://bugs.launchpad.net/nova/+bug/1679750 | |
| 10:27:55 | openstack | Launchpad bug 1679750 in OpenStack Compute (nova) queens "Allocations are not cleaned up in placement for instance 'local delete' case" [Medium,Fix committed] - Assigned to Matt Riedemann (mriedem) | |
| 10:28:03 | cdent | https://bugs.launchpad.net/nova/+bug/1662867 | |
| 10:28:04 | openstack | Launchpad bug 1662867 in OpenStack Compute (nova) queens "update_available_resource_for_node racing instance deletion" [Medium,Fix committed] - Assigned to Lee Yarwood (lyarwood) | |
| 10:32:57 | cdent | bauzas: I gotta step away, but will be back. I hope some of the above is useful | |
| 10:33:16 | bauzas | cdent: thanks for the help, I'll look at the bugs | |
| 10:33:35 | bauzas | and I'll try to discuss with the customer | |
| 11:12:07 | ratailor | could anybody review this https://review.openstack.org/#/c/498334/ need one more +2. | |
| 11:13:05 | ratailor | bauzas, ^^ | |
| 11:16:20 | s10 | Hello. Is there any possibility to somehow optimise host_state.update(), which runs on every instance scheduling? Specifically this: https://github.com/openstack/nova/blob/master/nova/scheduler/host_manager.py#L181 | |
| 11:17:12 | s10 | Our tests show, that this step (load list of instances to host_state) takes ~10 seconds for deployments with thousands of instances. | |
| 11:22:34 | openstackgerrit | Andrey Volkov proposed openstack/nova master: Docs: Add Placement to Nova system architecture https://review.openstack.org/584338 | |
| 11:25:14 | s10 | So if we want to start 1000 new instances with 6 nova-scheduler process, without this step (if we commented it out), all of them are being started tens of minutes minutes faster. | |
| 11:26:23 | s10 | And the only place, where host_state.instances is being used is ServerGroupAntiAffinityFilter and ServerGroupAffinityFilter... | |
| 11:30:58 | ispp | Hi, could anyone give me a hand with this? https://bugs.launchpad.net/nova/+bug/1783079 | |
| 11:30:59 | openstack | Launchpad bug 1783079 in OpenStack Compute (nova) "Unable to attach interface to a VM" [Undecided,New] | |
| 11:35:11 | openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Remove reference to transient domain when detaching devices https://review.openstack.org/584433 | |
| 11:35:42 | lyarwood | stephenfin: https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bug/1764883 - would you mind taking a swing at this today if you have time? | |
| 11:54:06 | openstackgerrit | Andrey Volkov proposed openstack/nova master: Docs: Add Placement to Nova system architecture https://review.openstack.org/584338 | |
| 11:54:40 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: Add queued_for_delete field to InstanceMapping object https://review.openstack.org/566795 | |
| 11:54:41 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: Online migration tool for populating queued-for-delete https://review.openstack.org/582536 | |
| 11:54:42 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: Update queued-for-delete from the ComputeAPI during deletion/restoration https://review.openstack.org/566813 | |
| 11:54:43 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: Return a minimal construct for nova service-list when a cell is down https://review.openstack.org/584829 | |
| 12:20:30 | openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Wire up a force disconnect_volume flag https://review.openstack.org/584849 | |
| 12:20:31 | openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP libvirt: Forcibly disconnect volumes during post_live_migration https://review.openstack.org/584850 | |
| 12:32:18 | openstackgerrit | huanhongda proposed openstack/nova master: hypervisor-stats shows wrong disk usages with shared storage https://review.openstack.org/149878 | |
| 12:48:18 | stephenfin | lyarwood: Sure | |
| 12:54:20 | gibi | stephenfin: hi! You were +2 on https://review.openstack.org/#/c/410297 before but I lost the +2 in merge conflict resolution. Could you look at it again please? | |
| 12:55:00 | stephenfin | gibi: yessir | |
| 12:55:05 | gibi | stephenfin: thank you sir | |
| 13:03:00 | stephenfin | gibi: One question here https://review.openstack.org/#/c/410297/42/nova/tests/unit/compute/test_compute_api.py | |
| 13:03:48 | gibi | stephenfin: let me check it locally without that line | |
| 13:04:03 | gibi | stephenfin: could be some rebase artifact | |
| 13:12:07 | gibi | stephenfin: tests pass without it so I'm going to respin the patch | |
| 13:13:38 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Transform missing delete notifications https://review.openstack.org/410297 | |
| 13:14:13 | gibi | stephenfin: ^^ removed the extra line | |
| 13:14:47 | stephenfin | gibi: Cool. +2 now | |
| 13:15:54 | gibi | cdent: stephenfin thanks | |
| 13:16:08 | gibi | bahh | |
| 13:16:11 | gibi | stephenfin: thanks | |
| 13:22:23 | kashyap | mdbooth_: Hi, when you get a moment, I'm blind and can't figure out why 'migrate_uri' is still "None" in the actual call here: http://paste.openstack.org/show/726442/ | |
| 13:22:39 | kashyap | Please enlighten, throw rotten tomatoes, etc. | |
| 13:24:25 | alex_xu | mriedem: re: http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2018-07-20.log.html#t2018-07-20T13:20:30 | |
| 13:24:37 | alex_xu | mriedem: agree with just merge 'server create' part in Rocky | |
| 13:25:23 | tssurya | alex_xu: so the merge into view builder would only be in Stein? | |
| 13:26:23 | alex_xu | tssurya: yea, is there anything you need about view builder, I see there are something you need, but I didn't follow it yet | |
| 13:26:55 | tssurya | alex_xu: yea, its mainly for this patch: https://review.openstack.org/#/c/567785/ | |
| 13:27:18 | tssurya | related to the handling a down cell, I need to basically return a minimal response for nova show and list servers | |
| 13:27:42 | alex_xu | tssurya: got it, let me check, thanks | |
| 13:27:46 | tssurya | for which I would have to handle it seperately for each of the deprecated extensions since they are being merged into the response individually | |
| 13:27:51 | tssurya | alex_xu: thanks | |
| 13:29:21 | mriedem | alex_xu: yeah gmann has some patches up in the same series for moving things from extensions to server view builder, | |
| 13:29:36 | mriedem | but with the state of the gate the last couple of weeks, i doubt all of this will get merged before feature freeze | |
| 13:31:41 | tssurya | mriedem: meanwhile I have a patch for nova service-list here : https://review.openstack.org/#/c/584829/ | |
| 13:31:49 | tssurya | which doesn't depend on those changes | |
| 13:32:22 | mriedem | tssurya: i assumed that the service list and server list changes for partial results would all be in the same microversion | |
| 13:32:30 | mriedem | it's kind of weird if they aren't | |
| 13:32:31 | tssurya | and then I will also do the poliy change for nova boot | |
| 13:32:37 | tssurya | mriedem: true that, | |
| 13:32:54 | tssurya | so we stall the API changes for now ? | |
| 13:33:11 | tssurya | or nvm, I will keep working on them and we can see, | |
| 13:33:17 | openstackgerrit | Takashi NATSUME proposed openstack/python-novaclient master: Fix the help text for server-group-create https://review.openstack.org/584709 | |
| 13:33:23 | mriedem | i don't think the server list/show partial results stuff will get in rocky at this rate, if i'm being honest | |
| 13:33:42 | tssurya | mriedem: got it | |
| 13:33:46 | mriedem | i think we're way too close to feature freeze for a change like that, and even if we approved it all today, it would take 4 days to merge | |
| 13:34:10 | mriedem | but we can see what dansmith and melwitt think about doing the service list partial results in a separate microversion for rocky since that's much smaller scope and admin-only so impacts are smaller | |
| 13:34:24 | gmann | mriedem: yeah, 5-6 are on zuul -2 let’s see how much gets in | |
| 13:34:27 | tssurya | mriedem: hmm ack | |
| 13:35:08 | mriedem | tssurya: my personal goal for the bp is getting the queued_for_delete data migration in for rocky, which means choosing between yours and dan's | |
| 13:35:33 | tssurya | mriedem: right, okay let's wait for dansmith then | |
| 13:35:46 | dansmith | mriedem: I guess I would think returning shell results for missing services would be super low priority to me | |
| 13:36:09 | dansmith | mriedem: if a cell is down and we just return the services we can find, I would think the admins would be fine with that given they know the cell is down | |
| 13:36:11 | mriedem | dansmith: as in might as well make them a single microversion | |
| 13:36:33 | mriedem | them = nova list & service list | |
| 13:36:47 | dansmith | mriedem: we are already returning partial results for service list if a cell is down right? | |
| 13:36:54 | mriedem | yes | |
| 13:37:06 | mriedem | tssurya did the fix for that as a bug | |
| 13:37:16 | tssurya | not partial results, | |
| 13:37:20 | tssurya | like skips that cell | |
| 13:37:21 | dansmith | I'm saying, focus on instance list returning shell instances to patch up the instance list, but not care about service list | |
| 13:37:28 | dansmith | tssurya: that's what I mean by partial results | |
| 13:37:34 | dansmith | just omitting the downed cell | |
| 13:37:37 | tssurya | ah yes sorry, | |
| 13:37:57 | dansmith | I'm not sure why we really need to try to patch up the service list tbh | |
| 13:38:04 | dansmith | and I imagine it's going to be hard | |
| 13:38:15 | mriedem | you can patch up the compute services, but that's about it | |
| 13:38:38 | tssurya | yea just the host and binary fields | |