Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2019-12-11
15:19:28 sean-k-mooney yep so basicaly the downstream issue was related to fixing allocation for undercloud (ironic) node where the customer acidentally deleted the service
15:20:34 mriedem stephenfin: while you're still around, i need you and efried to come to an agreement on https://review.opendev.org/#/c/696582/
15:20:34 sean-k-mooney because it was ironic and queens that perodic saved them. but they were asking what would happen if the same happend on the overcloud(libvirt nodes)
15:21:03 sean-k-mooney which was when we noticed that the heal_allcoation command was not on queens just rocky
15:34:59 mriedem speaking of which, melwitt - should i continue backporting these to rocky? https://review.opendev.org/#/q/topic:heal_allocations_dry_run+(status:open+OR+status:merged)
15:42:13 openstackgerrit Matt Riedemann proposed openstack/nova master: Add troubleshooting doc about rebuilding the placement db https://review.opendev.org/698517
15:42:15 mriedem efried: canori01: ^ brain dump
16:00:23 melwitt mriedem: if you do, it would be a help
16:00:34 melwitt I support ++
16:06:26 openstackgerrit Balazs Gibizer proposed openstack/nova master: Support live migration with qos ports https://review.opendev.org/695905
16:06:45 gibi mriedem: the happy case support for live migration is now complete in ^^
16:10:19 efried stephenfin: re https://review.opendev.org/#/c/696582/ -- I want the shiny new command in the docs for sure. And I'm not sure your PS2 commentary meant you wanted it actually removed -- did it?
16:12:28 mriedem gibi: ack - throw that series into the runways etherpad?
16:12:43 mriedem i'm also waiting on efried to come back on https://review.opendev.org/#/c/696541/
16:13:25 efried mriedem: looking now
16:13:43 gibi mriedem: ack, adding...
16:14:36 mriedem gibi: i also replied to your comments on https://review.opendev.org/#/c/637070/ but then accidentally rebased
16:14:57 gibi mriedem: ack, put it in my queue
16:19:13 efried mriedem, gibi: I'm +2 on https://review.opendev.org/#/c/696541/
16:19:25 gibi efried: thanks
16:25:06 openstackgerrit Lee Yarwood proposed openstack/nova master: libvirt: Remove native LUKS compat code https://review.opendev.org/669121
16:25:15 mriedem i'm not
16:29:07 openstackgerrit Matt Riedemann proposed openstack/nova stable/rocky: Add --dry-run option to heal_allocations CLI https://review.opendev.org/698525
16:30:17 gibi mriedem: ack, I will need to get back to that patch tomorrow
16:31:28 gibi mriedem: most of the nois is there because this patch went through couple PSs with different solutions
16:31:38 gibi mriedem: I will get back to it tomorrow and clean it up
16:33:03 sean-k-mooney gibi: o/
16:38:25 openstackgerrit Matt Riedemann proposed openstack/nova stable/rocky: Add --instance option to heal_allocations https://review.opendev.org/698529
16:38:53 openstackgerrit sean mooney proposed openstack/nova stable/train: Block rebuild when NUMA topology changed https://review.opendev.org/698530
16:39:52 openstackgerrit Matt Riedemann proposed openstack/nova stable/rocky: Add BFV wrinkle to TestNovaManagePlacementHealAllocations https://review.opendev.org/698531
16:40:54 openstackgerrit sean mooney proposed openstack/nova stable/train: Disable NUMATopologyFilter on rebuild https://review.opendev.org/698532
16:45:01 sean-k-mooney mriedem: since im backporting stuff should i backport https://review.opendev.org/#/c/695118/ which is the fix to https://bugs.launchpad.net/nova/+bug/1847367
16:45:01 openstack Launchpad bug 1847367 in OpenStack Compute (nova) "Images with hw:vif_multiqueue_enabled can be limited to 8 queues even if more are supported" [Undecided,Fix released] - Assigned to sean mooney (sean-k-mooney)
16:45:20 sean-k-mooney mriedem: it was opened against rocky so i guess it should go back at least that far
16:47:56 mriedem i'd probably let eandersson or his minions do the backports if they want them
16:49:01 efried mriedem: If I delete a shelved instance, does the virt driver ever get a crack at cleaning up?
16:49:01 efried a) if not offloaded, I assume yes, because the instance is still on the host
16:49:01 efried b) if offloaded, I assume no, because whose virt driver would we hit?
16:49:20 mriedem correct
16:49:25 efried thx
16:49:52 mriedem is this vpmem or accelerator related?
16:51:17 efried neither, vtpm
16:52:20 efried Means I think we're going to have to delete the swift obj from the conductor rather than the virt driver.
16:52:47 efried which kinda sucks because it's a virt driver-specific thing. At least the contents are.
16:52:51 mriedem i haven't been paying attentiong to the vtpm hullabaloo
16:52:58 mriedem *attention
16:53:17 mriedem conductor isn't involved in the server delete btw,
16:53:25 mriedem so the api would be doing whatever external cleanup is necessary
16:53:32 efried sigh, that's what I meant.
16:53:39 efried "controller"
16:53:47 efried can't imagine why I confuse that with "conductor".
16:54:02 efried though by now you would have thought I could get it the f right.
16:54:09 efried maybe after 8 years...
16:54:20 mriedem with enough pedantic ridicule you'll get there!
16:54:32 efried is that what it's for? gtk
16:54:51 efried I thought it was just plain old schoolyard bullying.
17:04:50 canori01 mriedem: That seems to have worked well. I'm still doing tests, but looks promising. I had to do it slightly differently. I'm running rocky, but my placement db is not broken out. So instead of dropping and recreating the db, I had to truncate the tables that placement uses. Then I bounced nova-compute and did the healing and aggregate syncing
17:07:35 mriedem ah cool
17:07:38 mriedem glad it's working
17:16:31 openstackgerrit Merged openstack/nova stable/queens: Do not update root_device_name during guest config https://review.opendev.org/696469
17:16:39 openstackgerrit Merged openstack/nova master: nova-net: Drop nova-network-base security group tests https://review.opendev.org/696508
17:19:15 sean-k-mooney efried: the virt driver should have cleaned up evertying on the host as part of the offload step
17:19:42 sean-k-mooney oh i see this is related to vtpm
17:24:20 openstackgerrit Stephen Finucane proposed openstack/nova master: trivial: Resolve (most) flake8 3.x issues https://review.opendev.org/695732
17:24:21 openstackgerrit Stephen Finucane proposed openstack/nova master: Switch to flake8 3.x https://review.opendev.org/695733
17:31:32 mriedem wtf, so back on dec 5 i had a passing run of nova-multi-cell with migration tests enabled. now since the 9th with a new run all migration tests are failing because once the confirmed resized server is active again the api is saying the flavor is the old id even though i can see in the conductor logs where right before that the instance has the correct flavor
17:31:50 mriedem the api is pulling from the correct cell
17:32:50 openstackgerrit Stephen Finucane proposed openstack/nova master: Add resource provider allocation unset example to troubleshooting doc https://review.opendev.org/696582
17:33:12 stephenfin mriedem: Revert that if you don't like what I've done. It was just easier do it than explain what I wanted in a comment ^
17:33:23 stephenfin efried: you asked about that earlier ^
17:34:23 mriedem ok
17:40:35 openstackgerrit Merged openstack/nova master: Use provider mappings from Placement (mostly) https://review.opendev.org/696992
17:40:42 openstackgerrit Merged openstack/nova master: Create a controller for qga when SEV is used https://review.opendev.org/693072
17:40:51 openstackgerrit Merged openstack/nova master: Extend NeutronFixture to handle multiple bindings https://review.opendev.org/696246
17:40:58 openstackgerrit Merged openstack/nova master: Do not mock setup net and migrate inst in NeutronFixture https://review.opendev.org/696247
18:22:23 efried mriedem: are you okay with stephenfin's update to at doc patch? Since you both have hands in it, if you're okay with it I'll fast approve, taking stephenfin's authorship as implicit approval and since it's docs...
18:22:41 melwitt johnthetubaguy: hey, are you around bychance?
18:37:12 mriedem efried: yet to look at it
18:37:29 mriedem but soon, very soon....muwahhaaha
18:40:02 openstackgerrit Matt Riedemann proposed openstack/nova master: Add cross-cell resize tests for _poll_unconfirmed_resizes https://review.opendev.org/698322
18:40:03 openstackgerrit Matt Riedemann proposed openstack/nova master: DNM: debug cross-cell resize https://review.opendev.org/698304
18:41:25 openstackgerrit Matt Riedemann proposed openstack/nova master: DNM: debug cross-cell resize https://review.opendev.org/698304
18:44:19 mriedem efried: stephenfin's changes look fine to me
18:45:00 efried +A
18:45:26 mriedem if someone can push through https://review.opendev.org/#/c/696509/ it's the current bottom of the nova-net removal series; it looks like the rest of the series after that is now in merge conflict so the whole thing has to be rebased.
18:52:46 efried mriedem: I'm gonna try to hit that today, but it keeps getting pushed down my stack :(
18:53:39 mriedem ack it's pretty mechanical so anyone should be able to hit it
19:02:40 melwitt TheJulia: do you know whether cpu_arch is supposed to be required from an ironic pov? https://github.com/openstack/nova/blob/master/nova/virt/ironic/driver.py#L103-L106 is it valid for a deployment *not* to specify cpu_arch? (for example, in a single arch environment) context is this bug https://bugzilla.redhat.com/show_bug.cgi?id=1688838
19:02:40 openstack bugzilla.redhat.com bug 1688838 in openstack-nova "Ironic should not treat cpu_arch as mandatory" [Medium,New] - Assigned to mwitt
19:06:12 sean-k-mooney gibi: by the way i assume attaching a port with a resocue request to a existing instance is still supported correct. it was declared out of scope in stien and it was not mentioned as adressed in train. is that on your ussuri todo list?
19:08:19 sean-k-mooney i assume we would have updated https://github.com/openstack/nova/blob/master/releasenotes/notes/reject-interface-attach-with-port-resource-request-17473ddc5a989a2a.yaml if it was supported or added another release note
19:18:41 melwitt jroll: ^ maybe you might know (ironic driver question from me)
19:31:46 mriedem sean-k-mooney: not supported - the request has to be validated with placement on attach and that isn't done
19:32:11 sean-k-mooney ya that is what i understood too
19:32:27 sean-k-mooney im doing a downstream docs review and wanted to make sure that was called out
19:33:13 mnaser eandersson: is this similar to what you've been running into? https://bugs.launchpad.net/nova/+bug/1835637
19:33:13 openstack Launchpad bug 1835637 in OpenStack Compute (nova) "(404) NOT_FOUND - failed to perform operation on queue 'notifications.info' in vhost '/nova' due to timeout" [Undecided,Incomplete]
20:04:59 openstackgerrit Sundar Nadathur proposed openstack/nova master: ksa auth conf and client for Cyborg access https://review.opendev.org/631242
20:05:00 openstackgerrit Sundar Nadathur proposed openstack/nova master: Add Cyborg device profile groups to request spec. https://review.opendev.org/631243
20:05:00 openstackgerrit Sundar Nadathur proposed openstack/nova master: Define Cyborg ARQ binding notification event. https://review.opendev.org/692707

Earlier   Later