| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-07-15 | |||
| 17:49:10 | gmann | gibi: dansmith melwitt sean-k-mooney As we need to do the hypervisor uuid support via microversion, and while updating spec for that, I thought it is good chance to remove the legacy way of force host things (via availability_zone) in same microversion + standardizing existing field itself instead of adding new one. | |
| 17:49:45 | gmann | with that I will leave this for xena and we can discuss in PTG for the improvement I added here https://review.opendev.org/c/openstack/nova-specs/+/793011/3/specs/xena/approved/allow-project-admin-list-hypervisors.rst#44 | |
| 17:51:42 | dansmith | gmann: I'm okay with that and I think others are pro-that as well | |
| 17:52:01 | gibi | gmann: ack. please add it to the ptg etherhpad https://etherpad.opendev.org/p/nova-yoga-ptg | |
| 17:52:29 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] move port creation to the NeutronFixture https://review.opendev.org/c/openstack/nova/+/787206 | |
| 17:52:29 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] create pps resource on OVS agent RP https://review.opendev.org/c/openstack/nova/+/787205 | |
| 17:52:30 | opendevreview | Balazs Gibizer proposed openstack/nova master: Detect extended_resource_request neutron API extension https://review.opendev.org/c/openstack/nova/+/793618 | |
| 17:52:30 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] neutron fixture for extended resource request https://review.opendev.org/c/openstack/nova/+/794306 | |
| 17:52:31 | opendevreview | Balazs Gibizer proposed openstack/nova master: Reject server operations with extended resource req https://review.opendev.org/c/openstack/nova/+/793620 | |
| 17:52:31 | opendevreview | Balazs Gibizer proposed openstack/nova master: Reject server create with extended resource req https://review.opendev.org/c/openstack/nova/+/793619 | |
| 17:52:32 | opendevreview | Balazs Gibizer proposed openstack/nova master: Bump os-resource-classes to 1.1.0 https://review.opendev.org/c/openstack/nova/+/800976 | |
| 17:52:32 | opendevreview | Balazs Gibizer proposed openstack/nova master: Add same_subtree field to RequestLevelParams https://review.opendev.org/c/openstack/nova/+/791503 | |
| 17:52:42 | gmann | sure | |
| 17:59:34 | opendevreview | Balazs Gibizer proposed openstack/nova master: Bump min placement microversion to 1.36 https://review.opendev.org/c/openstack/nova/+/791504 | |
| 18:01:07 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support same_subtree in allocation_canadidate query https://review.opendev.org/c/openstack/nova/+/791505 | |
| 18:01:08 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] refactor assertPortMatchesAllocation https://review.opendev.org/c/openstack/nova/+/792458 | |
| 18:01:09 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] refactor asserts in qos tests https://review.opendev.org/c/openstack/nova/+/798930 | |
| 18:05:16 | gmann | gibi: done | |
| 18:07:16 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] ports with both bw and pps resources https://review.opendev.org/c/openstack/nova/+/792394 | |
| 18:07:22 | opendevreview | Balazs Gibizer proposed openstack/nova master: Parse extended resource request from the port data https://review.opendev.org/c/openstack/nova/+/800085 | |
| 18:07:32 | opendevreview | Balazs Gibizer proposed openstack/nova master: Transfer RequestLevelParams from ports to scheduling https://review.opendev.org/c/openstack/nova/+/791506 | |
| 18:14:54 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support move ops with extended resource request https://review.opendev.org/c/openstack/nova/+/800087 | |
| 18:14:54 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support boot with extended resource request https://review.opendev.org/c/openstack/nova/+/800086 | |
| 18:16:26 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test]Refactor interface attach with qos https://review.opendev.org/c/openstack/nova/+/800088 | |
| 18:16:27 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] move unshelve test to the proper place https://review.opendev.org/c/openstack/nova/+/793621 | |
| 18:16:27 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support interaface attach / detach with new resource request format https://review.opendev.org/c/openstack/nova/+/800089 | |
| 18:53:44 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] create pps resource on OVS agent RP https://review.opendev.org/c/openstack/nova/+/787205 | |
| 18:53:44 | opendevreview | Balazs Gibizer proposed openstack/nova master: Bump os-resource-classes to 1.1.0 https://review.opendev.org/c/openstack/nova/+/800976 | |
| 18:53:45 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] neutron fixture for extended resource request https://review.opendev.org/c/openstack/nova/+/794306 | |
| 18:53:45 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] move port creation to the NeutronFixture https://review.opendev.org/c/openstack/nova/+/787206 | |
| 18:56:19 | opendevreview | Balazs Gibizer proposed openstack/nova master: Detect extended_resource_request neutron API extension https://review.opendev.org/c/openstack/nova/+/793618 | |
| 18:57:39 | opendevreview | Balazs Gibizer proposed openstack/nova master: Reject server create with extended resource req https://review.opendev.org/c/openstack/nova/+/793619 | |
| 18:59:19 | opendevreview | Balazs Gibizer proposed openstack/nova master: Reject server operations with extended resource req https://review.opendev.org/c/openstack/nova/+/793620 | |
| 18:59:20 | opendevreview | Balazs Gibizer proposed openstack/nova master: Bump min placement microversion to 1.36 https://review.opendev.org/c/openstack/nova/+/791504 | |
| 18:59:20 | opendevreview | Balazs Gibizer proposed openstack/nova master: Add same_subtree field to RequestLevelParams https://review.opendev.org/c/openstack/nova/+/791503 | |
| 18:59:21 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support same_subtree in allocation_canadidate query https://review.opendev.org/c/openstack/nova/+/791505 | |
| 19:01:11 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] refactor assertPortMatchesAllocation https://review.opendev.org/c/openstack/nova/+/792458 | |
| 19:01:33 | spatel | sean-k-mooney hey! | |
| 19:02:02 | spatel | Any idea about this error during instance create? | |
| 19:02:03 | spatel | ERROR (BadRequest): The requested availability zone is not available (HTTP 400) (Request-ID: req-aa7f2176-105b-4da8-8516-24310a85927a) | |
| 19:02:31 | spatel | I saw this reference - https://bugs.launchpad.net/fuel/+bug/1610309 | |
| 19:02:47 | spatel | I am running stein | |
| 19:03:57 | amodi | spatel: does the az with the name u're trying to provide exist already? | |
| 19:04:36 | spatel | Yes | |
| 19:04:39 | spatel | look ate this https://paste.opendev.org/show/807515/ | |
| 19:04:59 | spatel | amodi I have created foo and its saying not available | |
| 19:05:24 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] refactor asserts in qos tests https://review.opendev.org/c/openstack/nova/+/798930 | |
| 19:05:25 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] ports with both bw and pps resources https://review.opendev.org/c/openstack/nova/+/792394 | |
| 19:05:26 | opendevreview | Balazs Gibizer proposed openstack/nova master: Parse extended resource request from the port data https://review.opendev.org/c/openstack/nova/+/800085 | |
| 19:05:28 | opendevreview | Balazs Gibizer proposed openstack/nova master: Transfer RequestLevelParams from ports to scheduling https://review.opendev.org/c/openstack/nova/+/791506 | |
| 19:07:06 | amodi | spatel: yes so it looks like u need to make it 'available' first, the instance creation error won't persist | |
| 19:07:36 | amodi | im not an expert, so that was my best guess | |
| 19:09:19 | spatel | mostly they are available when you create but this is very odd | |
| 19:16:19 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support boot with extended resource request https://review.opendev.org/c/openstack/nova/+/800086 | |
| 19:16:20 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support move ops with extended resource request https://review.opendev.org/c/openstack/nova/+/800087 | |
| 19:18:50 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test]Refactor interface attach with qos https://review.opendev.org/c/openstack/nova/+/800088 | |
| 19:18:51 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support interaface attach / detach with new resource request format https://review.opendev.org/c/openstack/nova/+/800089 | |
| 19:18:54 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] move unshelve test to the proper place https://review.opendev.org/c/openstack/nova/+/793621 | |
| 20:18:23 | spatel | found my problem, on that AZ all the compute nodes where disabled in openstack that is why it was showing not available :) | |
| 20:18:27 | spatel | sorry for confusion | |
| 21:28:07 | JayF | Is there a known issue with stable/wallaby CI? I've been trying to get https://review.opendev.org/c/openstack/nova/+/799772 through the gate and there's a barrage of random-seeming failures. The change itself is in the ironic driver; the failures are clearly unrelated. | |
| 21:28:27 | JayF | I feel a little bad rechecking something 5+ times to get it through, so I thought I'd check to ensure there's not any known issues with stable/wallaby gate. | |
| 21:30:23 | JayF | A majority, but not all of the failures have been a 400 error around Invalid Volume (details in comments on the patch) | |
| 21:31:11 | sean-k-mooney | at least on of the failures is the device detach bug for volume detach | |
| 21:31:24 | sean-k-mooney | Device detach failed for vdb: Run out of retry while detaching device vdb with device alias virtio-disk1 | |
| 21:31:31 | JayF | That sounds like it matches the error I was referring to | |
| 21:31:32 | sean-k-mooney | JayF: that is a known isue | |
| 21:31:42 | JayF | Is there a backportable patch for it? Or just keep slamming rechecks | |
| 21:31:59 | sean-k-mooney | there is a fix for it im not sure if it has been backported | |
| 21:32:26 | sean-k-mooney | tl;dr qemu change the behavior so that trying to detach a volume that is detaching woudl cancel the detach and reslut in an error | |
| 21:32:34 | JayF | hmm. Maybe I'll dig and see if it backports cleanly. I obviously know a lot more about Ironic than nova, but if I can get it fixed why not :D | |
| 21:32:34 | sean-k-mooney | that broke nova retry logic | |
| 21:32:46 | sean-k-mooney | the fix is to use event instead of a retry loop | |
| 21:33:07 | sean-k-mooney | JayF: gibi and lyarwood have looked at backporting it | |
| 21:33:19 | sean-k-mooney | let me see if i can find it | |
| 21:33:52 | JayF | This patch I'm trying to land fixes a nasty bug in Ironic that we have confirmed multiple operators are experiencing, so I'm trying to get it backported as far as possible :D I appreciate the help | |
| 21:35:11 | sean-k-mooney | did you say this was wallaby or is it an older release | |
| 21:35:37 | sean-k-mooney | it looks like ist on wallaby https://review.opendev.org/c/openstack/nova/+/788720 | |
| 21:35:49 | JayF | Right now wallaby, when that lands I'll go w-1, and so on until it's not clean :) | |
| 21:36:03 | JayF | but I know my deployment will need it for wallaby, and a couple others at a minimum | |
| 21:36:40 | JayF | Uh oh. So it shouldn't be happening :-| | |
| 21:36:53 | sean-k-mooney | so the event change patch has been backported to wallaby already so you might be hitting the other detach bug | |
| 21:37:36 | sean-k-mooney | there is an issue where the guest seam to not respond to the detach properly in all caes | |
| 21:37:54 | sean-k-mooney | as a workaround we were looking ad modifying tempest to not do detaches when not needed | |
| 21:39:24 | JayF | That sounds good, so for now I'm going to keep rechecking and hope to win the gate-lottery. I'd offer to review the tempest workaround but I'm not sure a +1 form me would be that helpful :D | |
| 21:40:14 | sean-k-mooney | JayF: https://review.opendev.org/c/openstack/tempest/+/794757 i think this might be it | |
| 21:40:53 | sean-k-mooney | unfortuetly lee i snot around for the next 2 week due to real world stuff so not sure if that is going to proguress | |
| 21:41:19 | JayF | That's fine :) I'm honestly surprised to have gotten the concierge bug walkthrough with you, and I appreciate it :D. | |
| 21:41:25 | sean-k-mooney | JayF: in general device detach has been flakeing in the jobs for the last why and it does not really seam to be related ot change in nova code | |
| 21:41:44 | JayF | It's extra annoying for VM errors to be cratering an ironic-driver-only change :P | |
| 21:41:50 | sean-k-mooney | the latest issue may be a regression in qemu | |
| 21:41:57 | sean-k-mooney | JayF: yes | |
| 21:42:31 | JayF | I guess targetting a bunch of different qemu versions might have a similar problems to what we see in Ironic with ... unfortunately designed hardware BMCs :P | |
| 21:43:39 | sean-k-mooney | ill ask gibi tomorrow if we should consider making the job non voteing. it generally has not been wedgeing the gate but it has been failing frequetly enough that we might want to consider skiping the test or just manually reviewing the job for now | |
| 21:44:47 | JayF | thanks! I'll keep idling in here, feel free to ping me if there's anything I can do to help :) | |
| 21:45:07 | JayF | [or if you ever need someone with the big review hammer in Ironic :D] | |
| 21:45:48 | sean-k-mooney | i wonder if we could make the live migation jobs skip on change that only affect the ironic driver | |
| 21:46:15 | sean-k-mooney | you know since i dont precive that mattering to your use case unless the laws of physic cahnge | |
| 21:46:51 | JayF | I think that's a potentially wise change to make, but don't underestimate the ability of python to violate the laws of physics :P | |
| 21:47:43 | sean-k-mooney | im pretty sure we could add nova/test/unit/virt/ironic and nova/virt/ironic to the irrelevent files list | |