| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-07-15 | |||
| 15:45:47 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] move unshelve test to the proper place https://review.opendev.org/c/openstack/nova/+/793621 | |
| 15:50:14 | elodilles | melwitt: Lee explained somewhere why it is not failing in Train, but I don't find that comment now :/ but anyway, fortunately Train is not blocked by this \o/ | |
| 15:51:22 | melwitt | ack | |
| 17:02:43 | tosky | elodilles, melwitt: yeah, I've added my comments to the patch, I think it makes sense anyway (the long term plan was to remove the legacy jobs anyway) | |
| 17:17:55 | opendevreview | Balazs Gibizer proposed openstack/placement master: Bump os-resource-classes requirements https://review.opendev.org/c/openstack/placement/+/796595 | |
| 17:30:49 | opendevreview | Balazs Gibizer proposed openstack/placement master: Bump os-resource-classes requirements https://review.opendev.org/c/openstack/placement/+/796595 | |
| 17:40:27 | opendevreview | Balazs Gibizer proposed openstack/placement master: Bump os-resource-classes requirements https://review.opendev.org/c/openstack/placement/+/796595 | |
| 17:49:10 | gmann | gibi: dansmith melwitt sean-k-mooney As we need to do the hypervisor uuid support via microversion, and while updating spec for that, I thought it is good chance to remove the legacy way of force host things (via availability_zone) in same microversion + standardizing existing field itself instead of adding new one. | |
| 17:49:45 | gmann | with that I will leave this for xena and we can discuss in PTG for the improvement I added here https://review.opendev.org/c/openstack/nova-specs/+/793011/3/specs/xena/approved/allow-project-admin-list-hypervisors.rst#44 | |
| 17:51:42 | dansmith | gmann: I'm okay with that and I think others are pro-that as well | |
| 17:52:01 | gibi | gmann: ack. please add it to the ptg etherhpad https://etherpad.opendev.org/p/nova-yoga-ptg | |
| 17:52:29 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] create pps resource on OVS agent RP https://review.opendev.org/c/openstack/nova/+/787205 | |
| 17:52:29 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] move port creation to the NeutronFixture https://review.opendev.org/c/openstack/nova/+/787206 | |
| 17:52:30 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] neutron fixture for extended resource request https://review.opendev.org/c/openstack/nova/+/794306 | |
| 17:52:30 | opendevreview | Balazs Gibizer proposed openstack/nova master: Detect extended_resource_request neutron API extension https://review.opendev.org/c/openstack/nova/+/793618 | |
| 17:52:31 | opendevreview | Balazs Gibizer proposed openstack/nova master: Reject server create with extended resource req https://review.opendev.org/c/openstack/nova/+/793619 | |
| 17:52:31 | opendevreview | Balazs Gibizer proposed openstack/nova master: Reject server operations with extended resource req https://review.opendev.org/c/openstack/nova/+/793620 | |
| 17:52:32 | opendevreview | Balazs Gibizer proposed openstack/nova master: Add same_subtree field to RequestLevelParams https://review.opendev.org/c/openstack/nova/+/791503 | |
| 17:52:32 | opendevreview | Balazs Gibizer proposed openstack/nova master: Bump os-resource-classes to 1.1.0 https://review.opendev.org/c/openstack/nova/+/800976 | |
| 17:52:42 | gmann | sure | |
| 17:59:34 | opendevreview | Balazs Gibizer proposed openstack/nova master: Bump min placement microversion to 1.36 https://review.opendev.org/c/openstack/nova/+/791504 | |
| 18:01:07 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support same_subtree in allocation_canadidate query https://review.opendev.org/c/openstack/nova/+/791505 | |
| 18:01:08 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] refactor assertPortMatchesAllocation https://review.opendev.org/c/openstack/nova/+/792458 | |
| 18:01:09 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] refactor asserts in qos tests https://review.opendev.org/c/openstack/nova/+/798930 | |
| 18:05:16 | gmann | gibi: done | |
| 18:07:16 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] ports with both bw and pps resources https://review.opendev.org/c/openstack/nova/+/792394 | |
| 18:07:22 | opendevreview | Balazs Gibizer proposed openstack/nova master: Parse extended resource request from the port data https://review.opendev.org/c/openstack/nova/+/800085 | |
| 18:07:32 | opendevreview | Balazs Gibizer proposed openstack/nova master: Transfer RequestLevelParams from ports to scheduling https://review.opendev.org/c/openstack/nova/+/791506 | |
| 18:14:54 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support boot with extended resource request https://review.opendev.org/c/openstack/nova/+/800086 | |
| 18:14:54 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support move ops with extended resource request https://review.opendev.org/c/openstack/nova/+/800087 | |
| 18:16:26 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test]Refactor interface attach with qos https://review.opendev.org/c/openstack/nova/+/800088 | |
| 18:16:27 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support interaface attach / detach with new resource request format https://review.opendev.org/c/openstack/nova/+/800089 | |
| 18:16:27 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] move unshelve test to the proper place https://review.opendev.org/c/openstack/nova/+/793621 | |
| 18:53:44 | opendevreview | Balazs Gibizer proposed openstack/nova master: Bump os-resource-classes to 1.1.0 https://review.opendev.org/c/openstack/nova/+/800976 | |
| 18:53:44 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] create pps resource on OVS agent RP https://review.opendev.org/c/openstack/nova/+/787205 | |
| 18:53:45 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] move port creation to the NeutronFixture https://review.opendev.org/c/openstack/nova/+/787206 | |
| 18:53:45 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] neutron fixture for extended resource request https://review.opendev.org/c/openstack/nova/+/794306 | |
| 18:56:19 | opendevreview | Balazs Gibizer proposed openstack/nova master: Detect extended_resource_request neutron API extension https://review.opendev.org/c/openstack/nova/+/793618 | |
| 18:57:39 | opendevreview | Balazs Gibizer proposed openstack/nova master: Reject server create with extended resource req https://review.opendev.org/c/openstack/nova/+/793619 | |
| 18:59:19 | opendevreview | Balazs Gibizer proposed openstack/nova master: Reject server operations with extended resource req https://review.opendev.org/c/openstack/nova/+/793620 | |
| 18:59:20 | opendevreview | Balazs Gibizer proposed openstack/nova master: Add same_subtree field to RequestLevelParams https://review.opendev.org/c/openstack/nova/+/791503 | |
| 18:59:20 | opendevreview | Balazs Gibizer proposed openstack/nova master: Bump min placement microversion to 1.36 https://review.opendev.org/c/openstack/nova/+/791504 | |
| 18:59:21 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support same_subtree in allocation_canadidate query https://review.opendev.org/c/openstack/nova/+/791505 | |
| 19:01:11 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] refactor assertPortMatchesAllocation https://review.opendev.org/c/openstack/nova/+/792458 | |
| 19:01:33 | spatel | sean-k-mooney hey! | |
| 19:02:02 | spatel | Any idea about this error during instance create? | |
| 19:02:03 | spatel | ERROR (BadRequest): The requested availability zone is not available (HTTP 400) (Request-ID: req-aa7f2176-105b-4da8-8516-24310a85927a) | |
| 19:02:31 | spatel | I saw this reference - https://bugs.launchpad.net/fuel/+bug/1610309 | |
| 19:02:47 | spatel | I am running stein | |
| 19:03:57 | amodi | spatel: does the az with the name u're trying to provide exist already? | |
| 19:04:36 | spatel | Yes | |
| 19:04:39 | spatel | look ate this https://paste.opendev.org/show/807515/ | |
| 19:04:59 | spatel | amodi I have created foo and its saying not available | |
| 19:05:24 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] refactor asserts in qos tests https://review.opendev.org/c/openstack/nova/+/798930 | |
| 19:05:25 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] ports with both bw and pps resources https://review.opendev.org/c/openstack/nova/+/792394 | |
| 19:05:26 | opendevreview | Balazs Gibizer proposed openstack/nova master: Parse extended resource request from the port data https://review.opendev.org/c/openstack/nova/+/800085 | |
| 19:05:28 | opendevreview | Balazs Gibizer proposed openstack/nova master: Transfer RequestLevelParams from ports to scheduling https://review.opendev.org/c/openstack/nova/+/791506 | |
| 19:07:06 | amodi | spatel: yes so it looks like u need to make it 'available' first, the instance creation error won't persist | |
| 19:07:36 | amodi | im not an expert, so that was my best guess | |
| 19:09:19 | spatel | mostly they are available when you create but this is very odd | |
| 19:16:19 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support boot with extended resource request https://review.opendev.org/c/openstack/nova/+/800086 | |
| 19:16:20 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support move ops with extended resource request https://review.opendev.org/c/openstack/nova/+/800087 | |
| 19:18:50 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test]Refactor interface attach with qos https://review.opendev.org/c/openstack/nova/+/800088 | |
| 19:18:51 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support interaface attach / detach with new resource request format https://review.opendev.org/c/openstack/nova/+/800089 | |
| 19:18:54 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] move unshelve test to the proper place https://review.opendev.org/c/openstack/nova/+/793621 | |
| 20:18:23 | spatel | found my problem, on that AZ all the compute nodes where disabled in openstack that is why it was showing not available :) | |
| 20:18:27 | spatel | sorry for confusion | |
| 21:28:07 | JayF | Is there a known issue with stable/wallaby CI? I've been trying to get https://review.opendev.org/c/openstack/nova/+/799772 through the gate and there's a barrage of random-seeming failures. The change itself is in the ironic driver; the failures are clearly unrelated. | |
| 21:28:27 | JayF | I feel a little bad rechecking something 5+ times to get it through, so I thought I'd check to ensure there's not any known issues with stable/wallaby gate. | |
| 21:30:23 | JayF | A majority, but not all of the failures have been a 400 error around Invalid Volume (details in comments on the patch) | |
| 21:31:11 | sean-k-mooney | at least on of the failures is the device detach bug for volume detach | |
| 21:31:24 | sean-k-mooney | Device detach failed for vdb: Run out of retry while detaching device vdb with device alias virtio-disk1 | |
| 21:31:31 | JayF | That sounds like it matches the error I was referring to | |
| 21:31:32 | sean-k-mooney | JayF: that is a known isue | |
| 21:31:42 | JayF | Is there a backportable patch for it? Or just keep slamming rechecks | |
| 21:31:59 | sean-k-mooney | there is a fix for it im not sure if it has been backported | |
| 21:32:26 | sean-k-mooney | tl;dr qemu change the behavior so that trying to detach a volume that is detaching woudl cancel the detach and reslut in an error | |
| 21:32:34 | sean-k-mooney | that broke nova retry logic | |
| 21:32:34 | JayF | hmm. Maybe I'll dig and see if it backports cleanly. I obviously know a lot more about Ironic than nova, but if I can get it fixed why not :D | |
| 21:32:46 | sean-k-mooney | the fix is to use event instead of a retry loop | |
| 21:33:07 | sean-k-mooney | JayF: gibi and lyarwood have looked at backporting it | |
| 21:33:19 | sean-k-mooney | let me see if i can find it | |
| 21:33:52 | JayF | This patch I'm trying to land fixes a nasty bug in Ironic that we have confirmed multiple operators are experiencing, so I'm trying to get it backported as far as possible :D I appreciate the help | |
| 21:35:11 | sean-k-mooney | did you say this was wallaby or is it an older release | |
| 21:35:37 | sean-k-mooney | it looks like ist on wallaby https://review.opendev.org/c/openstack/nova/+/788720 | |
| 21:35:49 | JayF | Right now wallaby, when that lands I'll go w-1, and so on until it's not clean :) | |
| 21:36:03 | JayF | but I know my deployment will need it for wallaby, and a couple others at a minimum | |
| 21:36:40 | JayF | Uh oh. So it shouldn't be happening :-| | |
| 21:36:53 | sean-k-mooney | so the event change patch has been backported to wallaby already so you might be hitting the other detach bug | |
| 21:37:36 | sean-k-mooney | there is an issue where the guest seam to not respond to the detach properly in all caes | |
| 21:37:54 | sean-k-mooney | as a workaround we were looking ad modifying tempest to not do detaches when not needed | |
| 21:39:24 | JayF | That sounds good, so for now I'm going to keep rechecking and hope to win the gate-lottery. I'd offer to review the tempest workaround but I'm not sure a +1 form me would be that helpful :D | |
| 21:40:14 | sean-k-mooney | JayF: https://review.opendev.org/c/openstack/tempest/+/794757 i think this might be it | |
| 21:40:53 | sean-k-mooney | unfortuetly lee i snot around for the next 2 week due to real world stuff so not sure if that is going to proguress | |
| 21:41:19 | JayF | That's fine :) I'm honestly surprised to have gotten the concierge bug walkthrough with you, and I appreciate it :D. | |
| 21:41:25 | sean-k-mooney | JayF: in general device detach has been flakeing in the jobs for the last why and it does not really seam to be related ot change in nova code | |
| 21:41:44 | JayF | It's extra annoying for VM errors to be cratering an ironic-driver-only change :P | |
| 21:41:50 | sean-k-mooney | the latest issue may be a regression in qemu | |
| 21:41:57 | sean-k-mooney | JayF: yes | |
| 21:42:31 | JayF | I guess targetting a bunch of different qemu versions might have a similar problems to what we see in Ironic with ... unfortunately designed hardware BMCs :P | |