| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-11-09 | |||
| 09:57:00 | lyarwood | oh it's CentOSStream | |
| 09:59:08 | lyarwood | https://review.opendev.org/c/openstack/devstack/+/803023 was rejected so I need the branch conditional in master gah | |
| 10:00:51 | gibi | I've opened a gate bug for the tempest-integrated-compute-centos-8-stream job failing on master with version conflict as it seems to be 100% hit | |
| 10:00:54 | gibi | tempest-integrated-compute-centos-8-stream | |
| 10:01:19 | gibi | https://bugs.launchpad.net/nova/+bug/1950291 | |
| 10:03:48 | lyarwood | weird | |
| 10:04:12 | lyarwood | `Cannot install cinder because these package versions have conflicting dependencies.` FWIW | |
| 10:10:38 | gibi | interesing nothing recent in cinder bumped version | |
| 10:10:50 | gibi | and nothing in the requirements repo since the 6th | |
| 10:12:06 | gibi | this was on the 6th bumping boto https://review.opendev.org/c/openstack/requirements/+/816611/2/upper-constraints.txt#314 | |
| 10:12:30 | gibi | sorry 4th | |
| 10:15:11 | lyarwood | gibi: did you have a bug for the stable/victoria issue? | |
| 10:15:37 | gibi | nope | |
| 10:15:45 | lyarwood | ack | |
| 10:15:47 | gibi | please raise one | |
| 10:18:46 | kashyap | gibi: lyarwood: Catching up ... is it because of this not merging yet? https://review.opendev.org/c/openstack/devstack/+/803023 (fix is_fedora for centos 8 stream) | |
| 10:20:24 | lyarwood | yeah but as we didn't support centos8stream at that point we shouldn't backport this anyway | |
| 10:20:37 | lyarwood | I'll just land some regex shortly to fix this | |
| 10:21:12 | opendevreview | Jun Chen proposed openstack/nova master: Catch an exception in power off procedure https://review.opendev.org/c/openstack/nova/+/817176 | |
| 10:23:08 | kashyap | lyarwood: Ah, noted. Sorry, regex based on what? To selectively check if 8stream is available, if not fallback to vanilla CentoS? | |
| 10:24:44 | lyarwood | kashyap: regex to stop the centos8stream job from running on branches older than wallaby | |
| 10:24:50 | lyarwood | https://review.opendev.org/c/openstack/tempest/+/817179 | |
| 10:25:23 | kashyap | Aah, like that; thx! | |
| 10:25:53 | opendevreview | Lee Yarwood proposed openstack/nova stable/victoria: DNM - Test integrated-gate-compute fix for centos8stream https://review.opendev.org/c/openstack/nova/+/817180 | |
| 10:25:54 | lyarwood | ^ testing here | |
| 10:28:46 | gibi | I cannot reproduce the version conflict locally seen in https://bugs.launchpad.net/nova/+bug/1950291 | |
| 10:30:28 | gibi | but I don't have python3.6 :/ | |
| 10:35:07 | frickler | gibi: that looks like a failure in the index from pypi CDN, there is no conflict if you look at the version numbers. pip just fails to generate a proper error when it can't find that specific version in the index | |
| 10:35:40 | gibi | frickler: ohh, good point, then I guess the error will go away after the recheck | |
| 10:35:45 | bauzas | gibi: should we mark the bug Critical as it holds the gate ? | |
| 10:35:59 | bauzas | https://bugs.launchpad.net/nova/+bug/1950291 | |
| 10:36:08 | gibi | bauzas: wait a bit, frickler has an explanation that might mean it was a transient only | |
| 10:36:13 | bauzas | ok | |
| 10:36:15 | gibi | I have recheck running now | |
| 10:36:22 | bauzas | that's what I see | |
| 10:36:53 | frickler | we have some way of telling the CDN to refresh its cache, I can look that up in a bit | |
| 10:41:28 | gibi | still failing with boto conflict after recheck https://zuul.opendev.org/t/openstack/build/0ba1dd59972d48a98fe29b47dbb82e1e/log/job-output.txt | |
| 10:42:13 | bauzas | gibi: marking it Critical until we figure out a better vision | |
| 10:43:09 | bauzas | gibi: just to be clear, this is an unrelated issue from the stable/victoria gate, right? | |
| 10:43:22 | bauzas | here, we have centos-stream on wallaby and later | |
| 10:43:43 | gibi | bauzas: right | |
| 10:44:11 | bauzas | and I see lyarwood providing a tempest fix for the stable branches that are impacted | |
| 10:44:42 | frickler | bauzas: gibi: I did "curl -XPURGE https://pypi.org/simple/botocore" and the same without the "/botocore". please try another recheck | |
| 10:45:10 | gibi | frickler: ack I will | |
| 10:45:13 | gibi | and thanks | |
| 10:45:34 | bauzas | but I'll scroll when I'm back | |
| 10:46:04 | frickler | if it is still failing for jobs starting now, please ping infra-root in #opendev, I'll be afk for a bit | |
| 10:46:18 | kevko | sean-k-mooney: hi, here ? :) | |
| 11:03:27 | gibi | frickler: ack thanks | |
| 11:03:52 | opendevreview | Lee Yarwood proposed openstack/nova master: libvirt: Create qcow2 disks with the correct size without extending https://review.opendev.org/c/openstack/nova/+/779275 | |
| 11:10:20 | gibi | lyarwood: fyi cirros 0.5.2 is not a solution for the kernel panic as https://review.opendev.org/c/openstack/nova/+/817173 still triggers it | |
| 11:24:17 | lyarwood | gibi: Yeah I didn't think it would tbh | |
| 11:24:25 | gibi | so back to square one | |
| 12:00:43 | gibi | lyarwood: should I file a bug for the kernel panic problem on stable/victoria? | |
| 12:00:52 | gibi | or you already did? | |
| 12:00:59 | lyarwood | I haven't so go ahead | |
| 12:01:07 | gibi | ok | |
| 12:01:09 | gibi | I will do | |
| 12:09:35 | gibi | lyarwood: https://bugs.launchpad.net/nova/+bug/1950310 | |
| 12:21:24 | gibi | lyarwood: could this be the appearence of our old volume detach bug ^^ where the fix was the redesigned detach code in https://review.opendev.org/q/topic:bug/1882521 | |
| 12:21:35 | gibi | that was backported only to wallaby | |
| 12:22:21 | gibi | and I do see in the nova log that the _do_wait_and_retry_detach function goes through the 7 iteration | |
| 13:21:11 | opendevreview | Merged openstack/nova master: Remove SESSION_CONFIGURED global from DB fixture https://review.opendev.org/c/openstack/nova/+/815689 | |
| 13:26:41 | gibi | frickler: seems your PURGE command helped later runs does not hit the boto version conflict | |
| 13:27:21 | frickler | gibi: great, thanks for confirming | |
| 13:51:08 | gibi | lyarwood: I backported the libvirt event based detach series to stable/victoria let's see if that helps with the kernel panic | |
| 13:51:09 | opendevreview | Balazs Gibizer proposed openstack/nova stable/victoria: libvirt: Define and emit DeviceRemovedEvent and DeviceRemovalFailedEvent https://review.opendev.org/c/openstack/nova/+/817209 | |
| 13:51:10 | opendevreview | Balazs Gibizer proposed openstack/nova stable/victoria: libvirt: add AsyncDeviceEventsHandler https://review.opendev.org/c/openstack/nova/+/817210 | |
| 13:53:31 | opendevreview | Balazs Gibizer proposed openstack/nova stable/victoria: libvirt: allow querying devices from the persistent domain https://review.opendev.org/c/openstack/nova/+/817211 | |
| 13:56:01 | opendevreview | Balazs Gibizer proposed openstack/nova stable/victoria: libvirt: parse alias out from device config https://review.opendev.org/c/openstack/nova/+/817212 | |
| 13:57:57 | kevko | dansmith: commented on https://review.opendev.org/c/openstack/nova/+/817030 | |
| 13:58:40 | opendevreview | Merged openstack/nova master: Refactor Database fixture https://review.opendev.org/c/openstack/nova/+/815690 | |
| 13:58:51 | opendevreview | Merged openstack/nova master: Use ReplaceEngineFacade fixture https://review.opendev.org/c/openstack/nova/+/816820 | |
| 13:59:05 | opendevreview | Merged openstack/nova master: Fix interference in db unit test https://review.opendev.org/c/openstack/nova/+/814735 | |
| 14:00:54 | opendevreview | Balazs Gibizer proposed openstack/nova stable/victoria: Replace blind retry with libvirt event waiting in detach https://review.opendev.org/c/openstack/nova/+/817214 | |
| 14:01:56 | gibi | elodilles: this probably interest you too ^^ | |
| 14:03:07 | opendevreview | Balazs Gibizer proposed openstack/nova stable/victoria: Move the guest.get_disk test to test_guest https://review.opendev.org/c/openstack/nova/+/817215 | |
| 14:03:08 | opendevreview | Balazs Gibizer proposed openstack/nova stable/victoria: libvirt: Remove dead error handling code https://review.opendev.org/c/openstack/nova/+/817216 | |
| 14:03:09 | opendevreview | Balazs Gibizer proposed openstack/nova stable/victoria: Move instance power state check to _detach_with_retry https://review.opendev.org/c/openstack/nova/+/817217 | |
| 14:03:10 | opendevreview | Balazs Gibizer proposed openstack/nova stable/victoria: Consolidate device detach error handling https://review.opendev.org/c/openstack/nova/+/817218 | |
| 14:32:00 | opendevreview | Balazs Gibizer proposed openstack/nova stable/victoria: Parse alias from domain hostdev https://review.opendev.org/c/openstack/nova/+/816486 | |
| 14:40:37 | elodilles | gibi: wow, 10 patches for a single bug fix? :-o | |
| 14:43:08 | gibi | elodilles: you know that, it is the libvirt event based device detach serires | |
| 14:43:26 | gibi | it was backported to wallaby and now I backported it to victoria | |
| 14:48:46 | elodilles | gibi: oh, that's soooo... May... o:D | |
| 14:49:05 | gibi | :D | |
| 14:55:42 | stephenfin | gibi: Okay with me backporting those DB test changes? | |
| 14:56:07 | gibi | stephenfin: which one? | |
| 14:56:16 | stephenfin | https://review.opendev.org/c/openstack/nova/+/814735 and company | |
| 14:56:29 | gibi | I'm already on it | |
| 14:56:41 | stephenfin | oh, great :D | |
| 15:00:07 | bauzas | reminder: nova team meeting in 1 hour | |
| 15:00:17 | bauzas | ... here | |
| 15:00:23 | bauzas | (sorry, forgot to tell) | |
| 15:02:47 | opendevreview | sean mooney proposed openstack/nova master: This change replaces all hardcoded tox enve with generative envs https://review.opendev.org/c/openstack/nova/+/804292 | |
| 15:03:12 | sean-k-mooney | stephenfin: that ^ still has you -2 on it can you remove it so we can proceed with the review | |
| 15:03:52 | stephenfin | oh yeah, sure | |
| 15:04:36 | sean-k-mooney | i proably have typos and other issue in it but for the most part i think its ready to review | |
| 15:07:49 | opendevreview | Alexey Stupnikov proposed openstack/nova master: Test aborting queued live migration https://review.opendev.org/c/openstack/nova/+/776250 | |
| 15:10:13 | clarkb | frickler: bauzas gibi it happens when new deps are released and then we pin them in constraints because pypi has a fallback for its CDN lookups that tends to run out of date by a couple of weeks it seems | |