| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2026-06-03 | |||
| 18:06:31 | sean-k-mooney | or rather the volume_snapshot_delete assisted volume snapshto test | |
| 18:06:42 | sean-k-mooney | is triging that often | |
| 18:07:50 | sean-k-mooney | if i remove t he filter on nova that tirggerd 2341 times in the last 10 days | |
| 18:08:21 | sean-k-mooney | that with lvm or cephs as the backend | |
| 18:09:30 | sean-k-mooney | it looks like if hte snapshot is not foudn we explosde bcuase we dont have the type info info | |
| 18:14:06 | melwitt | that is a very old issue | |
| 18:14:42 | sean-k-mooney | it felt familar | |
| 18:14:58 | sean-k-mooney | i dont see a bug report for it quickly so im going to file one | |
| 18:15:05 | melwitt | yeah I'm looking for it, sec | |
| 18:15:17 | melwitt | ok that works too | |
| 18:15:44 | sean-k-mooney | https://bugs.launchpad.net/nova/+bug/2155187 | |
| 18:16:54 | sean-k-mooney | i kind fo hate "standard tracebacks" in logs | |
| 18:17:15 | sean-k-mooney | that partly why i try to pretnt os-brick is not a thing | |
| 18:17:35 | dansmith | agree, tracebacks in logs for normal occurrences is extremely uncool | |
| 18:17:49 | dansmith | we had an effort like ten years ago to get rid of them all | |
| 18:17:56 | dansmith | but as you say, brick is like a traceback generator :) | |
| 18:18:04 | melwitt | yeah. I know there was a fix proposed for this exact problem and I can't remember why it stalled out. and I can't even find it right now | |
| 18:18:30 | sean-k-mooney | we have drefinlly fixed other case wehre we asuem a key was alswasy present | |
| 18:18:50 | sean-k-mooney | i dont recall if it was this exact one but we have had that class of issue with the cinder path a few times | |
| 18:19:12 | sean-k-mooney | what i find intersting about this is we seam to mostly handel this internally | |
| 18:19:44 | sean-k-mooney | as in its a key error but of the 2200 or so hits only like 180 of those failed | |
| 18:20:05 | melwitt | it was this https://bugs.launchpad.net/nova/+bug/2033541 and this https://review.opendev.org/c/openstack/nova/+/900783 | |
| 18:20:07 | sean-k-mooney | so at least in the volume delete path this is just ugly in the logs | |
| 18:20:32 | sean-k-mooney | ah cool i can close it as a dupe then | |
| 18:20:45 | melwitt | (that was what I was thinking of) | |
| 18:20:51 | melwitt | is the one you saw with ceph also? | |
| 18:21:23 | sean-k-mooney | yep | |
| 18:21:26 | melwitt | I swear google is working less and less. launchpad search found me that when google couldn't | |
| 18:22:06 | melwitt | you might consider closing the older one as a dupe, it clearly is not getting searched easily haha | |
| 18:22:14 | sean-k-mooney | https://tinyurl.com/2k63h77v | |
| 18:22:37 | sean-k-mooney | so that the case where the trace happend but the job passes | |
| 18:22:58 | sean-k-mooney | but if you weiden that out | |
| 18:23:17 | melwitt | yeah. it absolutely happens all the time. and there was/is a patch proposed but it got stalled out for reasons i don't remember and I think that discouraged everything | |
| 18:23:18 | sean-k-mooney | its present in cidner cinder-plugin-ceph-tempest devstack-plugin-nfs-tempest-full | |
| 18:23:25 | sean-k-mooney | and cinder-tempest-lvm-multibackend | |
| 18:23:27 | sean-k-mooney | job | |
| 18:23:44 | sean-k-mooney | so it seam to be backend indepenent | |
| 18:23:54 | sean-k-mooney | if for any reason the snapshot is not found | |
| 18:23:56 | sean-k-mooney | it will explode | |
| 18:24:00 | melwitt | yeah it is the arbitrary dict thing which really sucks | |
| 18:24:16 | sean-k-mooney | well in my case there was a 404 | |
| 18:24:17 | melwitt | some backends use X keys some use Y keys and it's a wild west | |
| 18:24:36 | sean-k-mooney | i..e the snapshot was not found in cinder durign the delet test | |
| 18:24:47 | melwitt | there's no standard for that payload, last I checked | |
| 18:24:48 | sean-k-mooney | and then we didn have the info a as a reult | |
| 18:25:06 | sean-k-mooney | melwitt: ya i have noticed that too | |
| 18:25:21 | sean-k-mooney | i.e. tht the payload is very backend secific | |
| 18:25:31 | melwitt | I remember digging into it a bit and getting really discouraged | |
| 18:25:47 | melwitt | yeah. and I think they are not documented either. so I'm not sure what the first step in the right direction is even | |
| 18:26:14 | melwitt | that isn't just papering over something, I mean | |
| 18:26:33 | melwitt | it could probably be its own PTG topic | |
| 18:26:54 | sean-k-mooney | have you heard fo microverions :P | |
| 18:27:29 | melwitt | heh | |
| 18:27:59 | melwitt | I mean like for this, we could catch and ignore KeyError for this specific thing but the problem is bigger than that | |
| 18:29:05 | sean-k-mooney | skimmig the patch comment im unsure if this just stalled out because fo a 2 month dely in updatin the patch for your -1 or if there was any other outstading issue with it | |
| 18:30:10 | sean-k-mooney | https://review.opendev.org/c/openstack/nova/+/900783/13/nova/virt/libvirt/driver.py | |
| 18:30:24 | sean-k-mooney | i think is fine for this specific case | |
| 18:30:53 | sean-k-mooney | it just does nto resove that class of issue generally | |
| 18:31:21 | opendevreview | Rajesh Tailor proposed openstack/nova master: Fix KeyError on assisted snapshot call https://review.opendev.org/c/openstack/nova/+/900783 | |
| 18:31:23 | melwitt | ok I see | |
| 18:31:35 | sean-k-mooney | i just rebased that in th ui lets see if it passes or not | |
| 18:31:42 | melwitt | cool thanks | |
| 18:34:12 | sean-k-mooney | that was july 2024 which was right atount the time we wre dealing with https://security.openstack.org/ossa/OSSA-2024-001.html | |
| 18:35:24 | sean-k-mooney | i.e we were fixign the qemu image stuff and the fallout for breaking iso ectra | |
| 21:07:03 | opendevreview | Ghanshyam Maan proposed openstack/nova stable/2025.1: [CI][stable-only] nova-grenade-multinode fix https://review.opendev.org/c/openstack/nova/+/989579 | |
| #openstack-nova - 2026-06-04 | |||
| 01:42:40 | opendevreview | Merged openstack/nova master: Avoid reading 4GiB of reason text from RFB https://review.opendev.org/c/openstack/nova/+/991220 | |
| 03:18:51 | opendevreview | Merged openstack/nova stable/2025.1: [CI][stable-only] nova-grenade-multinode fix https://review.opendev.org/c/openstack/nova/+/989579 | |
| 07:54:37 | opendevreview | Merged openstack/nova master: Fix swap disk creation skipped on NFS during cold migration https://review.opendev.org/c/openstack/nova/+/988547 | |
| 09:04:20 | Uggla | Reminder: Today is spec review day | |
| 09:48:08 | opendevreview | Kamil Sambor proposed openstack/nova master: Change nova-alt-configurations job https://review.opendev.org/c/openstack/nova/+/983179 | |
| 10:07:57 | opendevreview | Merged openstack/nova-specs master: Intel TDX support in libvirt driver https://review.opendev.org/c/openstack/nova-specs/+/979608 | |
| 10:19:17 | gibi | Uggla: both SNP and TDX specs are approved now. So we made good progress :) | |
| 10:24:20 | opendevreview | Merged openstack/nova-specs master: libvirt: AMD SEV-SNP support https://review.opendev.org/c/openstack/nova-specs/+/983376 | |
| 10:48:35 | gibi | bauzas: dansmith: I reviewed the bidirectional RPC liveness spec and I have one RPC compat questions that one of you probably can answer easily https://review.opendev.org/c/openstack/nova-specs/+/984384 | |
| 10:49:04 | bauzas | gibi: I can try to look at this afternoon | |
| 10:55:47 | gibi | thanks | |
| 12:10:42 | opendevreview | dalekseev proposed openstack/nova master: Restrict machine type check to QEMU instances https://review.opendev.org/c/openstack/nova/+/991137 | |
| 12:18:46 | opendevreview | Takashi Kajinami proposed openstack/osc-placement master: Update support python versions https://review.opendev.org/c/openstack/osc-placement/+/991603 | |
| 12:24:31 | gibi | sambork, Uggla filed a new CLI UX bug for eventlet + py3.14 https://bugs.launchpad.net/nova/+bug/2155245 | |
| 12:27:49 | Uggla | gibi ok | |
| 12:28:01 | Uggla | and cool for the CC spec | |
| 12:28:58 | sambork | @gibi, ack, I can take a look at that. At first glance, it looks like a similar issue to the one you described yesterday with oslo and pickling | |
| 12:35:19 | gibi | yeah someting wrong happens when the python interpreter exits | |
| 12:35:35 | gibi | it only uggly but causing no issue as far as I see | |
| 12:35:59 | opendevreview | Kamil Sambor proposed openstack/nova master: Restore 'fork' start method for daemon mode on Python 3.14 https://review.opendev.org/c/openstack/nova/+/987815 | |
| 12:35:59 | opendevreview | Kamil Sambor proposed openstack/nova master: [dnm] testing python 3.14 with restored fork https://review.opendev.org/c/openstack/nova/+/987821 | |
| 12:50:49 | Uggla | gibi, if you have time to review 471815: Expose vlan trunking in metadata/configdrive | https://review.opendev.org/c/openstack/nova-specs/+/471815 | |
| 12:51:18 | Uggla | sorry to bother all of you with this one, but I would like not to miss it another time. | |
| 13:15:53 | opendevreview | Thibaut Démaret proposed openstack/nova master: libvirt: add disk rotation_rate support for local disks https://review.opendev.org/c/openstack/nova/+/979693 | |
| 13:25:08 | Uggla | gmaan, there is this new bug entered by jlejeune that might interest you: https://bugs.launchpad.net/nova/+bug/2155153 | |
| 13:31:51 | opendevreview | ChungWon Lee proposed openstack/nova-specs master: Spec for reduce failed builds value by time https://review.opendev.org/c/openstack/nova-specs/+/991636 | |
| 13:33:10 | gibi | Uggla: I feel like https://bugs.launchpad.net/nova/+bug/2155153 is a duplicate of an older bug of mine. Looking for it... | |
| 13:33:54 | Uggla | gibi, :) I was just thinnking about it | |
| 13:35:55 | gibi | found https://bugs.launchpad.net/nova/+bug/2147554 and did the paperwork | |
| 13:37:57 | opendevreview | ChungWon Lee proposed openstack/nova-specs master: Spec for reduce failed builds value by time https://review.opendev.org/c/openstack/nova-specs/+/991636 | |
| 13:46:41 | opendevreview | ribaudr proposed openstack/nova master: Add reproducer for bug #2115798 https://review.opendev.org/c/openstack/nova/+/991642 | |
| 13:46:41 | opendevreview | ribaudr proposed openstack/nova master: Fix race condition in security group add/remove https://review.opendev.org/c/openstack/nova/+/991643 | |
| 13:57:07 | opendevreview | ribaudr proposed openstack/nova master: Fix misleading description of assisted volume snapshots https://review.opendev.org/c/openstack/nova/+/991649 | |
| 14:02:16 | sean-k-mooney | bauzas: is this on your review list https://review.opendev.org/c/openstack/nova-specs/+/990259 | |
| 14:02:39 | bauzas | no | |