| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2026-06-03 | |||
| 15:02:27 | elodilles | gmaan: i can update this patch with your fix to unblock the gate https://review.opendev.org/c/openstack/nova/+/989579 | |
| 15:02:30 | elodilles | o:) | |
| 15:02:59 | Uggla | Reminder upstream bug triage in ~30mn | |
| 15:03:15 | gmaan | elodilles: Uggla ohk grenade on 2025.1 which i suggest to remove it :) but if you are fixing it is ok | |
| 15:03:31 | elodilles | Uggla: sorry, i didn't have enought time for bug triaging this time, so i'll just listen in today :S | |
| 15:04:01 | elodilles | gmaan: yes, yes, that we agreed to remove o:) | |
| 15:05:30 | elodilles | gmaan: my fix was about to land when the upper-constraints were bumped and struck again on the grenade o:) | |
| 15:06:20 | Uggla | elodilles, no worries, tbh I do not expect much this week on the triage due to review activities. | |
| 15:28:38 | Uggla | Upstream bug triage: https://meet.google.com/zjr-rxus-hzj | |
| 16:11:06 | sean-k-mooney | that in 20 minutes right? | |
| 16:11:39 | sean-k-mooney | oh no it was na hour ago | |
| 16:12:31 | sean-k-mooney | is it 15:30 UTC ? | |
| 16:23:34 | melwitt | sean-k-mooney: yes 15:30 UTC | |
| 17:28:08 | gmaan | elodilles: commented on grenade job fix,. you still needs to pin the tempest https://review.opendev.org/c/openstack/nova/+/989579 | |
| 17:28:28 | gmaan | tempest change to support that is merged so no depends-on needed anymore | |
| 17:44:30 | opendevreview | Ghanshyam Maan proposed openstack/nova stable/2025.1: [CI][stable-only] nova-grenade-multinode fix https://review.opendev.org/c/openstack/nova/+/989579 | |
| 18:04:47 | sean-k-mooney | so while debuging with the new cirror image i noteice something intersting | |
| 18:04:56 | sean-k-mooney | https://tinyurl.com/2k63h77v | |
| 18:05:29 | sean-k-mooney | while it does not alwasy cause a failure https://paste.opendev.org/show/b5V9zieRqmJVFjyb5uz9/ | |
| 18:06:04 | sean-k-mooney | nova is trigging that traceback like 50 times a day | |
| 18:06:31 | sean-k-mooney | or rather the volume_snapshot_delete assisted volume snapshto test | |
| 18:06:42 | sean-k-mooney | is triging that often | |
| 18:07:50 | sean-k-mooney | if i remove t he filter on nova that tirggerd 2341 times in the last 10 days | |
| 18:08:21 | sean-k-mooney | that with lvm or cephs as the backend | |
| 18:09:30 | sean-k-mooney | it looks like if hte snapshot is not foudn we explosde bcuase we dont have the type info info | |
| 18:14:06 | melwitt | that is a very old issue | |
| 18:14:42 | sean-k-mooney | it felt familar | |
| 18:14:58 | sean-k-mooney | i dont see a bug report for it quickly so im going to file one | |
| 18:15:05 | melwitt | yeah I'm looking for it, sec | |
| 18:15:17 | melwitt | ok that works too | |
| 18:15:44 | sean-k-mooney | https://bugs.launchpad.net/nova/+bug/2155187 | |
| 18:16:54 | sean-k-mooney | i kind fo hate "standard tracebacks" in logs | |
| 18:17:15 | sean-k-mooney | that partly why i try to pretnt os-brick is not a thing | |
| 18:17:35 | dansmith | agree, tracebacks in logs for normal occurrences is extremely uncool | |
| 18:17:49 | dansmith | we had an effort like ten years ago to get rid of them all | |
| 18:17:56 | dansmith | but as you say, brick is like a traceback generator :) | |
| 18:18:04 | melwitt | yeah. I know there was a fix proposed for this exact problem and I can't remember why it stalled out. and I can't even find it right now | |
| 18:18:30 | sean-k-mooney | we have drefinlly fixed other case wehre we asuem a key was alswasy present | |
| 18:18:50 | sean-k-mooney | i dont recall if it was this exact one but we have had that class of issue with the cinder path a few times | |
| 18:19:12 | sean-k-mooney | what i find intersting about this is we seam to mostly handel this internally | |
| 18:19:44 | sean-k-mooney | as in its a key error but of the 2200 or so hits only like 180 of those failed | |
| 18:20:05 | melwitt | it was this https://bugs.launchpad.net/nova/+bug/2033541 and this https://review.opendev.org/c/openstack/nova/+/900783 | |
| 18:20:07 | sean-k-mooney | so at least in the volume delete path this is just ugly in the logs | |
| 18:20:32 | sean-k-mooney | ah cool i can close it as a dupe then | |
| 18:20:45 | melwitt | (that was what I was thinking of) | |
| 18:20:51 | melwitt | is the one you saw with ceph also? | |
| 18:21:23 | sean-k-mooney | yep | |
| 18:21:26 | melwitt | I swear google is working less and less. launchpad search found me that when google couldn't | |
| 18:22:06 | melwitt | you might consider closing the older one as a dupe, it clearly is not getting searched easily haha | |
| 18:22:14 | sean-k-mooney | https://tinyurl.com/2k63h77v | |
| 18:22:37 | sean-k-mooney | so that the case where the trace happend but the job passes | |
| 18:22:58 | sean-k-mooney | but if you weiden that out | |
| 18:23:17 | melwitt | yeah. it absolutely happens all the time. and there was/is a patch proposed but it got stalled out for reasons i don't remember and I think that discouraged everything | |
| 18:23:18 | sean-k-mooney | its present in cidner cinder-plugin-ceph-tempest devstack-plugin-nfs-tempest-full | |
| 18:23:25 | sean-k-mooney | and cinder-tempest-lvm-multibackend | |
| 18:23:27 | sean-k-mooney | job | |
| 18:23:44 | sean-k-mooney | so it seam to be backend indepenent | |
| 18:23:54 | sean-k-mooney | if for any reason the snapshot is not found | |
| 18:23:56 | sean-k-mooney | it will explode | |
| 18:24:00 | melwitt | yeah it is the arbitrary dict thing which really sucks | |
| 18:24:16 | sean-k-mooney | well in my case there was a 404 | |
| 18:24:17 | melwitt | some backends use X keys some use Y keys and it's a wild west | |
| 18:24:36 | sean-k-mooney | i..e the snapshot was not found in cinder durign the delet test | |
| 18:24:47 | melwitt | there's no standard for that payload, last I checked | |
| 18:24:48 | sean-k-mooney | and then we didn have the info a as a reult | |
| 18:25:06 | sean-k-mooney | melwitt: ya i have noticed that too | |
| 18:25:21 | sean-k-mooney | i.e. tht the payload is very backend secific | |
| 18:25:31 | melwitt | I remember digging into it a bit and getting really discouraged | |
| 18:25:47 | melwitt | yeah. and I think they are not documented either. so I'm not sure what the first step in the right direction is even | |
| 18:26:14 | melwitt | that isn't just papering over something, I mean | |
| 18:26:33 | melwitt | it could probably be its own PTG topic | |
| 18:26:54 | sean-k-mooney | have you heard fo microverions :P | |
| 18:27:29 | melwitt | heh | |
| 18:27:59 | melwitt | I mean like for this, we could catch and ignore KeyError for this specific thing but the problem is bigger than that | |
| 18:29:05 | sean-k-mooney | skimmig the patch comment im unsure if this just stalled out because fo a 2 month dely in updatin the patch for your -1 or if there was any other outstading issue with it | |
| 18:30:10 | sean-k-mooney | https://review.opendev.org/c/openstack/nova/+/900783/13/nova/virt/libvirt/driver.py | |
| 18:30:24 | sean-k-mooney | i think is fine for this specific case | |
| 18:30:53 | sean-k-mooney | it just does nto resove that class of issue generally | |
| 18:31:21 | opendevreview | Rajesh Tailor proposed openstack/nova master: Fix KeyError on assisted snapshot call https://review.opendev.org/c/openstack/nova/+/900783 | |
| 18:31:23 | melwitt | ok I see | |
| 18:31:35 | sean-k-mooney | i just rebased that in th ui lets see if it passes or not | |
| 18:31:42 | melwitt | cool thanks | |
| 18:34:12 | sean-k-mooney | that was july 2024 which was right atount the time we wre dealing with https://security.openstack.org/ossa/OSSA-2024-001.html | |
| 18:35:24 | sean-k-mooney | i.e we were fixign the qemu image stuff and the fallout for breaking iso ectra | |
| 21:07:03 | opendevreview | Ghanshyam Maan proposed openstack/nova stable/2025.1: [CI][stable-only] nova-grenade-multinode fix https://review.opendev.org/c/openstack/nova/+/989579 | |
| #openstack-nova - 2026-06-04 | |||
| 01:42:40 | opendevreview | Merged openstack/nova master: Avoid reading 4GiB of reason text from RFB https://review.opendev.org/c/openstack/nova/+/991220 | |
| 03:18:51 | opendevreview | Merged openstack/nova stable/2025.1: [CI][stable-only] nova-grenade-multinode fix https://review.opendev.org/c/openstack/nova/+/989579 | |
| 07:54:37 | opendevreview | Merged openstack/nova master: Fix swap disk creation skipped on NFS during cold migration https://review.opendev.org/c/openstack/nova/+/988547 | |
| 09:04:20 | Uggla | Reminder: Today is spec review day | |
| 09:48:08 | opendevreview | Kamil Sambor proposed openstack/nova master: Change nova-alt-configurations job https://review.opendev.org/c/openstack/nova/+/983179 | |
| 10:07:57 | opendevreview | Merged openstack/nova-specs master: Intel TDX support in libvirt driver https://review.opendev.org/c/openstack/nova-specs/+/979608 | |
| 10:19:17 | gibi | Uggla: both SNP and TDX specs are approved now. So we made good progress :) | |
| 10:24:20 | opendevreview | Merged openstack/nova-specs master: libvirt: AMD SEV-SNP support https://review.opendev.org/c/openstack/nova-specs/+/983376 | |
| 10:48:35 | gibi | bauzas: dansmith: I reviewed the bidirectional RPC liveness spec and I have one RPC compat questions that one of you probably can answer easily https://review.opendev.org/c/openstack/nova-specs/+/984384 | |
| 10:49:04 | bauzas | gibi: I can try to look at this afternoon | |
| 10:55:47 | gibi | thanks | |
| 12:10:42 | opendevreview | dalekseev proposed openstack/nova master: Restrict machine type check to QEMU instances https://review.opendev.org/c/openstack/nova/+/991137 | |
| 12:18:46 | opendevreview | Takashi Kajinami proposed openstack/osc-placement master: Update support python versions https://review.opendev.org/c/openstack/osc-placement/+/991603 | |
| 12:24:31 | gibi | sambork, Uggla filed a new CLI UX bug for eventlet + py3.14 https://bugs.launchpad.net/nova/+bug/2155245 | |
| 12:27:49 | Uggla | gibi ok | |