Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2026-05-12
09:31:54 sean-k-mooney of course tempest (which is just stdlib unittest as the framework) may not be what you want fo rthis but i think it could be a decent fit
09:41:23 mikal Ok, I will consider this all tomorrow but it sounds promising to me.
09:41:25 mikal Thank you.
09:42:23 sean-k-mooney if gibi has time to update teh devstack patch to make it work on debian 13 we will likely proceed with it today, if they dont we may still proceed with it today to unblock the gate and follwo up next week
09:47:56 mikal Oh definitely adding the package now is the way to go. My thing will take a while to navigate I think. I'd offer to send a change for adding the patch, but I am also about to be pulled away for family duties.
09:48:41 sean-k-mooney im 99% sure i have a patch also locally but the host i run my devstack vms lost a hardrive at teh weekend
09:48:54 sean-k-mooney and while it can run with one failure i have it off until i have time to replace it
09:49:17 sean-k-mooney so my debian 13 spice enve where i was testing that fix is ofline :)
09:49:45 sean-k-mooney gibi's patch shoudl fix the current case and it would be a minor tweak to also supprot debain 13
10:50:04 frickler gibi: it there anything that can be done to make progress with https://bugs.launchpad.net/os-vif/+bug/2109396 ? there was a new pyroute2 release recently, but from the changelog it didn't look to me like it would help with this issue. the pyroute2 cap is the last remaining item we have until we can go back to having "normal" u-c updates again
10:58:11 opendevreview Balazs Gibizer proposed openstack/nova master: move nova-alt-config to debian-13 https://review.opendev.org/c/openstack/nova/+/966479
10:59:33 gibi I respin the devstack fix to include debian 13 and updated ^^ to point to that devstack change
11:00:08 gibi frickler: somebody should either fix pyroute2 with eventlet or we should drop eventlet from our codebase
11:00:15 gibi I have no other ideas
11:00:30 sean-k-mooney if only one of those was almost complete
11:01:11 sean-k-mooney frickler: i assume its not posisbel to have diffent version depending on if your using eventlet or not like we can based on python verion?
11:02:17 sean-k-mooney nova i now runign nova-compute without eventlet by default so could perhaps downgrade the pyroute2 used in eventlet mode and uncap it in threaded mode?
11:02:33 sean-k-mooney but that likely to requrie some toolign changes in devstack to do properly
11:03:09 gibi hm if we allow downgrading to our small amount of eventlet based jobs then the rest can probably run with the latest pyroute2
11:03:19 gibi s/to/in/
11:03:27 frickler how long will the eventlet mode be needed? 2027.1 for migration purposes?
11:03:44 gibi yes 2027.1 will still have eventlet as a last slurp
11:04:23 sean-k-mooney and we will be deleting it in about 12 months time basiclly we will do the deletion early in 2027.2
11:04:44 frickler we could override u-c within devstack, but that won't help deployers
11:05:10 sean-k-mooney 2026.2 is the first release where we are defaultign to threaded mode for nbova-compute
11:05:34 frickler so let me update https://review.opendev.org/c/openstack/requirements/+/973210 and then we can see where we actually stand currently
11:05:41 sean-k-mooney so this release would be compatibaly with newer pyroute2
11:07:00 sean-k-mooney frickler: we could also just say "if you want to use py3.14 you shoudl use threaded mode adn only keep the cap for 3.13 and below
11:07:35 sean-k-mooney but cool lets see what the updated run shows
11:14:00 opendevreview Dr. Jens Harbott proposed openstack/nova master: DNM: test pyroute2 bump https://review.opendev.org/c/openstack/nova/+/988242
11:20:11 gibi the nova-alt-configuration is the job that tests the eventlet mode. So we need a good result from that job in ^^ But that job is broken and being fixed in devstack :)
11:28:24 frickler ah, I wasn't aware that that is the same job. so waiting for it to be fixed first
11:30:21 gibi yeah I relized as we are chatting here :)
13:08:47 sean-k-mooney gibi: so it failed but on an undrealted test the spice tests passed but some fo the live migraiton test failed in test cleanup
13:13:20 gibi I will recheck the nova patch but I think the devstack one is good to go
13:13:32 sean-k-mooney yep i +2'd the devstack one
13:14:12 sean-k-mooney did you have a test patch on deb-12 on nova? i just check the patch that moved nova-alt-config to debin 13
13:15:21 gibi sean-k-mooney: this https://review.opendev.org/c/openstack/nova/+/988215 shows that the devstack patch unblock the nova-alt-config job
13:15:31 gibi with debian 12
13:15:54 sean-k-mooney great
13:16:18 sean-k-mooney then ya we shoudl proceed with the devstack patch is frickler and other are happy with it
13:16:52 sean-k-mooney as i said the test failure looked unrelated on debian 13
13:19:56 sean-k-mooney gibi: while i have been in meeting i have been having ai agents test my kernel module and it apears to be workign enough for the device to show up in lspci
13:20:25 sean-k-mooney im going to play around with it a bit more and see if i can get it to a porint where the VF are usabel by a nested qemu quickly
13:21:14 gibi sean-k-mooney: thanks
13:22:58 elodilles sean-k-mooney: sorry for pinging, can you please revisit my placement gatefix patch / check my comment on it? o:) https://review.opendev.org/c/openstack/placement/+/980761/2#message-6b13614a07d353e22186487083fe57b46b3aa02f
13:25:32 sean-k-mooney elodilles if the grenade job is working im kind of ok with it existing
13:25:43 sean-k-mooney but i dont really like having a know broken job
13:25:46 sean-k-mooney that is non voting
13:26:29 sean-k-mooney i would prefer if the skip level job was removed until it was fixed but if other agree then we can keep it
13:27:17 elodilles sean-k-mooney: yes, i usually remove as well broken / unfixable CI jobs, but with this i feel some hope o:) (also, it's included via a job template)
13:30:11 sean-k-mooney ill merge it for now and we can discuss it more once the cid is unblocked
13:31:52 elodilles sean-k-mooney: sure, thanks \o/
13:32:01 opendevreview ribaudr proposed openstack/nova master: Add reproducer for cold migration stuck after compute restart https://review.opendev.org/c/openstack/nova/+/988257
13:32:01 opendevreview ribaudr proposed openstack/nova master: Clean up orphaned cold migration on compute restart https://review.opendev.org/c/openstack/nova/+/988258
13:57:10 opendevreview Takashi Kajinami proposed openstack/nova-specs master: libvirt: AMD SEV-SNP support https://review.opendev.org/c/openstack/nova-specs/+/983376
13:59:45 opendevreview ribaudr proposed openstack/nova master: Implementing get_num_instances for ironic virt driver https://review.opendev.org/c/openstack/nova/+/955685
14:04:39 Uggla dansmith, sean-k-mooney as discussed yesterday ^ can you please hava a look.
14:07:04 sean-k-mooney i does not look liek you adressed gibi's comments on stale comments
14:07:23 opendevreview Julien LE JEUNE proposed openstack/nova master: Reproduce bug #2150616: KeyError in _rollback_volume_bdms https://review.opendev.org/c/openstack/nova/+/986754
14:07:23 opendevreview Julien LE JEUNE proposed openstack/nova master: Fix KeyError in _rollback_volume_bdms aborting live-migration rollback https://review.opendev.org/c/openstack/nova/+/988263
14:07:26 sean-k-mooney well at least particlly
14:07:42 sean-k-mooney over all i think it looks ok
14:07:48 sean-k-mooney just lookign quickly
15:41:48 opendevreview Merged openstack/placement stable/2025.1: [CI][stable-only] Fix docs job https://review.opendev.org/c/openstack/placement/+/980761
16:05:21 gibi as https://review.opendev.org/c/openstack/devstack/+/988214 has been merged the nova-alt-configuration job should start passing again. Happy rechecking
16:40:54 dansmith sweet
19:08:58 opendevreview Merged openstack/nova stable/2026.1: Fix resize to unpermitted flavors https://review.opendev.org/c/openstack/nova/+/988148
21:18:06 opendevreview Merged openstack/nova master: Fix functional tests and mypy on macOS https://review.opendev.org/c/openstack/nova/+/937727
22:59:14 opendevreview Merged openstack/os-vif master: Deprecate version module https://review.opendev.org/c/openstack/os-vif/+/987636
#openstack-nova - 2026-05-13
07:16:38 opendevreview Takashi Kajinami proposed openstack/nova-specs master: libvirt: AMD SEV-SNP support https://review.opendev.org/c/openstack/nova-specs/+/983376
07:18:28 opendevreview Takashi Kajinami proposed openstack/nova-specs master: libvirt: AMD SEV-SNP support https://review.opendev.org/c/openstack/nova-specs/+/983376
07:45:03 opendevreview Dong Ma proposed openstack/nova master: Keep cached VIF until host-side unplug succeeds https://review.opendev.org/c/openstack/nova/+/988390
07:48:29 opendevreview Dong Ma proposed openstack/nova master: Keep cached VIF until host-side unplug succeeds https://review.opendev.org/c/openstack/nova/+/988390
07:59:12 sean-k-mooney[m] [gibi](https://matrix.to/#/@_oftc_gibi:matrix.org) i have a working kernel module that does not require a special vm and can emulate multiple PFs each with up to 7 VFs. the pfs and vfs are enumerable in lspci qnd libvirt, get assigned a seperate iommu group and emulate a simple tty loopback device that works in a cirros qemu instance. so with this we could fully test pci passthough and sriov
08:01:33 sean-k-mooney[m] im going to look at adding the kernel to our zuul instance and creating a new cyborg extra repo to pacgakege the module and provide a set of playbooks to enable building a minimal kernel with the module
08:03:58 sean-k-mooney[m] nova alt config or nova next should ideally jusr be able to enable the pre playbook and it would handel the build and reboot into the 7.1 kernel. im also considering if a dkms module for ubuntu 26.04 would also be a valid apporch
08:40:35 gibi sean-k-mooney: sounds cool
08:42:18 sean-k-mooney[m] i think i can make the devices livemigratable too in the future
08:43:13 sean-k-mooney[m] to make the device fully work i needed to provide a vfio variant driver like is used for nvdia vgpus
08:43:53 sean-k-mooney[m] you can pass the device to a vm with the standard vfio-pci
08:44:20 sean-k-mooney[m] and it will be visible to the guest but reads and writes to bar0 dont work
08:44:35 sean-k-mooney[m] so we can test managed true or false
08:44:54 sean-k-mooney[m] bit false is needed for it to fully work in the guest
08:45:57 sean-k-mooney[m] im sure i could emulate orther device thia way too now that i have a working framework
09:11:09 frickler gibi: was the pyroute2 issue only sporadic? I'm wondering whether we should do more rechecks on the test change or whether we should actually to try the reqs bump now that the CI is all green
09:30:43 sean-k-mooney[m] [frickler](https://matrix.to/#/@_oftc_frickler:matrix.org) i belive yes it was nondetermistic
09:32:00 sean-k-mooney[m] that why we were originally able to bump it becase it worked well enough for the tempest test to pass in the requirements repo
10:19:50 frickler ok, I'll rebase my patch and run some more iterations
11:35:33 gibi frickler: indeed it is intermittent. And only a subset of the occurence of the log "This event loop is already running" actually causing tempest failure
11:40:58 gibi frickler: I think we have another complication. I read back the os-vif bug https://bugs.launchpad.net/os-vif/+bug/2109396 and when the above log can cause tempest failure is during testing of interface detach. We discussed yesterday that this is potentially an eventlet + asyncio issue and we only have nova-alt-configuration left running with eventlet mode we need that job to test interface detach
11:41:04 gibi otherwise we miss the potential issue with pyroute2
11:41:59 gibi Unfortunately I don't see such detach interface test result in the nova-alt-configuration in previous run During interface detach os-vif fails with:
11:42:11 gibi Unfortunately I don't see such detach interface test result in the nova-alt-configuration in previous run https://0c34cad25d42d1a19e0a-af98ebf7fb9f80d504693b6d78e0e17e.ssl.cf5.rackcdn.com/openstack/8ba07fdc336b43b9855a6abd3ac25cd1/testr_results.html
11:42:32 gibi so I think we lost test coverage when we moved our eventlet testing to nova-alt-configuration
11:42:37 gibi maybe too much
11:44:14 gibi as an immediate fix we can add tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON to nova-alt-configuraton. But probably we should mirror the tests running in nova-next to nova-alt-configuration
12:26:09 sean-k-mooney nova-alt-config was orgianly intened to test livemgirtion primarlly
12:26:15 sean-k-mooney but we coudl add in other test into it
12:26:57 sean-k-mooney gibi: its relitivly fast today so expanding the testing more espcially in light of the eventlet role i tnow plays makes sense

Earlier   Later