| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2026-07-08 | |||
| 16:44:46 | gibi | we join serially but the thread wait for their own 1 sec in parallel | |
| 16:44:54 | gibi | *threads | |
| 16:46:32 | sean-k-mooney | i think your correct | |
| 16:46:48 | sean-k-mooney | im just not sure why we see the wait | |
| 16:47:29 | gibi | anyhow I will dig deeper tomorrow. The last thing I do today is put a patch up to nova to nuke this 1 sec in the test | |
| 16:57:11 | opendevreview | Balazs Gibizer proposed openstack/nova master: HACK:Speed up functional test in threading mode https://review.opendev.org/c/openstack/nova/+/996500 | |
| 16:57:12 | sean-k-mooney | gibi: i might quickly hack on somehting, if i push anything ill add you to it and you can free free to udpate it or push your own fix | |
| 16:57:20 | gibi | OK thanks | |
| 16:57:40 | sean-k-mooney | im basiclly goign to ask ai to reporduce your finding in a test case and then see if it can rootcause it | |
| 16:57:42 | gibi | https://review.opendev.org/c/openstack/nova/+/996500 for me locally re-gains all the lost time in the threading mode | |
| 16:57:50 | gibi | sean-k-mooney: OK cool | |
| 16:58:22 | opendevreview | Balazs Gibizer proposed openstack/nova master: HACK:Speed up functional test in threading mode https://review.opendev.org/c/openstack/nova/+/996500 | |
| 16:58:31 | sean-k-mooney | also cool lets see how that ^ goes in ci over night | |
| 16:58:38 | gibi | yepp | |
| 16:58:42 | gibi | dropping now | |
| 16:58:44 | gibi | see you tomorrow | |
| 17:42:56 | opendevreview | Thibaut Démaret proposed openstack/nova master: libvirt: add disk rotation_rate support for local disks https://review.opendev.org/c/openstack/nova/+/979693 | |
| 18:45:38 | melwitt | I have a patch that has been up for a while with one +2, to make QEMU_IMG_LIMITS configurable if anyone might be interested https://review.opendev.org/c/openstack/nova/+/969538 this came from an old upstream CI issue where the image limit was too low for an encrypted disk with ceph | |
| 20:22:24 | sean-k-mooney | melwitt: so while that helps | |
| 20:22:39 | sean-k-mooney | we proably shoudl fix the memory limit if we are doign this | |
| 20:22:56 | sean-k-mooney | melwitt: currently we are limiting on adress space but we shoudl be limiting on RSS | |
| 20:23:39 | melwitt | hm ok .. I am not yet familiar with that | |
| 20:24:06 | sean-k-mooney | address space is how much well adrsss space that is mapped into the process with or without actual memory usage | |
| 20:24:15 | sean-k-mooney | RSS is residnet set size | |
| 20:24:24 | sean-k-mooney | i.e. how much actual memory is being used | |
| 20:25:05 | sean-k-mooney | in ci with some config we were seing newver version fo ceph/rbd map alot of memory without actully usign a lot of memroy | |
| 20:25:40 | melwitt | oh I see | |
| 20:25:56 | sean-k-mooney | https://github.com/openstack/oslo.concurrency/blob/master/oslo_concurrency/processutils.py#L162 | |
| 20:26:19 | melwitt | a-ha | |
| 20:27:15 | melwitt | so you think if we just s/address_space/resident_set_size/ | |
| 20:27:43 | melwitt | looks like rss has been a choice as long as address space ... so it is not a newly available choice. yet it has not been used | |
| 20:27:51 | melwitt | I wonder if that was deliberate | |
| 20:28:26 | sean-k-mooney | i would just sed it yes | |
| 20:29:54 | melwitt | looks like no one is using it, huh. https://codesearch.openstack.org/?q=resident_set_size&i=nope&literal=nope&files=&excludeFiles=&repos= | |
| 20:31:25 | sean-k-mooney | so i moved the ceph jobs to debian to work around it https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/955714 and proposed a reviert of the tempest skip https://review.opendev.org/c/openstack/tempest/+/955177 | |
| 20:31:54 | sean-k-mooney | but we never actully merge the tempest skip reviert | |
| 20:32:11 | melwitt | yeah, I remembered that. I had wondered what the "real fix" should be | |
| 20:33:48 | sean-k-mooney | i +1 your patch becasue we coudl proceed with it, i think movign to rss instead fo adresss space woudl make sense btu let see if gibi has or somoen else has an opion | |
| 20:34:20 | sean-k-mooney | melwitt: im not agaisnt makign it configurabl i just dont think that the correct limit to use in this case in general | |
| 20:34:31 | sean-k-mooney | but we coudl change that in a followup | |
| 20:35:14 | melwitt | sure. I'm also happy to just change it to resident_set_size if there is no potential bad thing about that haha | |
| 20:35:31 | melwitt | I am a bit wondering why no one has made use of it before | |
| 20:36:36 | sean-k-mooney | well almost nothign uses this in general https://codesearch.openstack.org/?q=ProcessLimits&i=nope&literal=nope&files=&excludeFiles=&repos= | |
| 20:36:45 | sean-k-mooney | and i think the code was cargo culted form nova to the rest | |
| 20:37:31 | sean-k-mooney | tweaking the adress space limit will allow more meory to be used like rss would | |
| 20:37:44 | melwitt | nova trend setter | |
| 20:37:47 | sean-k-mooney | but you may have to set it higher then otherwise | |
| 20:38:26 | melwitt | yeah. I mostly saw how cinder and ironic both doing it | |
| 20:38:44 | sean-k-mooney | you know what ill appove your current patch but lets chat about this more | |
| 20:38:53 | sean-k-mooney | your currrent patch matches cinder and ironics approch | |
| 20:39:06 | sean-k-mooney | so if it works for them it will proably be fine | |
| 20:39:11 | melwitt | it's ok, I don't mind chatting for rss | |
| 20:39:32 | sean-k-mooney | ok but lets check back tomorrow so we dont forget :) | |
| 20:40:12 | melwitt | I feel like dan would have a good input for this but I think he's away until next week | |
| 20:40:20 | sean-k-mooney | gmaan: related to ^ i rebased https://review.opendev.org/c/openstack/tempest/+/955177 to get new results | |
| 20:41:06 | sean-k-mooney | ok im goign to go eat dinner o/ | |
| 20:41:16 | melwitt | ok seeya o/ | |
| 20:48:49 | gmaan | sean-k-mooney: ack | |
| 21:38:07 | opendevreview | Ghanshyam Maan proposed openstack/nova master: Task tracking mechanism for graceful shutdown https://review.opendev.org/c/openstack/nova/+/996299 | |
| 21:57:03 | opendevreview | Merged openstack/nova master: Rename cyborg-tempest to cyborg-tempest-py3 https://review.opendev.org/c/openstack/nova/+/996297 | |
| 23:18:48 | opendevreview | Ashish Gupta proposed openstack/nova master: tests: file-backed SQLite with WAL in threading mode for Database and CellDatabases Fixtures https://review.opendev.org/c/openstack/nova/+/988583 | |
| 23:24:43 | opendevreview | Ashish Gupta proposed openstack/nova master: tests: use file-backed Placement SQLite in functional threading https://review.opendev.org/c/openstack/nova/+/992581 | |
| 23:27:11 | opendevreview | Ashish Gupta proposed openstack/nova master: tests: Use per-database write locks instead of global lock https://review.opendev.org/c/openstack/nova/+/992862 | |
| #openstack-nova - 2026-07-09 | |||
| 00:11:18 | opendevreview | Ashish Gupta proposed openstack/nova master: tests: file-backed SQLite with WAL in threading mode for Database and CellDatabases Fixtures https://review.opendev.org/c/openstack/nova/+/988583 | |
| 00:13:14 | opendevreview | Ashish Gupta proposed openstack/nova master: tests: use file-backed Placement SQLite in functional threading https://review.opendev.org/c/openstack/nova/+/992581 | |
| 00:15:14 | opendevreview | Ashish Gupta proposed openstack/nova master: tests: Use per-database write locks instead of global lock https://review.opendev.org/c/openstack/nova/+/992862 | |
| 00:27:58 | opendevreview | Takashi Kajinami proposed openstack/nova master: Use domain capabilities to detect SEV-SNP support https://review.opendev.org/c/openstack/nova/+/996316 | |
| 00:52:40 | sean-k-mooney | gibi: https://review.opendev.org/c/openstack/futurist/+/996567 and the followups may be of interst. | |
| 02:24:28 | opendevreview | Takashi Kajinami proposed openstack/nova master: libvirt: Remove redundant version check for virtio-fs https://review.opendev.org/c/openstack/nova/+/996496 | |
| 02:41:05 | opendevreview | Ghanshyam Maan proposed openstack/nova master: Call manager graceful_shutdown while RPC server waits https://review.opendev.org/c/openstack/nova/+/996583 | |
| 07:15:43 | frickler | anyone around for stable reviews of the OSSN-0101 fix? https://review.opendev.org/c/openstack/nova/+/995956 etc. | |
| 07:25:33 | opendevreview | Bhavana proposed openstack/nova master: Add Minimal Displacement Solver for MIG GPU Repartitioning https://review.opendev.org/c/openstack/nova/+/996058 | |
| 07:54:35 | gibi | frickler: +2 | |
| 07:54:47 | gibi | elodilles: could you look at these backports? https://review.opendev.org/c/openstack/nova/+/995956 | |
| 07:57:31 | opendevreview | Balazs Gibizer proposed openstack/nova master: HACK:Speed up functional test in threading mode https://review.opendev.org/c/openstack/nova/+/996500 | |
| 08:14:26 | opendevreview | Thibaut Démaret proposed openstack/nova master: libvirt: add disk rotation_rate support for local disks https://review.opendev.org/c/openstack/nova/+/979693 | |
| 08:39:04 | elodilles | gibi: +2'd it. will follow up with the backports to older branches when this merges | |
| 09:30:16 | gibi | elodilles: thanks | |
| 10:43:54 | ralonsoh | hi folks, a quick review for https://review.opendev.org/c/openstack/os-vif/+/995933 will be appreciated | |
| 10:43:55 | ralonsoh | thanks! | |
| 11:00:03 | opendevreview | Merged openstack/nova stable/2026.1: Fix mutating global config in websocket proxy https://review.opendev.org/c/openstack/nova/+/995956 | |
| 11:01:35 | opendevreview | Lajos Katona proposed openstack/nova master: Use SDK for Neutron networks https://review.opendev.org/c/openstack/nova/+/928022 | |
| 11:01:35 | opendevreview | Lajos Katona proposed openstack/nova master: Use SDK for Neutron subnets https://review.opendev.org/c/openstack/nova/+/962190 | |
| 11:53:00 | opendevreview | Ashish Gupta proposed openstack/placement master: tests: Support file-backed SQLite URL in placement fixtures https://review.opendev.org/c/openstack/placement/+/993106 | |
| 12:31:57 | opendevreview | Ashish Gupta proposed openstack/nova master: tests: use file-backed Placement SQLite in functional threading https://review.opendev.org/c/openstack/nova/+/992581 | |
| 12:34:54 | opendevreview | Ashish Gupta proposed openstack/nova master: tests: Use per-database write locks instead of global lock https://review.opendev.org/c/openstack/nova/+/992862 | |
| 13:14:19 | gibi | gmaan: sean-k-mooney: the threading functional test reproduces a seemingly valid API race condition between volume attach and attachment show https://bugs.launchpad.net/nova/+bug/2160224 | |
| 13:15:05 | sean-k-mooney | :) thats fun | |
| 13:15:42 | gibi | we create the BDM in one transaction and populate the attachment_id in second one | |
| 13:15:53 | gibi | in between the two there is a BDM but no attachment_id in it | |
| 13:15:59 | sean-k-mooney | i need to refine the futurist patches not only based on your feed back but to have them relibaliy pass the unit tests :) but there are a lot of optimisation opterutnities there | |
| 13:16:19 | gibi | but the API response schema on showing the attachment insists on having a not non attachment_id in the response | |
| 13:16:29 | gibi | ~not None | |
| 13:16:46 | sean-k-mooney | we proably should weaken it slightly | |
| 13:16:50 | gibi | I will push a fix to return 404 until the BDM has a valid attachement_id | |
| 13:16:58 | sean-k-mooney | if the servier has been built it shoudl be non non | |
| 13:17:00 | gibi | that does not need an response schema chang | |
| 13:17:40 | sean-k-mooney | oh for just GET servers/<server_id>/os-volume_attachments/<volume_id> | |
| 13:17:44 | gibi | yepp | |
| 13:17:48 | sean-k-mooney | so this isnt an issue in server show | |