Earlier  
Posted Nick Remark
#openstack-nova - 2026-02-04
17:21:01 sean-k-mooney )
17:22:25 sean-k-mooney it was orgilly suggestign puting the neutron netrokign call on that but i guess the only thing that impoant to consider is the _upload_data function
17:22:40 sean-k-mooney https://github.com/openstack/nova/blob/master/nova/image/glance.py#L580-L586
17:22:42 gibi OK, I will check the _upload_data codepath
17:23:09 sean-k-mooney im not sure we want to block the RPC thread with doing the file upload for snapshots
17:24:04 sean-k-mooney but as dan also pointed out unless we have a futre we can pass in or simialr i dont know hwe we are going to deal with returning the image uuid that is created form this call
17:24:45 sean-k-mooney when you do openstack server image create we need to return teh glance image id for the snapshot form the api if i recall correctly
17:24:49 gibi yepp, I need to think about all these.
17:26:05 sean-k-mooney doign it inline is fine if we move thie operation entrily to teh long runing thread pool but th ereply path is still an unknow i guess
17:26:26 gibi sean-k-mooney: food for thought. How do you feel about https://github.com/openstack/futurist/blob/master/futurist/_futures.py#L232 as a way out of deadlocks due to limited executor sizes?
17:26:37 gibi DynamicThreadPoolExecutor
17:27:07 sean-k-mooney i have not looked at that before but i was debeating about creatin a new executor propsosla that handeled prities canclation and delayed exection
17:27:53 gibi for the delayed execution I have this WIP in futurist https://review.opendev.org/c/openstack/futurist/+/975508
17:27:53 sean-k-mooney gibi: but i dont feel terible about one that cna grow as a way out
17:28:39 gibi yeah we still need to limit our parallel work due to IO and overall memory usage but at least the deadlock becomes something else :)
17:28:52 sean-k-mooney so the lib that watcher and zuul uses has lots of interest feature but the reason im not really suggesting that at the morment is that lib is 4? yes int a v4 rewirte which break backward compatiblity
17:29:02 sean-k-mooney *4 years?
17:30:27 sean-k-mooney gibi: ill try and rominate on it. im not a huge fan of async io. i dont hate it but i was also wonderign if we could/should consider limited use fo an asynio executor
17:32:05 sean-k-mooney if we were to use the DynamicThreadPoolExecutor
17:32:33 sean-k-mooney are you suggesting we woudl not set a max workers or set it relitivly high with the expcation taht in reality it will stay small?
17:33:12 gibi I have to read on what the Dynamic supports regarding sizing but I see that it can grow and shrink
17:33:38 sean-k-mooney """ If threads are not created often in your application, the number of idle
17:33:40 sean-k-mooney threads may stay high for a long time. To avoid it, you can call
17:33:42 sean-k-mooney :py:meth:`.maintain` periodically to keep the number of threads within
17:33:44 sean-k-mooney the thresholds."""
17:34:07 sean-k-mooney we might need to do that ^
17:35:32 sean-k-mooney gibi: i dont hate that idea if im honest. but its proably the rpc pool in oslo service that woudl be the most benifical to use that with right?
17:36:02 sean-k-mooney sorry in oslo.messaging
17:36:56 gibi yeah that too :)
17:37:24 sean-k-mooney i know we can set an executor type when we create the rpc servier im wondering if we can just provide an rpc instance
17:37:30 sean-k-mooney *executor instance
17:38:31 sean-k-mooney ya its just the name https://github.com/openstack/oslo.messaging/blob/master/oslo_messaging/rpc/server.py#L226-L240
17:41:15 sean-k-mooney so we woudl have ot update https://github.com/openstack/oslo.messaging/blob/master/pyproject.toml#L53
17:41:24 sean-k-mooney or add a new value
17:41:55 sean-k-mooney might be worth suggeting that to the oslo folks and see what they think
18:03:16 dansmith I'm not sure how the dynamic one really helps
18:03:43 dansmith you still have to set your max to the upper limit of what you're willing tolerate.. it uses less memory in slow times, which is a benefit, but it's still the same problem when you hit the limit
18:06:50 gmaan yeah, it does not solve the limit issue. I think we should be gradually learning about those limit issue (after solving the known one) and keep improving the defaults limit or better separate executor if any specific operations causing problem
18:36:20 gibi https://etherpad.opendev.org/p/eventlet-executor-semaphore-limit this is my brain dump looking at the long running task executor possibilities
18:36:47 gibi we have a list of pros and cons to choose from
18:38:45 gmaan thanks for catching those in etherpad
19:01:00 opendevreview Balazs Gibizer proposed openstack/nova master: Move the concurrent builds to its own Executor https://review.opendev.org/c/openstack/nova/+/975694
19:01:43 gibi this is the very raw idea of optionA) from the etherpad ^^ not tested at all :)
19:01:52 gibi and that marks my end of day
19:01:54 gibi o/
19:43:44 opendevreview Marius Leustean proposed openstack/nova-specs master: Add spec for handling orphan BDMs from late RPC processing https://review.opendev.org/c/openstack/nova-specs/+/975698
22:20:50 opendevreview Merged openstack/nova master: Fix blockio generation for LUN volumes https://review.opendev.org/c/openstack/nova/+/975542
#openstack-nova - 2026-02-05
01:17:56 gmaan sean-k-mooney: I did not +W this as you might want to review it too, if not let me know and I can apply +W https://review.opendev.org/c/openstack/nova/+/974445
01:18:11 gmaan rest other in the series are good to go
01:19:41 opendevreview melanie witt proposed openstack/nova master: TPM: prepare to bump service version for live migration https://review.opendev.org/c/openstack/nova/+/962051
01:19:41 opendevreview melanie witt proposed openstack/nova master: TPM: support live migration of `host` secret security https://review.opendev.org/c/openstack/nova/+/941483
01:19:42 opendevreview melanie witt proposed openstack/nova master: TPM: support live migration of `deployment` secret security https://review.opendev.org/c/openstack/nova/+/925771
01:19:42 opendevreview melanie witt proposed openstack/nova master: TPM: test live migration between hosts with different security https://review.opendev.org/c/openstack/nova/+/952629
01:19:43 opendevreview melanie witt proposed openstack/nova master: TPM: add late check for supported TPM secret security https://review.opendev.org/c/openstack/nova/+/956975
01:19:43 opendevreview melanie witt proposed openstack/nova master: TPM: opt-in to new TPM secret security via resize https://review.opendev.org/c/openstack/nova/+/962052
01:19:44 opendevreview melanie witt proposed openstack/nova master: DNM vtpm tempest https://review.opendev.org/c/openstack/nova/+/957477
01:19:45 opendevreview melanie witt proposed openstack/nova master: TPM: bump service version to enable live migration https://review.opendev.org/c/openstack/nova/+/975724
01:22:22 gmaan sean-k-mooney: ah you already checked and left comment there, got it now. I +w it.
02:32:50 opendevreview Takashi Natsume proposed openstack/nova master: Update contributor guide for 2026.1 Gazpacho https://review.opendev.org/c/openstack/nova/+/961896
02:37:50 opendevreview Ghanshyam proposed openstack/nova master: DNM: test oslo.service set_service_opts_defaults https://review.opendev.org/c/openstack/nova/+/975739
02:38:52 opendevreview Ghanshyam proposed openstack/nova master: DNM: test oslo.service set_service_opts_defaults https://review.opendev.org/c/openstack/nova/+/975739
03:14:07 opendevreview Merged openstack/nova master: Libvirt event handling without eventlet https://review.opendev.org/c/openstack/nova/+/965949
03:14:23 opendevreview Merged openstack/nova master: SubclassSignatureTestCase to use NoDBTestCase as base https://review.opendev.org/c/openstack/nova/+/974861
03:43:48 opendevreview Merged openstack/nova master: Enable mypy on nova/utils.py https://review.opendev.org/c/openstack/nova/+/969936
03:56:57 opendevreview Ghanshyam proposed openstack/nova master: DNM: test oslo.service set_service_opts_defaults https://review.opendev.org/c/openstack/nova/+/975739
06:36:05 opendevreview Takashi Kajinami proposed openstack/nova master: libvirt: Extend functional test coverage of UEFI boot guests https://review.opendev.org/c/openstack/nova/+/969263
06:36:05 opendevreview Takashi Kajinami proposed openstack/nova master: libvirt: Add basic xml generation for firmware auto selection https://review.opendev.org/c/openstack/nova/+/969085
06:36:06 opendevreview Takashi Kajinami proposed openstack/nova master: libvirt: Add capability to load loader and nvram from xml https://review.opendev.org/c/openstack/nova/+/969086
06:36:06 opendevreview Takashi Kajinami proposed openstack/nova master: libvirt: Add capability to load smm feature from existing xml https://review.opendev.org/c/openstack/nova/+/969131
06:36:07 opendevreview Takashi Kajinami proposed openstack/nova master: libvirt: Use firmware auto-selection by libvirt https://review.opendev.org/c/openstack/nova/+/969132
07:40:42 opendevreview Takashi Kajinami proposed openstack/nova master: AMD SEV: omit iommu='on' for virtio devices https://review.opendev.org/c/openstack/nova/+/909635
07:40:55 opendevreview Takashi Kajinami proposed openstack/nova master: libvirt: Remove tpm support detection for libvirt < 8.0.0 https://review.opendev.org/c/openstack/nova/+/952308
07:41:03 opendevreview Takashi Kajinami proposed openstack/nova master: libvirt: Drop redundant chown of tpm data directory https://review.opendev.org/c/openstack/nova/+/962446
10:56:25 opendevreview Merged openstack/nova master: Live migration with iothreads https://review.opendev.org/c/openstack/nova/+/975000
11:18:09 opendevreview John Garbutt proposed openstack/nova master: Make PCPUs not land on VCPUs by default https://review.opendev.org/c/openstack/nova/+/975779
12:18:10 opendevreview Max proposed openstack/nova master: fix: _get_guest_disk_device UnboundLocalError https://review.opendev.org/c/openstack/nova/+/975783
#openstack-nova - 2026-02-19
02:57:44 opendevreview Ghanshyam Maan proposed openstack/nova master: Use 2nd RPC server in compute operations https://review.opendev.org/c/openstack/nova/+/975588
04:34:26 opendevreview Ghanshyam Maan proposed openstack/nova master: Prepare resize/cold migration for graceful shutdown https://review.opendev.org/c/openstack/nova/+/977182
05:02:16 opendevreview Ghanshyam Maan proposed openstack/nova master: Use 2nd RPC server in compute operations https://review.opendev.org/c/openstack/nova/+/975588
05:46:46 opendevreview Ghanshyam Maan proposed openstack/nova master: Prepare resize/cold migration for graceful shutdown https://review.opendev.org/c/openstack/nova/+/977182
06:14:06 opendevreview Ghanshyam Maan proposed openstack/nova master: Use 2nd RPC server in compute operations https://review.opendev.org/c/openstack/nova/+/975588
06:24:03 opendevreview Ghanshyam Maan proposed openstack/nova master: Prepare resize/cold migration for graceful shutdown https://review.opendev.org/c/openstack/nova/+/977182
07:03:52 opendevreview Ghanshyam Maan proposed openstack/nova master: Use 2nd RPC server in compute operations https://review.opendev.org/c/openstack/nova/+/975588
07:11:09 opendevreview Ghanshyam Maan proposed openstack/nova master: Prepare resize/cold migration for graceful shutdown https://review.opendev.org/c/openstack/nova/+/977182
08:54:08 opendevreview Dominik proposed openstack/nova master: NUMA Topology with Resource Providers: Libvirt NUMA Migrate https://review.opendev.org/c/openstack/nova/+/971177
09:22:42 gibi sean-k-mooney: hi, there is another iothreads fix from lajoskatona that ready to land https://review.opendev.org/c/openstack/nova/+/975934
09:44:46 opendevreview Silvan Kaiser proposed openstack/nova master: libvirt: partial revert, Quobyte driver supported again https://review.opendev.org/c/openstack/nova/+/977300
09:46:11 opendevreview Silvan Kaiser proposed openstack/nova master: libvirt: partial revert, Quobyte driver supported again https://review.opendev.org/c/openstack/nova/+/977300
10:31:42 sean-k-mooney gibi: ah yes i didnt pull it donw since they respon it but ill take a look shortly
10:31:53 sean-k-mooney that was on my todo list thatnks for the reminder
10:42:53 sean-k-mooney gibi: ill have finsihed testing this in about 15 minute and then ill submit it but how do you feel about adding whitebox to check? we talked about it a few times but it actully caght this bug
10:43:57 sean-k-mooney i mentioned it offhand to jparker too but i recnectly became aware that the linux kernle has the ablity to emulate/report multiple numa nodes as well
10:44:31 sean-k-mooney with not much effort we coulf properly test live migration with and without cpu pinning and hugepages and numa in the first part ci
10:44:58 sean-k-mooney we have most of it already in whitebox we just need to run it and tweak the job slichtly if we want ot add numa
10:45:57 sean-k-mooney i need to tweak my old patch that we reverted for the basic testing of cpu_share_set and repo-spe that for nova-alt-config
10:51:19 opendevreview ribaudr proposed openstack/nova master: FUP Add HW_PCI_LIVE_MIGRATABLE trait to PCI resource providers https://review.opendev.org/c/openstack/nova/+/977310
11:13:41 sean-k-mooney lajoskatona: gibi tested and approved it will hopefully merge later today and unblock https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/975225
11:14:20 sean-k-mooney it has also been tested trasitivly via that change
11:17:47 lajoskatona sean-k-mooney, gibi: thanks
11:24:01 priteau Lots of jobs hitting post_failure in 2025.1 :( ModuleNotFoundError: No module named 'typing_extensions'

Earlier   Later