| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2026-08-11 | |||
| 22:48:19 | dansmith | those first few lines show the end of waiting for the first stop, second stop was already sent at that point | |
| 22:49:06 | dansmith | then actual shutdown starts "graceful shutdown finished", then "Received method during closing channel" and then stopping RPC server, then again for some reason | |
| 22:49:15 | dansmith | but those were like a minute or two after I sent the second stop | |
| 22:49:24 | gmaan | can you paste a few more log above that. whn shutdown started | |
| 22:49:38 | gmaan | because that time we do stop main rpcserver where 2nd stop_instance should not be picked | |
| 22:50:28 | dansmith | it waited for minutes, so nore than a few lines but.. | |
| 22:50:56 | dansmith | https://paste.opendev.org/show/bGlDyiz2mraL9dQ3DSfd/ | |
| 22:51:21 | dansmith | first line is graceful start, then waiting for 1 in-progress, somewhere in there is when I issued the second stop | |
| 22:51:54 | dansmith | then L72 is when the first stop finishes its artificial sleep delay and actually completes | |
| 22:53:34 | gmaan | so L5 is where we stop rpc server and i cannot see where is 2ns stop_instance is receveid | |
| 22:54:13 | dansmith | nel 1. This method will be ignored | |
| 22:54:13 | dansmith | right (on L5).. isn't this us receiving something on the should-be-closed channel? > Received method (60, 30) during closing chan | |
| 22:57:14 | dansmith | after restart I don't see my logs that stop gets called again, which is why I'm assuming it is ^ | |
| 22:57:51 | dansmith | one of my instances is wedged because I was testing the manila share stuff before this.. perhaps I'll try getting a fully clean environment and try to reproduce this in case I've got something stuck that is getting in the way | |
| 22:58:09 | gmaan | need to check on oslo.messaging side what is this exactly because in rpcserver.stop() listener stopped listening anything from queue | |
| 22:58:22 | dansmith | ack, that was my expectation of course | |
| 22:58:38 | dansmith | either way, that aside, it's cool to see the graceful shutdown waiting for the stop task as expected now | |
| 22:59:21 | gmaan | it worked for me but yeah please try on clean env. let me check those warning in my cpu log again. i did not gave attension to those as 2nd stop was picked up and successful after compute came up | |
| 23:06:51 | gmaan | dansmith: i can see those amqp warnings even my scenario is passing means 2nd stop was picked up once compute is started again | |
| 23:07:18 | gmaan | i will check these warnings if those are from loopingcall; or so | |
| 23:07:31 | gmaan | later, need to pick kids from school | |
| #openstack-nova - 2026-08-12 | |||
| 00:45:54 | opendevreview | Merged openstack/nova stable/2026.1: Implementing get_num_instances for ironic virt driver https://review.opendev.org/c/openstack/nova/+/989002 | |
| 05:01:25 | opendevreview | Ghanshyam Maan proposed openstack/nova master: Unify the thread pool executors into a central factory https://review.opendev.org/c/openstack/nova/+/998571 | |
| 05:20:47 | opendevreview | Bhavana proposed openstack/nova-specs master: Add spec for MIG-aware PCI Host Weigher https://review.opendev.org/c/openstack/nova-specs/+/998753 | |
| 06:36:03 | opendevreview | Goutham Pacha Ravi proposed openstack/nova master: Extract share management from ComputeManager https://review.opendev.org/c/openstack/nova/+/999349 | |
| 06:36:04 | opendevreview | Goutham Pacha Ravi proposed openstack/nova master: Support cold migration with virtiofs shares https://review.opendev.org/c/openstack/nova/+/989633 | |
| 09:47:27 | opendevreview | Stephen Finucane proposed openstack/nova master: trivial: Fix outstanding flake8 issues https://review.opendev.org/c/openstack/nova/+/999714 | |
| 09:47:27 | opendevreview | Stephen Finucane proposed openstack/nova master: Replace use of datetime.timezone.UTC https://review.opendev.org/c/openstack/nova/+/989515 | |
| 09:47:28 | opendevreview | Stephen Finucane proposed openstack/nova master: Enable G (flake8-logging-format) rules https://review.opendev.org/c/openstack/nova/+/998557 | |
| 09:47:28 | opendevreview | Stephen Finucane proposed openstack/nova master: Add ruff-check https://review.opendev.org/c/openstack/nova/+/974441 | |
| 13:12:25 | gibi | tkajinam: antia: I'm not 100% clear on the status of the TDX discussion. Is there still an open question or antia just needs to adjust the series according to the latest discussion? | |
| 13:16:12 | antia | gibi: I think all is clear now, just doing the final adjustments | |
| 13:18:27 | gibi | antia: cool. thanks | |
| 13:46:52 | opendevreview | Kamil Sambor proposed openstack/nova master: Add regression test for BFV evacuate + Cinder timeout https://review.opendev.org/c/openstack/nova/+/999261 | |
| 13:52:44 | dansmith | gmaan: okay clean install this morning and I'm able to see the full thing working.. I do still get the weird "received, ignored" message before the compute shuts down | |
| 13:53:16 | dansmith | gmaan: however, I can see the second stop queued in rabbit after shutdown and can see it replayed after restart and have it actually do the thing we want, so that's cool | |
| 13:53:41 | dansmith | I dunno why not before, but like I say I was pivoting from the manila stuff so something must not have been right | |
| 15:35:29 | gmaan | dansmith: thanks for testing and review. i did not time to check that warning things yesterday but I will check if that is something valid one because amqp listener stopped listening but queue was up or so | |
| 17:17:10 | gmaan | melwitt: these two changes for graceful shutdown are ready for 2nd core, first one you already reviewed earlier with +1, please check https://review.opendev.org/c/openstack/nova/+/996299 https://review.opendev.org/c/openstack/nova/+/996583 | |
| 17:17:40 | melwitt | gmaan: nice, will look | |
| 17:17:53 | gmaan | thanks | |
| 17:54:38 | opendevreview | Goutham Pacha Ravi proposed openstack/nova master: Support cold migration with virtiofs shares https://review.opendev.org/c/openstack/nova/+/989633 | |
| 20:58:37 | opendevreview | Ashish Gupta proposed openstack/nova master: Make functional-py313-threading voting https://review.opendev.org/c/openstack/nova/+/997216 | |
| 20:58:38 | opendevreview | Ashish Gupta proposed openstack/nova master: Fix test_fill_vifs_migration under native threading https://review.opendev.org/c/openstack/nova/+/1000780 | |
| #openstack-nova - 2026-08-13 | |||
| 04:01:41 | opendevreview | Ghanshyam Maan proposed openstack/nova master: Unify the thread pool executors into a central factory https://review.opendev.org/c/openstack/nova/+/998571 | |
| 04:22:06 | opendevreview | Ghanshyam Maan proposed openstack/nova master: Shutdown thread pool executors during service shutdown https://review.opendev.org/c/openstack/nova/+/1000211 | |
| 05:07:18 | opendevreview | Ghanshyam Maan proposed openstack/nova master: Shutdown thread pool executors during graceful shutdown https://review.opendev.org/c/openstack/nova/+/1000211 | |
| 05:07:47 | opendevreview | Ghanshyam Maan proposed openstack/nova master: Add doc and release notes for the graceful shutdown task tracking https://review.opendev.org/c/openstack/nova/+/997141 | |
| 07:25:45 | opendevreview | Anton Iacobaeus proposed openstack/nova master: libvirt: Generalize memory encryption config https://review.opendev.org/c/openstack/nova/+/998466 | |
| 07:25:46 | opendevreview | Anton Iacobaeus proposed openstack/nova master: libvirt: Launch security Intel TDX https://review.opendev.org/c/openstack/nova/+/999249 | |
| 07:25:46 | opendevreview | Anton Iacobaeus proposed openstack/nova master: libvirt: Add memory encryption config for TDX https://review.opendev.org/c/openstack/nova/+/998608 | |
| 07:25:47 | opendevreview | Anton Iacobaeus proposed openstack/nova master: libvirt: reject_mem_enc_instances https://review.opendev.org/c/openstack/nova/+/1000082 | |
| 07:25:47 | opendevreview | Anton Iacobaeus proposed openstack/nova master: doc: Add documentation for Intel TDX https://review.opendev.org/c/openstack/nova/+/1000081 | |
| 07:25:48 | opendevreview | Anton Iacobaeus proposed openstack/nova master: libvirt: Add os_firmware_secure https://review.opendev.org/c/openstack/nova/+/1000472 | |
| 07:57:47 | opendevreview | Anton Iacobaeus proposed openstack/nova master: libvirt: Check only x86_64 arch for Intel TDX https://review.opendev.org/c/openstack/nova/+/1000805 | |
| 08:33:51 | opendevreview | Lajos Katona proposed openstack/nova master: libvirt: Avoid setting MTU during live migration if different https://review.opendev.org/c/openstack/nova/+/995809 | |
| 08:33:51 | opendevreview | Lajos Katona proposed openstack/nova master: libvirt: Add test for MTU overwrite during live migration https://review.opendev.org/c/openstack/nova/+/995803 | |
| 08:33:52 | opendevreview | Lajos Katona proposed openstack/nova master: libvirt: Preserve queue_size during live migration https://review.opendev.org/c/openstack/nova/+/995841 | |
| 08:33:52 | opendevreview | Lajos Katona proposed openstack/nova master: Add regression test to repoduce bug 1854844 https://review.opendev.org/c/openstack/nova/+/991772 | |
| 08:38:57 | RomanHros[m] | Hello, please someone look at the https://launchpad.net/bugs/2016173. It looks like very beneficial patch but seems to be forgotten... | |
| 09:42:24 | frickler | melwitt: sean-k-mooney[m]: ^^ any reason this is stuck except lack of focus? https://review.opendev.org/c/openstack/nova/+/880399 | |
| 09:45:19 | sean-k-mooney[m] | nothing comes to mind | |
| 09:48:39 | sean-k-mooney[m] | im still waking up but i can take a look properly when im at my desk | |
| 10:39:31 | opendevreview | Stephen Finucane proposed openstack/nova master: Add ruff-check https://review.opendev.org/c/openstack/nova/+/974441 | |
| 10:39:31 | opendevreview | Stephen Finucane proposed openstack/nova master: trivial: Fix outstanding flake8 issues https://review.opendev.org/c/openstack/nova/+/999714 | |
| 10:39:32 | opendevreview | Stephen Finucane proposed openstack/nova master: Enable G (flake8-logging-format) rules https://review.opendev.org/c/openstack/nova/+/998557 | |
| 13:24:51 | gibi | antia: tkajinam: after pulling down the latest version of the TDX series to the same machine I used before for testing I libvirt rejects the VM boot with | |
| 13:24:54 | gibi | Aug 13 16:23:40 beast01.rhos.lab.eng.brq2.redhat.com nova-compute[1108220]: ERROR nova.compute.manager [instance: e034aa57-fdca-4ea2-831f-41bcf51eb1d3] libvirt.libvirtError: operation failed: Unable to find 'efi' firmware that is compatible with the current configuration | |
| 13:25:18 | gibi | so I guess this is connected to the secure loader / secure firmware change | |
| 13:25:30 | antia | gibi: okay interesting | |
| 13:25:52 | gibi | it is on centos 10 stream | |
| 13:27:24 | antia | what firmware files does it have? | |
| 13:27:45 | gibi | https://paste.openstack.org/show/bT6yOXgAEr7XuYjlHCvI/ | |
| 13:27:53 | gibi | this is the xml | |
| 13:28:54 | antia | that forces no secure boot, does it have a no secure boot TDX firmware? | |
| 13:28:55 | gibi | collecting... | |
| 13:29:41 | gibi | https://paste.openstack.org/show/bSKoS2kOht69y2yUygFX/ | |
| 13:29:46 | gibi | these are the descriptors | |
| 13:30:37 | gibi | it seems that I have only one tdx descriptor and that points to a secureboot firmware | |
| 13:30:58 | antia | yup that makes sense, I have the same on my system | |
| 13:31:16 | gibi | OK so I guess I can boot if I request secureboot as well | |
| 13:31:42 | antia | or set it to 'optional' | |
| 13:31:56 | sean-k-mooney | optinal effectivly mean off | |
| 13:32:01 | gibi | I have OVMF.inteltdx.secboot.fd and OVMF.inteltdx.fd so I can also create a new descriptor | |
| 13:32:06 | sean-k-mooney | it means libvirt decies which migh tactully work now | |
| 13:32:26 | sean-k-mooney | beofre it used ot more or less be off but worht a try | |
| 13:32:33 | antia | I think in this case libvirt has no other choice than to give an enabled one, but I could be wrong | |
| 13:32:36 | gibi | sean-k-mooney: given I have only firmware descriptor for tdx + secure boot libvirt will select that if optional | |
| 13:32:45 | gibi | I will test it :) | |
| 13:33:34 | antia | https://paste.openstack.org/show/bdbleKLLworBpma70kXB/ | |
| 13:33:34 | antia | I created a no secure boot firmware from my available firmware | |
| 13:34:11 | antia | I suppose it works differently on centos | |
| 13:36:03 | gibi | yepp optional works and the VM uses the secure boot firmware | |
| 13:36:17 | gibi | as that is the only one with tdx now | |
| 13:36:51 | gibi | I will try antia's nosb descriptor now :) | |
| 13:37:01 | antia | :D | |
| 13:39:28 | gibi | ...adapted to my env | |
| 13:40:37 | sean-k-mooney | ya its likely just a packaging issue | |
| 13:41:04 | sean-k-mooney | thats not a blocker for the feature | |
| 13:42:42 | gibi | yeah it seems to work | |