| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2024-06-19 | |||
| 16:26:31 | bauzas | because pre.yaml runs before tempest creates its own flavors | |
| 16:26:43 | sean-k-mooney | pre runs before the run playbook | |
| 16:26:48 | sean-k-mooney | so be fore devstack is run | |
| 16:27:41 | sean-k-mooney | local.sh is run here https://github.com/openstack/devstack/blob/master/stack.sh#L1485-L1492 | |
| 16:27:56 | bauzas | 2024-06-19 15:18:24.159 | ++ lib/tempest:install_tempest:815 : git_clone https://opendev.org/openstack/tempest.git /opt/stack/tempest master | |
| 16:28:09 | bauzas | compared to 2024-06-19 15:17:50.794 | + ./stack.sh:main:1489 : [[ -x /opt/stack/devstack/local.sh ]] | |
| 16:28:27 | bauzas | so pre-run is called before install_tempest | |
| 16:28:42 | sean-k-mooney | pre-run is called before the run playbook | |
| 16:28:54 | sean-k-mooney | so its run after all the parent jobs pre playbooks | |
| 16:29:04 | sean-k-mooney | and be fore the current jobs run playbook | |
| 16:29:14 | sean-k-mooney | so its before stack.sh is invoked | |
| 16:29:30 | sean-k-mooney | the proable i think is your using the wrong path | |
| 16:29:32 | sean-k-mooney | on sec | |
| 16:29:36 | sean-k-mooney | your using /opt/stack/devstack/local.sh | |
| 16:30:17 | bauzas | which is expected path, right? | |
| 16:30:35 | sean-k-mooney | not in ci | |
| 16:30:46 | sean-k-mooney | that is not where devstack will be cloned | |
| 16:32:03 | bauzas | https://github.com/openstack/devstack/blob/master/stack.sh#L1489 is where my /opt/stack/devstack/local.sh script is called | |
| 16:32:11 | bauzas | 2024-06-19 15:17:50.794 | + ./stack.sh:main:1489 : [[ -x /opt/stack/devstack/local.sh ]] | |
| 16:32:20 | sean-k-mooney | oh actully i gues its correct | |
| 16:32:22 | sean-k-mooney | https://review.opendev.org/c/openstack/nova/+/679656/13/playbooks/nfv/nfv.yaml | |
| 16:32:30 | sean-k-mooney | oh right | |
| 16:32:40 | bauzas | but alas, install_tempest runs *after* stack.sh | |
| 16:32:57 | sean-k-mooney | it should not | |
| 16:33:11 | sean-k-mooney | we install tempet as part of devstack | |
| 16:34:04 | bauzas | yeah I'm confused | |
| 16:34:13 | sean-k-mooney | do you have a link to th job | |
| 16:34:18 | bauzas | yeah | |
| 16:34:29 | bauzas | https://zuul.opendev.org/t/openstack/build/32d394d8265e4cc188fc3c5a50d33993 | |
| 16:39:06 | sean-k-mooney | im about to finish for today but ill take a look beofre i drop | |
| 16:40:28 | bauzas | I think I found why | |
| 16:40:34 | bauzas | 2024-06-19 15:18:23.933 | + ./stack.sh:main:1517 : run_phase stack test-config | |
| 16:40:45 | bauzas | then runs 2024-06-19 15:18:23.963 | ++ functions-common:run_phase:1860 : basename /opt/stack/devstack/extras.d/80-tempest.sh | |
| 16:41:13 | bauzas | which then does some async_wait 2024-06-19 15:18:24.047 | ++ extras.d/80-tempest.sh:source:20 : async_wait install_tempest | |
| 16:41:49 | bauzas | which then installs tempest 2024-06-19 15:18:24.159 | ++ lib/tempest:install_tempest:815 : git_clone https://opendev.org/openstack/tempest.git /opt/stack/tempest master | |
| 16:49:34 | sean-k-mooney | that sounds like a regression in devstack | |
| 16:51:12 | bauzas | maybe I should create the flavors and then configure tempest to use them | |
| 16:52:22 | sean-k-mooney | i have doen that in the past too | |
| 16:52:25 | sean-k-mooney | it works | |
| 16:52:37 | bauzas | do you have some job using it ? | |
| 16:52:38 | sean-k-mooney | thats what i normally do https://review.opendev.org/c/openstack/nova/+/679656/13/playbooks/nfv/nfv.yaml | |
| 16:52:50 | sean-k-mooney | bauzas: not that we merged | |
| 16:53:08 | sean-k-mooney | but i created multi numa testing jobs a few times in the past | |
| 16:53:12 | sean-k-mooney | just to show it workign | |
| 16:53:35 | bauzas | cool | |
| 16:53:52 | bauzas | I already knew how to use another flavor for Tempest https://docs.openstack.org/tempest/latest/configuration.html#flavors | |
| 16:54:20 | bauzas | but I found how to modify the config by a CI job with your change : https://review.opendev.org/c/openstack/nova/+/679656/13/.zuul.yaml | |
| 16:54:22 | bauzas | thanks | |
| 16:54:47 | bauzas | I think it's better than just modifying all of the flavors | |
| 16:55:01 | bauzas | anyway, I'm done too | |
| 16:55:13 | bauzas | I'll change my stuff tomorrow morning | |
| 19:10:37 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : Enable an experimental job for testing mtty https://review.opendev.org/c/openstack/nova/+/922140 | |
| 19:10:38 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : mtty: add devstack compilation for fedora builds https://review.opendev.org/c/openstack/nova/+/918420 | |
| 22:43:29 | sean-k-mooney[m] | bauzas: frickler just an fyi i was able to stack on nobe fine by just installing the latest version of setuptool in the requiments and global venv | |
| 22:45:37 | sean-k-mooney[m] | if i get a chance tomorrow ill see if i can tweak devstack to make that work out of the box but i dont think we need to do anything speciall beyond that | |
| 22:47:43 | opendevreview | sean mooney proposed openstack/nova master: WIP : Enable an experimental job for testing mtty https://review.opendev.org/c/openstack/nova/+/922140 | |
| 22:51:39 | opendevreview | sean mooney proposed openstack/nova master: Revert "Always delete NVRAM files when deleting instances" https://review.opendev.org/c/openstack/nova/+/922354 | |
| #openstack-nova - 2024-06-20 | |||
| 06:44:57 | gboutry | Hello Nova, I've tried upgrading libvirt/qemu in a dev env, and I'm unable to live migrate anymore. | |
| 06:45:02 | gboutry | I'm getting "virDomainMigrateToURI3() failed" "unsupported configuration: Target CPU feature count 44 does not match source 109". | |
| 06:45:07 | gboutry | The 2 hosts are VMs created the same way, with one having 8 cores and the other one having 4 cores, but same CPU features. | |
| 06:45:16 | gboutry | This error does not appear with libvirt 8.0.0 / QEMU 6.2.0 (ubuntu 22.04 versions), but do appear with libvirt 10.0.0 / QEMU 8.2.1 (ubuntu 24.04 versions). | |
| 06:45:22 | gboutry | These are pretty big version jumps I know, do you have any insight on how to investigate this? | |
| 07:39:27 | opendevreview | Sahid Orentino Ferdjaoui proposed openstack/nova master: scheduler: fix _get_sharing_providers to support unlimited aggr https://review.opendev.org/c/openstack/nova/+/921665 | |
| 08:25:18 | opendevreview | ribaudr proposed openstack/nova master: Attach Manila shares via virtiofs (drivers and compute manager part) https://review.opendev.org/c/openstack/nova/+/833090 | |
| 08:25:19 | opendevreview | ribaudr proposed openstack/nova master: Mounting the shares as part of the initialization process https://review.opendev.org/c/openstack/nova/+/880075 | |
| 08:25:19 | opendevreview | ribaudr proposed openstack/nova master: Deletion of associated share mappings on instance deletion https://review.opendev.org/c/openstack/nova/+/881472 | |
| 08:25:20 | opendevreview | ribaudr proposed openstack/nova master: Add metadata for shares https://review.opendev.org/c/openstack/nova/+/850500 | |
| 08:25:20 | opendevreview | ribaudr proposed openstack/nova master: Add share_info parameter to reboot method for each driver (driver part) https://review.opendev.org/c/openstack/nova/+/854823 | |
| 08:25:21 | opendevreview | ribaudr proposed openstack/nova master: Support rebooting an instance with shares (compute manager part) https://review.opendev.org/c/openstack/nova/+/854824 | |
| 08:25:21 | opendevreview | ribaudr proposed openstack/nova master: Add share_info parameter to resume method for each driver (driver part) https://review.opendev.org/c/openstack/nova/+/860284 | |
| 08:25:22 | opendevreview | ribaudr proposed openstack/nova master: Support resuming an instance with shares (compute manager part) https://review.opendev.org/c/openstack/nova/+/860285 | |
| 08:25:22 | opendevreview | ribaudr proposed openstack/nova master: Add helper methods to rescue/unrescue shares https://review.opendev.org/c/openstack/nova/+/860286 | |
| 08:25:24 | opendevreview | ribaudr proposed openstack/nova master: Support rescuing an instance with shares https://review.opendev.org/c/openstack/nova/+/860287 | |
| 08:25:24 | opendevreview | ribaudr proposed openstack/nova master: Allow to mount manila share using Cephfs protocol https://review.opendev.org/c/openstack/nova/+/883862 | |
| 08:25:26 | opendevreview | ribaudr proposed openstack/nova master: Check shares support (compute manager) https://review.opendev.org/c/openstack/nova/+/885751 | |
| 08:25:26 | opendevreview | ribaudr proposed openstack/nova master: Attach Manila shares via virtiofs (API) https://review.opendev.org/c/openstack/nova/+/836830 | |
| 08:25:28 | opendevreview | ribaudr proposed openstack/nova master: Add helper methods to attach/detach shares https://review.opendev.org/c/openstack/nova/+/885753 | |
| 08:25:28 | opendevreview | ribaudr proposed openstack/nova master: Add instance.share_attach notification https://review.opendev.org/c/openstack/nova/+/850501 | |
| 08:25:30 | opendevreview | ribaudr proposed openstack/nova master: Add instance.share_detach notification https://review.opendev.org/c/openstack/nova/+/851028 | |
| 08:25:30 | opendevreview | ribaudr proposed openstack/nova master: Add shares to InstancePayload https://review.opendev.org/c/openstack/nova/+/851029 | |
| 08:25:32 | opendevreview | ribaudr proposed openstack/nova master: Add instance.share_attach_error notification https://review.opendev.org/c/openstack/nova/+/860282 | |
| 08:25:32 | opendevreview | ribaudr proposed openstack/nova master: Add instance.share_detach_error notification https://review.opendev.org/c/openstack/nova/+/860283 | |
| 08:25:34 | opendevreview | ribaudr proposed openstack/nova master: Add libvirt test to ensure metadata are working. https://review.opendev.org/c/openstack/nova/+/852086 | |
| 08:25:34 | opendevreview | ribaudr proposed openstack/nova master: Add virt/libvirt error test cases https://review.opendev.org/c/openstack/nova/+/852087 | |
| 08:25:36 | opendevreview | ribaudr proposed openstack/nova master: Docs about Manila shares API usage https://review.opendev.org/c/openstack/nova/+/871642 | |
| 08:43:08 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : Enable an experimental job for testing mtty https://review.opendev.org/c/openstack/nova/+/922140 | |
| 08:43:09 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : mtty: add devstack compilation for fedora builds https://review.opendev.org/c/openstack/nova/+/918420 | |
| 11:03:01 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : Enable an experimental job for testing mtty https://review.opendev.org/c/openstack/nova/+/922140 | |
| 11:03:02 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : mtty: add devstack compilation for fedora builds https://review.opendev.org/c/openstack/nova/+/918420 | |
| 13:59:42 | frickler | bauzas: did you see the "3 RLock(s) were not greened" messages e.g. at the start of https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_42a/922140/13/experimental/nova-mtty/42a251f/controller/logs/screen-n-super-cond.txt ? JayF mentioned something similar yesterday in the ironic channel, not sure if that may actually be relevant? | |
| 14:00:14 | frickler | seems to be related to running on py3.12 at least | |
| 14:04:18 | JayF | I asked my eventlet expert downstream about it. I haven't gotten any response yet. I suspect it maybe that the way they are detecting those locks are getting false positives. | |
| 14:25:40 | frickler | ack, otherwise one may want to insert more debugging output into that warning | |
| 14:48:48 | JayF | There isn't much more to give. Basically it's just inquiring from the garbage collector if it's tracking any rlock objects. It can't really reliably /do/ anything with those objects if detected. | |
| 14:49:16 | JayF | I printed the information on the objects, and nonsurprisingly, it wasn't useful. I suspect it might be possible to get deeper with a debugger + a lower level knowledge of python than I have at hand | |
| 16:28:48 | opendevreview | Rafael Weingartner proposed openstack/nova master: Block VM instance resize to flavor with different aggregates https://review.opendev.org/c/openstack/nova/+/922421 | |
| 16:51:47 | melwitt | frickler, JayF: I looked up that log message in eventlet and there's a code comment about how in python < 3.10 the warning won't be logged, so that at least explains why we start seeing it in newer python https://github.com/eventlet/eventlet/blob/ec6c0fffccc129bea468a5badb03034d83f8cc5e/eventlet/patcher.py#L406 | |
| 16:52:10 | JayF | melwitt: well, I think there's a behavior change in 3.12 | |
| 16:52:29 | JayF | melwitt: because chasing down + eliminating those warnings was part of getting eventlet happier when the changes started | |
| 16:53:11 | melwitt | yeah, the code comment explains the behavior change | |