| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2025-07-15 | |||
| 16:36:16 | gibi | awesome | |
| 16:36:17 | dansmith | I also have outstanding glance pings | |
| 16:36:31 | dansmith | so, I don't want to over-promise :) | |
| 16:36:37 | gibi | no worries :) | |
| 16:36:46 | bauzas | excellent thanks | |
| 16:36:50 | gibi | I have no other news | |
| 16:37:21 | bauzas | #topic Open discussion | |
| 16:37:25 | bauzas | (crickets) | |
| 16:37:30 | bauzas | anything anyone ? | |
| 16:38:06 | gibi | - | |
| 16:38:09 | bauzas | cool | |
| 16:38:31 | bauzas | I'll be honest, I don't have the same energy than Uggla about skimming the long list of untriaged bugs | |
| 16:38:40 | bauzas | but I can give the baton to any volunteer | |
| 16:39:13 | bauzas | thanks all then :) | |
| 16:39:20 | bauzas | see you next week | |
| 16:39:21 | gibi | thanks folks | |
| 16:39:22 | bauzas | #endmeeting | |
| 16:39:22 | opendevmeet | Meeting ended Tue Jul 15 16:39:22 2025 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | |
| 16:39:22 | opendevmeet | Minutes: https://meetings.opendev.org/meetings/nova/2025/nova.2025-07-15-16.00.html | |
| 16:39:22 | opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/nova/2025/nova.2025-07-15-16.00.txt | |
| 16:39:22 | opendevmeet | Log: https://meetings.opendev.org/meetings/nova/2025/nova.2025-07-15-16.00.log.html | |
| 16:39:26 | fwiesel | Thanks, everyone | |
| 16:39:27 | elodilles | thanks o/ | |
| 16:39:33 | gmaan | thanks | |
| 16:41:17 | ratailor_ | thanks | |
| 17:34:07 | opendevreview | Dan Smith proposed openstack/nova master: Remove eventlet timer from multi_cell_list https://review.opendev.org/c/openstack/nova/+/954990 | |
| 17:34:08 | opendevreview | Dan Smith proposed openstack/nova master: WIP: Parallelize s-g generators https://review.opendev.org/c/openstack/nova/+/955091 | |
| 18:56:04 | opendevreview | Brett Holman proposed openstack/nova master: Add DMI data to non-x86 architectures https://review.opendev.org/c/openstack/nova/+/953989 | |
| 20:38:33 | sean-k-mooney | do we have a critiria for what can and cant go in nova-contrib? | |
| 20:40:34 | sean-k-mooney | now that it exists im wondering if it makes sense to port https://opendev.org/x/nfv-filters/src/branch/master/nfv_filters/nova/scheduler/filters/aggregate_instance_type_filter.py | |
| 20:41:52 | sean-k-mooney | i suspect that may not quite work any more due to the removal of log translation and six | |
| 20:42:46 | sean-k-mooney | but im wondering if we are ok with out of tree filters/weigher in nova-contrib in general | |
| 20:43:29 | sean-k-mooney | nova-contibe is not actully a valid python package | |
| 20:43:58 | sean-k-mooney | which is why im wondering how it can be used/extended over time | |
| 20:47:01 | sean-k-mooney | maybe a topic for the ptg? alhtough we likely shoudl at a minium add a licene file before the end of the release and likely a readme too even if its short | |
| 21:08:35 | dansmith | yeah, discuss next ptg.. I don't really want it to grow to a python package with all the release requirements (if we can help it) | |
| 21:09:10 | dansmith | and, I'd say I'm not sure if I want to encourage (via setting an example) out of tree drivers for interfaces that aren't really very strong, even though we all acknowledge that filter/weighers are pretty common | |
| 21:09:22 | dansmith | so not opposed, but think it might be good to set some ground rules | |
| 21:41:09 | opendevreview | Brett Holman proposed openstack/nova master: Add DMI data to non-x86 architectures https://review.opendev.org/c/openstack/nova/+/953989 | |
| #openstack-nova - 2025-07-16 | |||
| 01:18:10 | gmaan | finally this is merged, ceph job should be green now https://review.opendev.org/c/openstack/tempest/+/954949 | |
| 01:18:13 | gmaan | gibi: ^^ | |
| 07:32:27 | gibi | gmaan: thanks! | |
| 07:34:16 | gibi | gmaan: https://review.opendev.org/c/openstack/nova/+/954956 this now proves the the original problem is the ceph version 19.2.1 with pinned back packages to 19.2.0 the tempest test still passes. I'm in the process to find a way to report the bug to ceph upstream... | |
| 10:38:43 | sean-k-mooney | gibi: as a workaround shoudl we just move the affected jobs to debian like the nova-hybrid-plug job | |
| 10:38:56 | sean-k-mooney | i can push up a patch to just update the node set and see if that passes | |
| 10:39:38 | sean-k-mooney | we can alwasy swap back later if we want or keep the ceph jobs on debian. we have had no real issues with the hybrid plug job since we swapped | |
| 10:40:18 | sean-k-mooney | we are installing ceph via cephadm using containers fo the ceph version wont change it would just be the qemu and librbd/rados version that change | |
| 10:40:50 | sean-k-mooney | since that the only part that actully comes form the distro packages in the devstack job | |
| 10:41:15 | sean-k-mooney | assuming that works we coudl avoid skipping the testing | |
| 10:41:43 | sean-k-mooney | oh https://review.opendev.org/c/openstack/tempest/+/954949 merged... | |
| 10:42:07 | sean-k-mooney | well i guess i can propose a revert and depend on and test that as well | |
| 10:57:52 | opendevreview | sean mooney proposed openstack/nova master: move ceph jobs to debian to avoid bug 2116852 https://review.opendev.org/c/openstack/nova/+/955179 | |
| 10:58:23 | sean-k-mooney | so something like ^ | |
| 10:59:27 | sean-k-mooney | we can see if that passes and decied if we want to keep it disabled or just do that. we could also consdier doign the debian swap in the parent devstack jobs so it fixes it for everyone | |
| 10:59:51 | sean-k-mooney | so devstack-plugin-ceph-tempest-py3 and devstack-plugin-ceph-multinode-tempest-py3 | |
| 11:00:47 | sean-k-mooney | which are defiend in https://github.com/openstack/devstack-plugin-ceph/blob/master/.zuul.yaml | |
| 11:29:05 | gibi | I've added the Ceph project on https://bugs.launchpad.net/nova/+bug/2116852 to let ubuntu see the issue | |
| 12:09:14 | opendevreview | Merged openstack/nova master: Move ComputeManager to use spawn_on https://review.opendev.org/c/openstack/nova/+/948186 | |
| 13:45:03 | noonedeadpunk | hey folks! am I right that there is no way so far to supply any arbitrary arguments to as migration_flags ? | |
| 13:48:37 | noonedeadpunk | specifically thinking about VIR_MIGRATE_PARALLEL and VIR_MIGRATE_PARAM_PARALLEL_CONNECTIONS now | |
| 14:08:02 | sean-k-mooney | noonedeadpunk: be design no not really. that an internal interface of nova's libvirt driver | |
| 14:08:26 | sean-k-mooney | we add flag when we supprot new features in our config. | |
| 14:08:50 | sean-k-mooney | unofficlly you very ocationlly can enable some thing via the migration uri via query args | |
| 14:10:30 | sean-k-mooney | we woudl need to actully add supprot for that in nova properly if we were to supprot it | |
| 14:15:59 | noonedeadpunk | yeah, I was planning to look into adding this thing to nova, but also wondering about how to workaround current failures of migration | |
| 14:16:17 | noonedeadpunk | As it seems to ways so far is either to disable tls, or increase throughput | |
| 14:24:01 | noonedeadpunk | do you think I'd be needing to submit a full-fledged spec for that? | |
| 14:26:56 | dansmith | for which? always-on migration flags, config knob to enable one, or something like generic flag merging support? | |
| 14:27:23 | dansmith | in either of those cases we probably want to document the need, risk, config behavior, etc | |
| 14:30:54 | gibi | eventlet sync https://meet.google.com/bcy-uqoz-hje | |
| 14:32:40 | noonedeadpunk | dansmith: config knob I believe. to enable/disable parallel and amount of forks | |
| 14:32:56 | noonedeadpunk | ok, I guess I'll come up with smth relatively simple | |
| 14:46:09 | dansmith | noonedeadpunk: I think a spec for that yeah | |
| 15:19:12 | noonedeadpunk | sean-k-mooney: do you recall the issue I was coming with for live migration failures a month ago or so? | |
| 15:19:46 | noonedeadpunk | as I was able to reproduce it on plain libvirt+qemu on ubuntu | |
| 15:20:02 | noonedeadpunk | and pretty much it's kinda a single usecase which is failing.... | |
| 15:20:27 | noonedeadpunk | virsh migrate --live --auto-converge --persistent --copy-storage-all --tls instance-00016a41 qemu+tls://compute10/system | |
| 15:20:56 | noonedeadpunk | if I: drop tls, add parallel or use compress - migration passes. | |
| 15:21:37 | noonedeadpunk | but this also is really confusing... how in the world uwing qemu+tls without --tls does not actually use tls... | |
| 15:22:07 | sean-k-mooney | noonedeadpunk: reading back and yes vagly | |
| 15:23:24 | sean-k-mooney | spec vs specless blueprint in this context partly comes down to the upgrade impact, the other factor being what version fo libvirt/qemu supprot it ectra | |
| 15:23:28 | noonedeadpunk | but anyway, wanted to confirm it has nothing to do with nova. But I'm very surprised nobody else was reporting or coming with that | |
| 15:23:39 | sean-k-mooney | we do allow new config option that default to the old bevhioar without a spec | |
| 15:23:50 | noonedeadpunk | intention was to keep the behavior for sure | |
| 15:24:00 | sean-k-mooney | btu if it impact upgrades in a mixed comptue node version case it almost alwasy needs a spec | |
| 15:25:00 | sean-k-mooney | noonedeadpunk: but if i recall correctly you were seeing qemu crashes right | |
| 15:25:46 | noonedeadpunk | I was thinking to add an option for instance live_migration_parallel_connections with default of 1, and when it's >1 add https://libvirt.org/html/libvirt-libvirt-domain.html#VIR_MIGRATE_PARAM_PARALLEL_CONNECTIONS and libvirt.VIR_MIGRATE_PARALLEL | |
| 15:25:53 | noonedeadpunk | sean-k-mooney: I do | |
| 15:26:19 | noonedeadpunk | also thinking to report a bug to qemu, and gather some debug logs now | |
| 15:26:34 | sean-k-mooney | so i dont actlly have a problem with a config option that set hte number of parralel connection and use that to enable this | |
| 15:27:10 | sean-k-mooney | but beyond that we woudl need to make sure the version of libvirt supprot that | |
| 15:27:19 | sean-k-mooney | and qemu | |
| 15:27:24 | sean-k-mooney | both on the source and dest host | |
| 15:27:39 | sean-k-mooney | and we may or may not want ot schdluer on it. | |
| 15:27:48 | noonedeadpunk | any gotchas on how to trace that back? | |
| 15:28:31 | sean-k-mooney | you have replicated this with that virsh migrate command yes | |
| 15:28:54 | sean-k-mooney | if you have ideally without openstack at all i think we shoudl file a libvirt but for that | |
| 15:29:08 | noonedeadpunk | yeah, it's without openstack at all | |
| 15:29:10 | noonedeadpunk | or well | |
| 15:29:28 | dansmith | I think a spec to explain how this works and what the considerations are is important.. like, does this have a dependency on the remote version? do we want to schedule for the feature? if not, why not? | |