| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2025-05-09 | |||
| 14:39:27 | opendevreview | Balazs Gibizer proposed openstack/nova master: Document threading mode and tuneables https://review.opendev.org/c/openstack/nova/+/949364 | |
| 14:39:27 | opendevreview | Balazs Gibizer proposed openstack/nova master: DNM:Run nova-next with n-sch in threading mode https://review.opendev.org/c/openstack/nova/+/948450 | |
| 17:20:43 | opendevreview | Merged openstack/nova stable/2025.1: Use dict object for request_specs_dict in the _list_view https://review.opendev.org/c/openstack/nova/+/948061 | |
| #openstack-nova - 2025-05-12 | |||
| 08:24:47 | mikal | sean-k-mooney: you around? I realised today that there hasn't yet been an os-traits release for the USB and sound compute traits. I can haz release plz? | |
| 11:01:33 | stephenfin | mikal: Sean will be around later today, alright. However, you can propose a release yourself if there isn't one already. You want the openstack/releases repo | |
| 11:02:08 | stephenfin | bauzas: gibi: In Sean's absence, have either of you any idea what the workaround is that they're talking about here? https://bugs.launchpad.net/ubuntu/+source/apparmor/+bug/2065685 | |
| 11:02:45 | stephenfin | I'm trying to bump the Ubuntu versions used for both Gophercloud and k8s cloud-provider-openstack and am running into that issue, e.g. https://github.com/gophercloud/gophercloud/actions/runs/14969772718/job/42047885458?pr=3374 | |
| 11:07:47 | gibi | stephenfin: https://bugs.launchpad.net/ubuntu/+source/apparmor/+bug/2065685/comments/9 I think this manual pathing what Sean refers to | |
| 11:08:46 | stephenfin | Do you know if we're doing that though? codesearch.o.o doesn't turn up any relevant hints (fwict) for the bug ID or the packages | |
| 11:09:50 | stephenfin | No worries if not. I was expecting to find something in our .zuul.yaml or the DevStack git log but no dice | |
| 11:10:04 | gibi | I dont know | |
| 11:10:39 | gibi | but I guess we have noble jobs so we should either see the issue or have some fix | |
| 11:11:03 | stephenfin | yeah, that was my expectation | |
| 11:11:22 | stephenfin | maybe it's done in the images. I'll ask on #openstack-infra | |
| 11:11:48 | gibi | sorry I haven't seen this issue before | |
| 11:11:52 | gibi | so I have no clue | |
| 11:15:24 | stephenfin | All good :+1: | |
| 13:33:08 | opendevreview | Konrad Gube proposed openstack/nova master: Use Cinder's os-extend_volume_completion volume action. https://review.opendev.org/c/openstack/nova/+/873560 | |
| 13:49:54 | opendevreview | Konrad Gube proposed openstack/nova-specs master: Re-propose using extend volume completion action for 2025.2 https://review.opendev.org/c/openstack/nova-specs/+/949504 | |
| 15:48:39 | opendevreview | Balazs Gibizer proposed openstack/nova master: Translate scatter-gather to futurist https://review.opendev.org/c/openstack/nova/+/947966 | |
| 15:48:40 | opendevreview | Balazs Gibizer proposed openstack/nova master: Replace utils.spawn_n with spawn https://review.opendev.org/c/openstack/nova/+/948076 | |
| 15:48:40 | opendevreview | Balazs Gibizer proposed openstack/nova master: Use futurist for _get_default_green_pool() https://review.opendev.org/c/openstack/nova/+/948072 | |
| 15:48:41 | opendevreview | Balazs Gibizer proposed openstack/nova master: Move ComputeManager to use spawn_on https://review.opendev.org/c/openstack/nova/+/948186 | |
| 15:48:41 | opendevreview | Balazs Gibizer proposed openstack/nova master: Add spawn_on https://review.opendev.org/c/openstack/nova/+/948079 | |
| 15:48:42 | opendevreview | Balazs Gibizer proposed openstack/nova master: Make nova.utils.pass_context private https://review.opendev.org/c/openstack/nova/+/948188 | |
| 15:48:42 | opendevreview | Balazs Gibizer proposed openstack/nova master: Move ConductorManager to use spawn_on https://review.opendev.org/c/openstack/nova/+/948187 | |
| 15:48:43 | opendevreview | Balazs Gibizer proposed openstack/nova master: Make the default executor configurable https://review.opendev.org/c/openstack/nova/+/948087 | |
| 15:48:43 | opendevreview | Balazs Gibizer proposed openstack/nova master: Rename DEFAULT_GREEN_POOL to DEFAULT_EXECUTOR https://review.opendev.org/c/openstack/nova/+/948086 | |
| 15:48:45 | opendevreview | Balazs Gibizer proposed openstack/nova master: Document threading mode and tuneables https://review.opendev.org/c/openstack/nova/+/949364 | |
| 15:48:45 | opendevreview | Balazs Gibizer proposed openstack/nova master: Print ThreadPool statistics https://review.opendev.org/c/openstack/nova/+/948340 | |
| 15:48:47 | opendevreview | Balazs Gibizer proposed openstack/nova master: DNM:Run nova-next with n-sch in threading mode https://review.opendev.org/c/openstack/nova/+/948450 | |
| 15:48:47 | opendevreview | Balazs Gibizer proposed openstack/nova master: WIP: allow service to start with threading https://review.opendev.org/c/openstack/nova/+/948311 | |
| 16:45:22 | opendevreview | Balazs Gibizer proposed openstack/nova master: Print ThreadPool statistics https://review.opendev.org/c/openstack/nova/+/948340 | |
| 16:45:23 | opendevreview | Balazs Gibizer proposed openstack/nova master: WIP: allow service to start with threading https://review.opendev.org/c/openstack/nova/+/948311 | |
| 16:45:23 | opendevreview | Balazs Gibizer proposed openstack/nova master: Document threading mode and tuneables https://review.opendev.org/c/openstack/nova/+/949364 | |
| 16:45:24 | opendevreview | Balazs Gibizer proposed openstack/nova master: DNM:Run nova-next with n-sch in threading mode https://review.opendev.org/c/openstack/nova/+/948450 | |
| 18:23:18 | opendevreview | Alan Bishop proposed openstack/nova-specs master: Show swap_progress in attachment details https://review.opendev.org/c/openstack/nova-specs/+/937485 | |
| 20:50:35 | mikal | stephenfin: it is not entirely clear to me from the documentation what the correct release command line for os-traits is given it is release independent. While I am happy to do the thing, are there any docs for this soemwhere? | |
| #openstack-nova - 2025-05-13 | |||
| 07:17:31 | gokhan | seems it is about sriov. I want to be sure this is expected behaviour.these are the gpu information on my system > https://paste.openstack.org/show/bpDV7Ie9xshYowaWgAOK/ The other issue is I can only create gpus with l40s-1a:2a, l40s-1q:2q and l40s-1b:2b but can not create l40s-12q. what can be reason for this problem ? can you help please? | |
| 07:17:31 | gokhan | hello folks, I am trying to enable gpu virtualization on nova. I am trying to test on nvidia l40s gpu card. My os is ubuntu 22.04. I have only one gpu. I installed nvidia vgpu manager 18.1 on ubuntu and then running "ls /sys/class/mdev_bus/*/mdev_supported_types" command returned no such file. then I run "/usr/lib/nvidia/sriov-manage -e all" command and new pcis are created. "lspci -nn | grep -i nvidia" command returned newly created 32 gpus. it | |
| 09:15:45 | opendevreview | Sylvain Bauza proposed openstack/nova master: [doc] Adding vGPUs max_instances caveat fix for virtual-gpu https://review.opendev.org/c/openstack/nova/+/949579 | |
| 09:16:33 | bauzas | sean-k-mooney: gibi: we forgot to add upstram docs for the SRIOV GPU capping fix, could you please quickly review https://review.opendev.org/c/openstack/nova/+/949579 ? | |
| 10:34:57 | sean-k-mooney | oh by capping fix you mena the max_instanaces config option sure | |
| 10:36:21 | pas-ha[m] | Consult your card docs for what is possible with it, what profiles in which mode (single vGPU vs heterogeneous vGPU) and in which quantity are possible with it. | |
| 10:36:21 | pas-ha[m] | devices left where you did not create any mdevs. | |
| 10:36:21 | pas-ha[m] | gokhan: the NVIDIA drivers generally create more PCI devices than the actual max possible number of vGPUs they can be split to (even for the smallest size). You can use mdevctl or sysfs interface to check the actual 'available instances' on each mdev type on each PCI dev. After you created those mdev you can - check again, you will see that now everything would be 0, you've reached max capacity for your card, even if there are PCI | |
| 10:37:09 | sean-k-mooney | we didnt entirly forget we added the help text as part of the config option but ya the improvment looks reasonable | |
| 10:39:49 | sean-k-mooney | pas-ha[m]: ritght it basically create enouch VF for the smallest vgpu type it can support | |
| 10:40:23 | sean-k-mooney | wich i get why they do that but its also not a great ux | |
| 10:45:25 | hertrste | Hi. I would like to ask to get some further feedback on https://review.opendev.org/c/openstack/nova-specs/+/945549. Tank you! | |
| 10:52:31 | gokhan | pas-ha[m], yes it is correct. L40S created 32 vf. I select nvidia-1153 as l40s-12q and nova/placement created 4 resource providers beacuse max instances are 4 in l40s-12. If I change from l40s-12q to l40s-1q, nova/placement creates 32 new resource providers. It maps every pci slot to one vm. It seem it is working as expected. | |
| 10:53:10 | gokhan | https://paste.openstack.org/show/bdL9DHdT9pnIbGEFrbEO/ | |
| 10:54:49 | gokhan | but sometimes when I try to change types, nova is deleting previous resource providers and not create new ones | |
| 10:58:51 | gokhan | pas-ha[m], host vgpu mode is SR-IOV https://paste.openstack.org/show/bg5WeH9FWvpWhenTJA70/ | |
| 11:00:03 | gokhan | I wonder can we create different vgpu types per VFs? | |
| 11:00:07 | pas-ha[m] | gokhan: the problem is that very rarely you can really create that many resources, which leads to overreporting in placement. Nova does not know that of those 32 resource providers that each can handle 1 vgpu resource, only say 12 can really be occupied (because you set Nova to create that vgpu type that can fit only 12), mdev initially still reports that every of those 32 pci devs can hold 1 vgpu of your type... for that recent nova | |
| 11:00:08 | pas-ha[m] | https://docs.nvidia.com/vgpu/17.0/grid-vgpu-user-guide/index.html#virtual-gpu-types-grid-reference - here is a comprehensive list of all the vgpu types _and their combinations_ (for the heterogeneous vGPU mode which your card supports, and which I guess is enabled when you put the card into the SR-IOV mode). | |
| 11:00:08 | pas-ha[m] | versions have 'max instances' option in the [mdev_...] section, to limit the amount of resource providers created. | |
| 11:03:06 | pas-ha[m] | again, check mdevctl types, it will show you 'available instances' for each mdev type on each PCI device - and mind that this number will change (everywhere, on all the PCI VFs) as you create new mdevs. | |
| 11:05:03 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Stop using wsgi.Controller.api_version to switch between API versions https://review.opendev.org/c/openstack/nova/+/936366 | |
| 11:05:03 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Adjust validation helpers for a single-method future https://review.opendev.org/c/openstack/nova/+/936365 | |
| 11:05:04 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add new, simpler api_version decorator https://review.opendev.org/c/openstack/nova/+/936367 | |
| 11:05:04 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Only check minimum API version https://review.opendev.org/c/openstack/nova/+/940325 | |
| 11:05:05 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Simplify parameter types https://review.opendev.org/c/openstack/nova/+/936369 | |
| 11:05:05 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Only run format checks on strings https://review.opendev.org/c/openstack/nova/+/936368 | |
| 11:05:06 | opendevreview | Stephen Finucane proposed openstack/nova master: tests: Ensure all APIs have a response body schema https://review.opendev.org/c/openstack/nova/+/924598 | |
| 11:05:07 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add response body schemas for hosts APIs https://review.opendev.org/c/openstack/nova/+/937047 | |
| 11:05:07 | opendevreview | Stephen Finucane proposed openstack/nova master: doc: Add missing API samples https://review.opendev.org/c/openstack/nova/+/937012 | |
| 11:05:09 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add response body schemas for hypervisors APIs (1/3) https://review.opendev.org/c/openstack/nova/+/937245 | |
| 11:05:09 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add response body schemas for instance actions https://review.opendev.org/c/openstack/nova/+/937048 | |
| 11:05:11 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add response body schemas for hypervisors APIs (3/3) https://review.opendev.org/c/openstack/nova/+/937247 | |
| 11:05:11 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add response body schemas for hypervisors APIs (2/3) https://review.opendev.org/c/openstack/nova/+/937246 | |
| 11:05:13 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add response body schemas for remote consoles https://review.opendev.org/c/openstack/nova/+/940114 | |
| 11:05:13 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add response body schemas for server IPs APIs https://review.opendev.org/c/openstack/nova/+/937608 | |
| 11:05:15 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add response body schemas for image metadata APIs https://review.opendev.org/c/openstack/nova/+/940299 | |
| 11:05:15 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add response body schemas for keypairs APIs https://review.opendev.org/c/openstack/nova/+/940115 | |
| 11:05:17 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add response body schemas for server diagnostics API https://review.opendev.org/c/openstack/nova/+/940506 | |
| 11:05:17 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add response body schemas for server topology API https://review.opendev.org/c/openstack/nova/+/940300 | |
| 11:05:19 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add response body schemas for server password APIs https://review.opendev.org/c/openstack/nova/+/945736 | |
| 11:05:19 | opendevreview | Stephen Finucane proposed openstack/nova master: api: Add response body schemas for server external events API https://review.opendev.org/c/openstack/nova/+/940508 | |
| 11:12:12 | gokhan | thanks for great explanation pas-ha[m] I got it :) | |
| 11:52:39 | opendevreview | Stephen Finucane proposed openstack/nova stable/2024.1: add pyproject.toml to support pip 23.1 https://review.opendev.org/c/openstack/nova/+/949617 | |
| 12:07:33 | gibi | bauzas: is it just me or nova-next is failing with mdev stuff https://zuul.opendev.org/t/openstack/builds?job_name=nova-next&skip=0 | |
| 12:07:54 | gibi | 3237 Async compile_mdev_samples:45784]: finished compile_mdev_samples with result 1 in 37 seconds | |
| 12:08:40 | gibi | https://zuul.opendev.org/t/openstack/build/b8c32faa528e4bddbfb027f43f1f184c/log/job-output.txt#21834 | |
| 12:08:58 | sean-k-mooney | gibi: perhaps ocationally but it seam sto be passign for the most part unless it just started today? | |
| 12:10:47 | gibi | filed bug https://bugs.launchpad.net/nova/+bug/2110545 | |
| 12:10:54 | gibi | it started today | |
| 12:11:30 | sean-k-mooney | https://zuul.opendev.org/t/openstack/build/f28f307aa79646f6a9a54965ae3592e6/log/controller/logs/devstacklog.txt#19105 | |
| 12:11:46 | sean-k-mooney | so it looks like the kernel we downloaded is gettign a 404 | |
| 12:12:18 | gibi | yeah it seems | |
| 12:12:45 | sean-k-mooney | we may need to check how we are selectign that package | |
| 12:12:54 | sean-k-mooney | this is either an infra issue where the package should be avioable | |
| 12:13:10 | sean-k-mooney | or perhaps we hard coded it instead fo gettign the one for the currently installed kernel | |
| 12:13:42 | sean-k-mooney | https://github.com/openstack/nova/blob/master/devstack/lib/mdev_samples#L40 | |
| 12:13:58 | sean-k-mooney | sorry https://github.com/openstack/nova/blob/master/devstack/lib/mdev_samples#L30-L32 | |
| 12:14:28 | sean-k-mooney | or perhaps https://github.com/openstack/nova/blob/master/devstack/lib/mdev_samples#L36 is what actully failing | |
| 12:14:42 | sean-k-mooney | in any case we are using uname to get the runnign kernel | |
| 12:15:04 | sean-k-mooney | so this is proably an issue with our mirros or an issue with the ubuntu repos | |
| 12:15:41 | sean-k-mooney | we could temproally disabele the compile and reenable it in bauzas's serise where he is actully usign the compiled module | |