| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2024-01-19 | |||
| 17:50:22 | bauzas | _colby: the main concern is how to correctly express the request and my personal take is that in general VGPU flavors only ask for VGPUs | |
| 17:51:09 | bauzas | _colby: do you confirm that you're not interested in mixing vgpu resources and other resources like pci passthrough devices in the same flavor ? | |
| 17:56:18 | spatel | sean-k-mooney good to know :) thanks | |
| 17:58:52 | _colby | bauzas: we have a hypervisor that is strictly for passthrough and some that use vGPU. On the vGPU host we offer a vGPU option with 100% of the GPU though. | |
| 17:59:45 | _colby | Is it even possible to do passthrough with vgpu? With passthrough the nvidia drivers on the hypervisor need to be disabled | |
| 18:00:04 | sean-k-mooney | _colby: not passthogu of a vgpu | |
| 18:00:16 | bauzas | _colby: and you wouldn't be interested in requesting qos-bandwidth ports or cyborg ? | |
| 18:00:18 | _colby | ah I see | |
| 18:00:23 | sean-k-mooney | we mean booting a vm with a sriov nic + a vgpu | |
| 18:00:26 | _colby | not on our system no | |
| 18:00:54 | bauzas | _colby: the context is that I'm documenting some usage | |
| 18:01:04 | bauzas | https://review.opendev.org/c/openstack/nova/+/906151/1/doc/source/admin/virtual-gpu.rst#136 | |
| 18:01:35 | bauzas | if you start using some extra spec parameter called 'group_policy', you may not be able to request other things | |
| 18:01:51 | bauzas | but you can continue to request for a single vGPU *and* other things tho | |
| 18:02:30 | bauzas | the alternative is to do a lot of configuration by privoding distinct traits https://review.opendev.org/c/openstack/nova/+/906151/1/doc/source/admin/virtual-gpu.rst#158 | |
| 18:02:42 | bauzas | but that sounds nearly impracticable for ops to me | |
| 18:05:01 | _colby | bauzas: interesting. Our use case this should be fin. We have not actually had many requests for multiple vgpus, and we dont offer any special NIC options at this time. | |
| 18:05:43 | _colby | We have HPC systems for uses who need things like that. This is more for research groups to use for their projects. | |
| 18:06:11 | opendevreview | Sylvain Bauza proposed openstack/nova master: Support multiple allocations for vGPUs https://review.opendev.org/c/openstack/nova/+/845757 | |
| 18:06:11 | opendevreview | Sylvain Bauza proposed openstack/nova master: document how to ask for more a single vGPU https://review.opendev.org/c/openstack/nova/+/906151 | |
| 18:06:18 | bauzas | sean-k-mooney: added the relnote ^ | |
| 18:06:34 | bauzas | sean-k-mooney: _colby also provided some insights about their VGPU usages | |
| 18:08:26 | bauzas | _colby: thanks for your valuable feedback | |
| 18:08:45 | bauzas | _colby: fwiw, we have a couple of improvments in flight this cycle and you may be interested in getting those | |
| 18:09:22 | sean-k-mooney | yep i saw | |
| 18:09:47 | bauzas | https://review.opendev.org/q/topic:%22bug/2041519%22+AND+(is:open+OR+is:merged) | |
| 18:09:47 | sean-k-mooney | _colby even with the patch that bauzas is providing to fix this current bug i would really treat multipel vgpus as experimental | |
| 18:10:29 | bauzas | _colby: the above link would give you the SRIOV fix | |
| 18:10:43 | bauzas | sean-k-mooney: I'm cool with documenting that | |
| 18:10:56 | sean-k-mooney | bauzas: have you tested the move operatios with multipel vgpus. like cold migrate and or your future live migration supprot | |
| 18:11:01 | bauzas | (the fact that's more an unsupported feature than a real thing) | |
| 18:11:26 | bauzas | sean-k-mooney: no tbc | |
| 18:11:50 | bauzas | although I don't see any reason why it wouldn't work | |
| 18:11:59 | sean-k-mooney | i woudl certenly feel more comfortabel saying "multiple vgpus in the same vm is experimatal, please report bugs" | |
| 18:12:21 | bauzas | sean-k-mooney: that's why I'm offering to drop the doc | |
| 18:12:31 | bauzas | the relnote seems enough to me | |
| 18:12:44 | bauzas | if people want to use it, cool | |
| 18:13:09 | sean-k-mooney | lets discuss that next week. you shoudl go start your weekend | |
| 18:13:26 | bauzas | the patches are all ready now | |
| 18:13:36 | bauzas | let's see what CI is saying | |
| 18:13:56 | bauzas | btw. it occured to me that our jobs become again flakey on weird things | |
| 18:20:10 | sean-k-mooney | ya a little | |
| 18:20:14 | sean-k-mooney | any thing in particalr | |
| 18:20:23 | sean-k-mooney | i have seen some nova-lvm failures | |
| 21:11:58 | opendevreview | Jay Faulkner proposed openstack/nova stable/2023.2: [ironic] Partition & use cache for list_instance* https://review.opendev.org/c/openstack/nova/+/906155 | |
| #openstack-nova - 2024-01-20 | |||
| 03:22:04 | opendevreview | Takashi Kajinami proposed openstack/nova master: libvirt: Fail when file-backed memory is used with reservation https://review.opendev.org/c/openstack/nova/+/906161 | |
| 07:14:31 | opendevreview | Takashi Kajinami proposed openstack/nova master: libvirt: Fail when file-backed memory is used with reservation https://review.opendev.org/c/openstack/nova/+/906161 | |
| #openstack-nova - 2024-01-21 | |||
| 01:22:07 | opendevreview | sean mooney proposed openstack/nova-specs master: enable nova to dynamically partion cpus https://review.opendev.org/c/openstack/nova-specs/+/906205 | |
| #openstack-nova - 2024-01-22 | |||
| 06:34:24 | songwenping | -----------------++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ | |
| 09:57:53 | opendevreview | Sylvain Bauza proposed openstack/nova master: document how to ask for more a single vGPU https://review.opendev.org/c/openstack/nova/+/906151 | |
| 10:14:21 | songwenping_ | hi, team, any body can help to look at the problem about the tempest failed:https://zuul.opendev.org/t/openstack/build/5ea2c69c3b0c4a4d882944be580ba27f | |
| 10:25:04 | bauzas | songwenping_: something is wrong with the cyborg tempest plugin | |
| 10:25:06 | bauzas | 2024-01-22 09:51:08.246168 | controller | ++ /opt/stack/cyborg/devstack/plugin.sh:source:8 : source /opt/stack/cyborg/devstack/lib/cyborg 2024-01-22 09:51:08.248710 | controller | /opt/stack/cyborg/devstack/lib/cyborg: line 293: syntax error: unexpected end of file | |
| 10:25:27 | bauzas | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_5ea/906246/1/check/cyborg-tempest/5ea2c69/job-output.txt | |
| 10:26:25 | bauzas | that's seen again in the devstack install logs : | |
| 10:26:27 | bauzas | 2024-01-22 09:51:08.231 | + functions-common:run_plugins:1820 : local dir=/opt/stack/cyborg 2024-01-22 09:51:08.233 | + functions-common:run_plugins:1821 : [[ -f /opt/stack/cyborg/devstack/plugin.sh ]] 2024-01-22 09:51:08.236 | + functions-common:run_plugins:1822 : source /opt/stack/cyborg/devstack/plugin.sh stack pre-install 2024-01-22 09:51:08.239 | ++ /opt/stack/cyborg/devstack/plugin.sh:source:7 : | |
| 10:26:29 | bauzas | echo_summary 'cyborg devstack plugin.sh called: stack/pre-install' 2024-01-22 09:51:08.241 | ++ ./stack.sh:echo_summary:468 : [[ -t 3 ]] 2024-01-22 09:51:08.243 | ++ ./stack.sh:echo_summary:474 : echo -e cyborg devstack plugin.sh called: stack/pre-install 2024-01-22 09:51:08.246 | ++ /opt/stack/cyborg/devstack/plugin.sh:source:8 : source /opt/stack/cyborg/devstack/lib/cyborg 2024-01-22 09:51:08.2 | |
| 10:26:31 | bauzas | 48 | /opt/stack/cyborg/devstack/lib/cyborg: line 293: syntax error: unexpected end of file 2024-01-22 09:51:08.250 | ++++ /opt/stack/cyborg/devstack/lib/cyborg:source:1 : exit_trap | |
| 10:26:33 | bauzas | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_5ea/906246/1/check/cyborg-tempest/5ea2c69/controller/logs/devstacklog.txt | |
| 10:33:19 | songwenping_ | thanks bauzas, i will check my commit. | |
| 12:11:36 | tkajinam | looks like Pirrow was bumped to 10.x.x and this killed doc job | |
| 12:11:52 | tkajinam | 'ImageDraw' object has no attribute 'textsize' | |
| 12:16:31 | tkajinam | https://pillow.readthedocs.io/en/stable/releasenotes/10.0.0.html#font-size-and-offset-methods | |
| 12:29:57 | tkajinam | https://github.com/blockdiag/blockdiag/issues/176 | |
| 12:30:09 | tkajinam | https://github.com/blockdiag/blockdiag/issues/177 | |
| 12:53:50 | frickler | tkajinam: oh, that. I remember people started to replace their blockdiags with other types of drawings. I guess we'll have to revert that bump once again for now | |
| 12:54:02 | opendevreview | Takashi Kajinami proposed openstack/nova master: DNM: Checking doc job https://review.opendev.org/c/openstack/nova/+/906265 | |
| 12:54:03 | opendevreview | Takashi Kajinami proposed openstack/nova master: DNM: Checking doc job with fixed u-c https://review.opendev.org/c/openstack/nova/+/906266 | |
| 12:54:20 | tkajinam | frickler, yeah | |
| 12:54:39 | tkajinam | frickler, I hope https://review.opendev.org/c/openstack/requirements/+/906262 is enough. testing in the above patches | |
| 12:54:59 | tkajinam | probably I can try it in my local. one sec | |
| 12:55:17 | opendevreview | sean mooney proposed openstack/nova master: add initial healthcheck support https://review.opendev.org/c/openstack/nova/+/825015 | |
| 12:56:35 | frickler | see also https://review.opendev.org/c/openstack/requirements/+/897537 , seems we need to go on with that for some cycles. also I though we did have some doc cross jobs in reqs that tests that, hmm | |
| 12:58:39 | tkajinam | ah, ok. so this is not the first time we hit this | |
| 12:59:15 | opendevreview | sean mooney proposed openstack/nova master: add healthcheck manager to manager base https://review.opendev.org/c/openstack/nova/+/827844 | |
| 12:59:15 | opendevreview | sean mooney proposed openstack/nova master: add healthcheck tracker to nova context https://review.opendev.org/c/openstack/nova/+/829468 | |
| 12:59:16 | opendevreview | sean mooney proposed openstack/nova master: add healthcheck utils and constants https://review.opendev.org/c/openstack/nova/+/829469 | |
| 12:59:16 | opendevreview | sean mooney proposed openstack/nova master: add healthcheck endpoint to proxy commands https://review.opendev.org/c/openstack/nova/+/830703 | |
| 13:00:18 | tkajinam | frickler, I tested that requirement change and confirmed doc build now succeeds | |
| 13:00:20 | tkajinam | just fyi | |
| 13:00:45 | tkajinam | (I was concerned about potential conflicts with the other bumps but seems a simple and single downgrade works. nice | |
| 13:02:11 | frickler | tkajinam: yes, once I saw your comment I remembered that we had that thing before. thx for confirming it works, already approved 906262 | |
| 13:02:27 | tkajinam | frickler, thank you, too | |
| 13:49:40 | frickler | nova ppl please also check https://bugs.launchpad.net/ironic/+bug/2026345 related to the above | |
| 13:55:02 | bauzas | frickler: lookign | |
| 13:55:54 | bauzas | frickler: fwiw, now I've upgraded to F39 which defaults to py312, I need to target my docs and relnotes tox runs by capping them with py39 or py310 | |
| 13:56:04 | bauzas | and I saw some problem with Pillow due to some dependency | |
| 13:59:45 | frickler | sounds like we should add some py312 testing into requirements and elsewhere soon. I'm just not sure yet which distro to use for that. maybe I should start looking at some noble stuff, that would likely make sense for devstack, too | |
| 14:12:07 | bauzas | frickler: lemme know when we need to merge the new reqs patch in Nova (but I think we don't need it ) | |
| 14:13:14 | bauzas | yeah, Pillow is neither in reqs.txt or in test-reqs.txt | |
| 14:13:42 | opendevreview | Marius Leustean proposed openstack/nova master: Faults from cell DB missing in GET /servers/detail https://review.opendev.org/c/openstack/nova/+/699176 | |
| 14:34:12 | bauzas | sean-k-mooney: fwiw, I reworded entirely the doc patch for the multi-vgpu-per_instance bugfix https://review.opendev.org/c/openstack/nova/+/906151/2 | |
| 14:34:34 | frickler | bauzas: that's not the point, stopping to use blockdiag seems to be what is needed | |
| 14:35:07 | bauzas | sean-k-mooney: long story short, I just say that SRIOV GPUs are fine, but you would need to do something else for non-SRIOV GPUs | |
| 14:35:43 | bauzas | frickler: well, if blockdiag is unmaintained, we may need to do this indeed | |
| 14:36:07 | bauzas | frickler: but nothing magically happens even if we wish it, we need some people to do the dirty work :) | |
| 14:36:41 | bauzas | so I can try to file a bug report but no promises we could change that shortly | |
| 14:37:29 | bauzas | (ideally, if many projects share the same usage of blockdiag, I'd certainly be happy if the TC could take a stance on that situation like they did with eventlet) | |
| 14:37:49 | bauzas | gmann: JayF: just sayin' ^ | |
| 14:44:00 | tkajinam | https://bugs.launchpad.net/ironic/+bug/2026345 | |