| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-09-02 | |||
| 11:02:39 | stephenfin | ? | |
| 11:09:47 | alex_xu | brinzhang: that is better to have luyao to take a look at, but I think that is the version luyao tested | |
| 11:40:55 | gibi | stephenfin: hm, that is an interesting catch | |
| 11:41:14 | gibi | I'm not aware of inflight microversion bumps | |
| 11:42:48 | gibi | yeah, looking through our bp list I don't think we have a version bump https://launchpad.net/nova/+milestone/victoria-3 | |
| 11:45:18 | sean-k-mooney | gibi: i think that might be a first for m3 since they were added :) | |
| 11:46:06 | sean-k-mooney | stephenfin: you could just add a microverion for this | |
| 11:46:14 | gibi | I guess it is a definit signal that nova development is slowing down | |
| 11:46:42 | sean-k-mooney | to singal the xenapi apis being removed | |
| 11:47:10 | sean-k-mooney | then use that for tempest | |
| 11:50:12 | sean-k-mooney | gibi: by the way i didnt find any thing broken in your code although there is that latent bug for keeping the vfs in teh db in sync with reality after a vf is detached | |
| 11:50:27 | sean-k-mooney | was there anything in particalar you wanted me to test that i did not | |
| 11:50:46 | gibi | sean-k-mooney: thanks for the tests. I think you covered everything. | |
| 11:51:36 | gibi | sean-k-mooney: regarding the latent bug. when a pf is attached to a guest then the host deletes the vfs from the pf | |
| 11:51:46 | gibi | and then when the pf is freed from the guest | |
| 11:51:52 | gibi | the vfs are not recreated by the host | |
| 11:52:06 | sean-k-mooney | kind of | |
| 11:52:19 | gibi | I did added a bit of configuration to re-create the vfs | |
| 11:52:25 | gibi | I mean host config | |
| 11:52:35 | sean-k-mooney | that is the effect but its not somuch the host deleting the vf as we are unbining the pf from the kernel and the vf are destoyed when that happens | |
| 11:53:06 | sean-k-mooney | basically i allocated the VFs using /sys and echo at run time | |
| 11:53:09 | gibi | how the vfs was created in the first place? I guess by writing under /sys | |
| 11:53:13 | gibi | yeah | |
| 11:53:19 | gibi | so that steps is not persistent | |
| 11:53:26 | sean-k-mooney | but that configurtion info is lost when you allocate teh pf to the vm | |
| 11:53:30 | gibi | yepp | |
| 11:53:43 | sean-k-mooney | then wehn qemu is done it does a functionl level pci reset | |
| 11:53:44 | gibi | I think this is a host configuration task to keep the number of vfs perisitent | |
| 11:53:52 | gibi | persistent | |
| 11:53:58 | sean-k-mooney | it is | |
| 11:54:07 | gibi | so I put | |
| 11:54:07 | gibi | pre-up echo '4' > /sys/class/net/enp129s0f0/device/sriov_numvfs | |
| 11:54:08 | sean-k-mooney | but we could also protect against it eaisly in nova | |
| 11:54:23 | gibi | hm, how? | |
| 11:54:39 | gibi | does nova know what is the number of vfs to be re-created? | |
| 11:54:54 | sean-k-mooney | gibi: when we set teh vfs from unavaiable to avaiable after freeing the PF in the db we chould check with libvirt to make sure the exist | |
| 11:55:02 | sean-k-mooney | if they dont we can delete them in the db | |
| 11:55:24 | sean-k-mooney | or i guess we could count them and recreate them with that echo but deleteing seams simpler | |
| 11:55:43 | gibi | ohh, yes, we could sync our db with reality | |
| 11:55:48 | sean-k-mooney | yep | |
| 11:55:55 | gibi | I don't want to recreate anything host level | |
| 11:56:04 | sean-k-mooney | so syncing with reality shoudl be simple | |
| 11:56:08 | gibi | I see | |
| 11:56:40 | sean-k-mooney | the other thning is that unless your udev rules are correct when you unbind the pf form the vm | |
| 11:56:52 | sean-k-mooney | the pf might not bind back to the netdev vendor driver | |
| 11:57:03 | sean-k-mooney | it can stay bound to vfio-pci | |
| 11:57:22 | songwenping_ | bauzas: hi, i'm test vGPU with VM and meet some problems. I have install nvidia-smi driver and my GPU's already set nvidia driver, but i cannot find mdev_bus at /sys/class path. | |
| 11:57:22 | sean-k-mooney | in that case the vf wont be recreated by a pre-up command | |
| 11:57:35 | sean-k-mooney | but that is definetly out of nova scope | |
| 11:57:59 | sean-k-mooney | songwenping_: what kernel are you using | |
| 11:58:10 | gibi | sean-k-mooney: ack | |
| 11:58:20 | sean-k-mooney | songwenping_: also i dont think that is where it is | |
| 11:58:32 | bauzas | songwenping_: have you installed the nvidia driver in the compute service ? | |
| 11:58:58 | songwenping_ | i use ubuntu 18.04. | |
| 11:59:09 | songwenping_ | my centos env is ok. | |
| 11:59:12 | sean-k-mooney | songwenping_: i think its /sys/bus/mdev not /sys/class/mdev but its only created after you modporbe vfio-mdev | |
| 12:00:14 | sean-k-mooney | yep sean@pop-os:~$ ls /sys/bus/mdev/ | |
| 12:00:15 | sean-k-mooney | devices drivers drivers_autoprobe drivers_probe uevent | |
| 12:00:20 | songwenping_ | sean-k-mooney: also not find at /sys/bus/mdev | |
| 12:00:45 | sean-k-mooney | yep you need to do "sudo modprobe vfio-mdev" | |
| 12:00:49 | sean-k-mooney | to create it | |
| 12:01:16 | sean-k-mooney | wait is this a ubuntu 18.04 host | |
| 12:01:19 | sean-k-mooney | or guest | |
| 12:01:27 | songwenping_ | host | |
| 12:01:40 | sean-k-mooney | nvidia annoyingly does not have ubuntu host drivers | |
| 12:01:49 | sean-k-mooney | for virtual gpus | |
| 12:02:00 | sean-k-mooney | they only suppor ubuntu guests | |
| 12:03:04 | sean-k-mooney | so unless you used alien or something to install the rhel rpm on your ubuntu host i dont see how you can install the correct driver and kernel module | |
| 12:03:29 | sean-k-mooney | mdevs will work but not nvidia grid on a ubuntu host | |
| 12:04:24 | songwenping_ | i get nvidia-* last week and create vm with vgpu success with devstack on ubuntu 18.04 host. | |
| 12:04:40 | openstackgerrit | Johannes Kulik proposed openstack/nova master: vmware tests: Support different moref backend representations https://review.opendev.org/749488 | |
| 12:05:12 | bauzas | songwenping_: what sean-k-mooney said, nvidia doesn't support ubunutu as a compute OS | |
| 12:06:49 | jkulik | stephenfin, if you find some time, please have a look at https://review.opendev.org/749488 for the first patch for the oslo.vmware SOAP library switch. sorry for the long wait, downstream needed a lot more love than usual ... | |
| 12:06:54 | songwenping_ | i really get the nivida-* is at /sys/class/mdev_bus as centos. but now i cannot get it. | |
| 12:13:15 | sean-k-mooney | songwenping_: i think that class path will only exist if you have mdevs allocated | |
| 12:13:38 | sean-k-mooney | songwenping_: but as i said you cant use ubuntu as a host os for nvida grid | |
| 12:14:03 | sean-k-mooney | i can be the guest os but nvidia does not make the host level driver availabel for ubuntu | |
| 12:17:07 | songwenping_ | sean-k-mooney: yeah, i have allocated mdevs and i reinstall vgpu-kvm package. | |
| 12:17:55 | sean-k-mooney | songwenping_: where did you get the package for ubuntu? | |
| 12:18:38 | songwenping_ | nvidia official website | |
| 12:18:49 | songwenping_ | NVIDIA-Linux-x86_64-440.107-vgpu-kvm.run | |
| 12:19:07 | sean-k-mooney | https://docs.nvidia.com/grid/10.0/product-support-matrix/index.html | |
| 12:19:19 | sean-k-mooney | according to that ubnuntu is not supported as a host os | |
| 12:20:05 | songwenping_ | the path is /sys/class/mdev_bus/0000\:af\:00.0/mdev_supported_types/ generate, but nothing in it.:( | |
| 12:20:42 | sean-k-mooney | your going to have to talk to nvidia about that | |
| 12:22:27 | sean-k-mooney | the offical nividia doc which was last update on the 21st of august says ubunut is not supported i think you install the ubunut guest driver on the host | |
| 12:22:28 | songwenping_ | sean-k-mooney, bauzas: thanks a lot. i'll try to use ubuntu guest. | |
| 12:22:57 | openstackgerrit | Yao wang proposed openstack/nova master: Use VIR_DOMAIN_XML_INACTIVE for detach volume https://review.opendev.org/749489 | |
| 12:36:59 | bauzas | songwenping__: FWIW, for nvidia specific issues like it, please look at their documentation for vGPUs https://docs.nvidia.com/grid/latest/grid-vgpu-user-guide/index.html#grid-vgpu-introduction | |
| 12:37:36 | bauzas | the openstack community is not an nvidia support team :p | |
| 12:46:04 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/queens: compute: Don't delete the original attachment during pre LM rollback https://review.opendev.org/749233 | |
| 12:46:04 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/queens: Add regression tests for bug #1889108 https://review.opendev.org/749232 | |
| 12:46:05 | openstack | bug 1889108 in OpenStack Compute (nova) train "failures during driver.pre_live_migration remove source attachments during rollback" [Undecided,In progress] https://launchpad.net/bugs/1889108 - Assigned to Lee Yarwood (lyarwood) | |
| 12:47:07 | stephenfin | jkulik: sure, done | |
| 13:46:04 | openstackgerrit | Stephen Finucane proposed openstack/nova master: WIP: Resolve issues with various HTTP status codes https://review.opendev.org/749505 | |
| 13:46:43 | stephenfin | gmann, sean-k-mooney, gibi: There's a potential solution to our "no microversion in Victoria" conundrum ^ If that's not completely bonkers, I could probably finish it today | |
| 13:47:02 | stephenfin | though, in fairness, it probably is completely bonkers :) | |
| 13:47:13 | gibi | stephenfin: ack, will look. | |
| 13:47:33 | stephenfin | fair fair | |
| 13:51:35 | bauzas | gibi: sean-k-mooney: /me needs help of a network specialist | |