| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-07-02 | |||
| 09:23:19 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: Validate CPU pinning configuration for mixed instance https://review.opendev.org/716268 | |
| 09:23:20 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: scheduler: mixed instance CPU resource translating https://review.opendev.org/728482 | |
| 09:27:36 | lyarwood | masterpe: kk well I'd raise a bug with Ubuntu against QEMU, if they can prove it's an OpenStack issue we can then raise one against Nova. | |
| 09:28:49 | lyarwood | masterpe: bonus points if you try to reproduce this outside of OpenStack btw. | |
| 09:29:07 | lyarwood | https://bugs.launchpad.net/ubuntu/+source/qemu <- that's where you can raise the QEMU bug FWIW | |
| 09:32:21 | masterpe | https://gist.github.com/mpiscaer/9c50e4e6f81d004fc78bc282e910a458 is the log of the instance on qemu | |
| 09:33:51 | openstack | Launchpad bug 1882416 in Ubuntu Cloud Archive "virtio-balloon change breaks rocky -> stein live migrate" [Undecided,New] | |
| 09:33:51 | frickler | masterpe: is that the same as https://bugs.launchpad.net/cloud-archive/+bug/1882416 ? | |
| 09:35:24 | masterpe | Yes | |
| 09:35:49 | frickler | masterpe: then best try to talk to cpaelzer in #ubuntu-server | |
| 09:43:41 | masterpe | Qemu fix this issue in commit 2bbadb08ce272d65e1f78621002008b07d1e0f03, Thank you very much, this is something I can work with. | |
| 10:06:44 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/rocky: fix scsi disk unit number of the attaching volume when cdrom bus is scsi https://review.opendev.org/730312 | |
| 10:08:53 | lyarwood | ops ignore that, just catching up on stable today and didn't check the ML first | |
| 10:30:09 | gibi | stephenfin: I have a question in https://review.opendev.org/#/c/730382 | |
| 10:34:20 | stephenfin | gibi: Replied. Will update now | |
| 10:34:40 | openstackgerrit | Wenping Song proposed openstack/nova master: Admin auth token to call Cyborg API by Nova https://review.opendev.org/739011 | |
| 10:35:19 | gibi | stephenfin: what is your view about notifying the out of tree driver authors? | |
| 10:35:28 | stephenfin | Yup, I'll do that too | |
| 10:36:22 | gibi | cool | |
| 10:36:47 | gibi | regarding tox -e mypy. yes, removing the quotes does not make that command fail | |
| 10:36:55 | gibi | which is strange | |
| 10:37:17 | gibi | I deleted .pyc files and still | |
| 10:41:42 | lyarwood | gmann: just catching up with your work on stable, thanks again for driving all of this. | |
| 10:42:03 | lyarwood | gmann: just trying to fixup stable/rocky for openstack/nova | |
| 10:42:16 | lyarwood | gmann: I'll move the remaining grenade jobs to nv | |
| 10:42:39 | lyarwood | gmann: I also noticed debtcollector is borking ubuntu-xenial based nodes as it requires >= py3.6 | |
| 10:43:09 | lyarwood | gmann: remind me, is it better to handle this in openstack/requirements or each project on stable? | |
| 10:43:23 | lyarwood | https://zuul.opendev.org/t/openstack/build/0e880aa891de40c2ad9d07916cb9bf5b/log/job-output.txt#3312 <- for reference | |
| 10:48:11 | lyarwood | ah wait that isn't a uc issue | |
| 10:49:11 | lyarwood | https://github.com/openstack/devstack-gate/blob/master/devstack-vm-gate-wrap.sh#L519-L520 | |
| 10:51:16 | openstackgerrit | sean mooney proposed openstack/nova master: catch libvirt exception when nodedev not found. https://review.opendev.org/739017 | |
| 10:52:10 | sean-k-mooney1 | bauzas: stephenfin ^ that is the minimal change im working on the full fix now | |
| 10:53:15 | stephenfin | lyarwood: enabling this should resolve that for us, but I'm not sure if it's available there https://github.com/pypa/pip/issues/988 Assuming not, we probably want to be using upper-constraints there? | |
| 10:54:28 | lyarwood | stephenfin: yeah you would think we want to apply uc here somehow | |
| 10:54:44 | lyarwood | stephenfin: but as this is branchless I'm not sure how that works tbh | |
| 10:54:47 | stephenfin | sean--k-mooney: you've a double hyphen there, btw ;) | |
| 10:54:51 | lyarwood | I'm sure there are examples somewhere | |
| 10:54:58 | sean--k-mooney | lyarwood: there is an upperconstratis for each stable branch | |
| 10:54:59 | stephenfin | isn't the branch an environment variable in zuul? | |
| 10:55:13 | sean--k-mooney | ah thanks | |
| 10:55:49 | lyarwood | stephenfin: yup I'm sure there are examples somewhere | |
| 10:56:22 | sean-k-mooney | i shoudl really jsut drop the k since i hate my middel name and never use it but i would have to alther my config file and thats more effort then i care about :) | |
| 10:56:58 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/rocky: Make greande jobs n-v for EM and oldest stable https://review.opendev.org/739020 | |
| 10:58:50 | lyarwood | sean-k-mooney: sorry yeah us isn't branchless, devstack-gate is. | |
| 10:58:56 | lyarwood | uc* | |
| 11:00:15 | sean-k-mooney | ah ok | |
| 11:00:32 | sean-k-mooney | if you set it in the stable/ version of requirements | |
| 11:00:45 | sean-k-mooney | then it will be applied to devstack gate too right | |
| 11:00:53 | gokhani | hi nova folks, I wonder if we can use gpu virtualization on ubuntu kvm compute nodes? In nvidia docs, I can't see support of ubuntu kvm hypervisor ( https://docs.nvidia.com/grid/7.0/product-support-matrix/index.html ). Is there any suggestions for gpu virtualization in an OpenStack environment which works on ubuntu 18.04? | |
| 11:00:55 | sean-k-mooney | unless this is in unit tests | |
| 11:01:12 | sean-k-mooney | even then you can set it via an env var | |
| 11:01:48 | sean-k-mooney | gokhani: if you can install the driver then proably but they dont package for debian | |
| 11:02:42 | sean-k-mooney | if they are using dkms then you could proably use ailen too install the rpm | |
| 11:02:56 | sean-k-mooney | not sure if it would work however | |
| 11:03:15 | sean-k-mooney | gokhani: form a nova point of view we dont care | |
| 11:03:30 | sean-k-mooney | nvida driver support is the limiting factor | |
| 11:04:50 | sean-k-mooney | gokhani: https://www.teradici.com/web-help/ter1702003/2.8/Content/_Graphics%20Agent/Installing/Linux/installing_nvidia_linux_ubuntu.htm | |
| 11:05:50 | sean-k-mooney | that might just be the guest driver | |
| 11:11:55 | gokhani | sean-k-mooney, I have a supermicro server which has 4 nvidia tesla v100-SXM2 gpu cards and nvidia has tesla driver for ubuntu 18.04 (https://www.nvidia.com/Download/driverResults.aspx/160638/en-us). but for virtual gpu software nvidia doesn't give debian package. may be I need to also consult nvidia. | |
| 11:12:27 | sean-k-mooney | gokhani: you need a different driver for grid | |
| 11:12:45 | sean-k-mooney | teslsa cards are supported on ubunut but i dont think grid is | |
| 11:12:52 | sean-k-mooney | on the host at least for vgpu | |
| 11:13:11 | sean-k-mooney | that does not mean you cant get it to work but yes you should contact nvidia | |
| 11:13:49 | sean-k-mooney | you will also need to buy the approriate licenses and set up the server to delegate the licneses to your compute nodes | |
| 11:18:22 | gokhani | sean-k-mooney, ok ı see. initially I wanna test vgpu on openstack and then if everything goes well, we are planning to buy appropriate licenses. If I can't get it to work on ubuntu, I will try centos/rhel. | |
| 11:19:23 | sean-k-mooney | you cna use a low res gpu without cuda without a license i think | |
| 11:20:10 | sean-k-mooney | so you can test you can boot a vm but not use if for useful work beyond a slighly better vnc/spice console experinece | |
| 11:22:09 | gokhani | sorry what do you mean with *res ? | |
| 11:22:32 | sean-k-mooney | resolution e.g i think its capped at 720p | |
| 11:24:47 | lyarwood | sean-k-mooney: sorry back, https://github.com/openstack/devstack-gate/blob/master/devstack-vm-gate-wrap.sh#L519-L520 is the issue, I don't think we actually have requirements pulled down for the correct branch at this point | |
| 11:25:11 | sean-k-mooney | lyarwood: zuul should have cloned it | |
| 11:25:33 | sean-k-mooney | it does that before devstack-gate runs as far as i know | |
| 11:27:47 | sean-k-mooney | so i think you can jsut pass -c /opt/git/openstack/requirements/upper-constriats.txt | |
| 11:28:07 | lyarwood | hmmm I think this might actually be fixed, I can't reproduce locally | |
| 11:28:23 | gokhani | sean-k-mooney, ok if I see correctly, for testing ı can test gpu virtualization with no license. | |
| 11:30:20 | sean-k-mooney | gokhani: i belvie so just with reduced capablities | |
| 11:30:27 | sean-k-mooney | bug you can confirm the hardware works | |
| 11:35:01 | gokhani | sean-k-mooney, I am confused. from nova point for using nvidia vgpu capabilities, do I need also nvidia vgpu software on my server or it is built in function in nova ? ı mean tesla or grid driver is enough for nova except licenses ? | |
| 11:41:50 | sean-k-mooney | gokhani: you need the vgpu software on your server | |
| 11:42:05 | sean-k-mooney | nova just has the ablity to tell libvirt to configure it | |
| 11:42:13 | sean-k-mooney | well vms that use vgpus | |
| 11:43:58 | sean-k-mooney | gokhani: the lices are ativly issued by a server like windows linces so you need to run an instance of that licensing serverr somewhere and you need to configre the hosts to phone home ot that server everytime a vms is booted with a vgpu to claim a lisence | |
| 11:44:18 | sean-k-mooney | gokhani: this should be all coverd in the nvida docs | |
| 11:44:31 | sean-k-mooney | its not specific to nova | |
| 11:57:05 | gibi | stephenfin: left a bunch of notes in https://review.opendev.org/#/c/631363 . I can be convinced to do the functional test coverage in a follow up | |
| 12:06:09 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: objects: Introduce the 'CPUAllocationPolicy.MIXED' enum https://review.opendev.org/716267 | |
| 12:06:10 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: Calculate the CPU usage for mixed instance https://review.opendev.org/716269 | |
| 12:06:10 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: Validate CPU pinning configuration for mixed instance https://review.opendev.org/716268 | |
| 12:06:10 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: libvirt: apply mixed instance CPU policy https://review.opendev.org/728481 | |
| 12:06:11 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: scheduler: mixed instance CPU resource translating https://review.opendev.org/728482 | |
| 12:06:12 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: flavor: Enable 'hw:cpu_dedicated_mask' for creating a mixed instance https://review.opendev.org/714706 | |
| 12:13:10 | jsuchome | gibi: Hi, I've created https://review.opendev.org/#/c/738738/ for you | |
| 12:13:45 | gibi | jsuchome: thans! | |
| 12:13:47 | gibi | thanks | |
| 12:17:11 | gokhani | sean-k-mooney, thanks for your useful information. After consulting to nvidia, I will decide. | |
| 12:54:43 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Add support for resize and cold migration of emulated TPM files https://review.opendev.org/639934 | |
| 12:54:43 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Add emulated TPM support to Nova https://review.opendev.org/631363 | |
| 12:54:43 | openstackgerrit | Stephen Finucane proposed openstack/nova master: virt: Add 'context', drop 'network_info' parameters for 'unrescue' https://review.opendev.org/730382 | |
| 12:56:58 | stephenfin | dansmith: Can you look at https://review.opendev.org/#/c/683043/ again today? | |
| 13:16:44 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/rocky: Make greande jobs n-v for EM and oldest stable https://review.opendev.org/739020 | |