| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-07-01 | |||
| 17:27:05 | lyarwood | https://github.com/lyarwood/nova/blob/d4c857dfcb1ccfa5410de55671e69c722bbc990e/nova/virt/libvirt/guest.py#L811-L819 | |
| 18:03:02 | lseki | lyarwood / sean-k-mooney: is blockResize called always, no matter what c-vol did before? | |
| 18:15:35 | lseki | testing it in a stable/train devstack here... | |
| 18:27:00 | lyarwood | lseki: yes | |
| 18:34:04 | lseki | oh no | |
| 18:34:14 | lseki | https://www.irccloud.com/pastebin/hmybxXhk/ | |
| 18:49:35 | lseki | the driver being used is `LibvirtNFSVolumeDriver`, with parent `LibvirtBaseFileSystemVolumeDriver` and grandpa `LibvirtBaseVolumeDriver` | |
| 18:49:54 | lseki | none of them implement `extend_volume` :-( | |
| 18:54:53 | lseki | so it stops here https://github.com/lyarwood/nova/blob/d4c857dfcb1ccfa5410de55671e69c722bbc990e/nova/virt/libvirt/driver.py#L2100 before reaching `_resize_attached_volume` | |
| 19:05:41 | lseki | I implemented `LibvirtNFSVolumeDriver.extend_volume` that just returns `requested_size`, and then attached extend worked! | |
| 19:05:47 | lseki | 🎉 | |
| 19:05:47 | lseki | 🎉 | |
| 19:06:41 | lseki | I'll update the bug report and submit the patches for both cinder and nova | |
| 19:07:12 | lseki | lyarwood: sean-k-mooney thank you for helping me! | |
| 19:59:34 | openstackgerrit | Merged openstack/nova master: Prevent libvirt driver starting on non Linux platform https://review.opendev.org/737508 | |
| 21:56:25 | openstackgerrit | Merged openstack/nova master: Limit the number of concurrent snapshots https://review.opendev.org/736169 | |
| #openstack-nova - 2020-07-02 | |||
| 00:53:50 | openstackgerrit | Brin Zhang proposed openstack/nova master: Delete ARQs by UUID if Cyborg ARQ bind fails. https://review.opendev.org/716186 | |
| 00:54:03 | openstackgerrit | Brin Zhang proposed openstack/nova master: cyborg evacuate support https://review.opendev.org/715326 | |
| 00:54:18 | openstackgerrit | Brin Zhang proposed openstack/nova master: WIP: Cyborg shelve/unshelve support https://review.opendev.org/729563 | |
| 01:00:42 | openstackgerrit | Brin Zhang proposed openstack/nova master: Optimize _create_and_bind_arqs logic in conducor https://review.opendev.org/726564 | |
| 08:58:14 | masterpe | I want to live-migrate from qemu version 2.11.1 to 3.1.0. Is this possible? Or is it only possible via a cold-migration? | |
| 09:10:27 | lyarwood | masterpe: it should be possible, forward live migrations like that are a supported feature. | |
| 09:11:03 | masterpe | lyarwood: When I test it I get the error: "stream had I/O failure" | |
| 09:11:36 | masterpe | when the same nodes are both on version qemu version 2.11.1 it works fine. | |
| 09:15:06 | lyarwood | masterpe: kk well it's supported so that smells like an actual bug in 3.1.0, which underlying os & OpenStack distro are you using? | |
| 09:16:24 | masterpe | Ubuntu 18.04 and it is part of an upgrade from Rocky to Stein | |
| 09:23:17 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: objects: Introduce 'pcpuset' field for InstanceNUMACell https://review.opendev.org/714658 | |
| 09:23:17 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: notifications: add the pcpuset info to instance numa cell payload https://review.opendev.org/728480 | |
| 09:23:18 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: objects: Introduce the 'CPUAllocationPolicy.MIXED' enum https://review.opendev.org/716267 | |
| 09:23:18 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: libvirt: apply mixed instance CPU policy https://review.opendev.org/728481 | |
| 09:23:19 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: Validate CPU pinning configuration for mixed instance https://review.opendev.org/716268 | |
| 09:23:19 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: Calculate the CPU usage for mixed instance https://review.opendev.org/716269 | |
| 09:23:20 | openstackgerrit | Huaqiang Wang proposed openstack/nova master: scheduler: mixed instance CPU resource translating https://review.opendev.org/728482 | |
| 09:27:36 | lyarwood | masterpe: kk well I'd raise a bug with Ubuntu against QEMU, if they can prove it's an OpenStack issue we can then raise one against Nova. | |
| 09:28:49 | lyarwood | masterpe: bonus points if you try to reproduce this outside of OpenStack btw. | |
| 09:29:07 | lyarwood | https://bugs.launchpad.net/ubuntu/+source/qemu <- that's where you can raise the QEMU bug FWIW | |
| 09:32:21 | masterpe | https://gist.github.com/mpiscaer/9c50e4e6f81d004fc78bc282e910a458 is the log of the instance on qemu | |
| 09:33:51 | frickler | masterpe: is that the same as https://bugs.launchpad.net/cloud-archive/+bug/1882416 ? | |
| 09:33:51 | openstack | Launchpad bug 1882416 in Ubuntu Cloud Archive "virtio-balloon change breaks rocky -> stein live migrate" [Undecided,New] | |
| 09:35:24 | masterpe | Yes | |
| 09:35:49 | frickler | masterpe: then best try to talk to cpaelzer in #ubuntu-server | |
| 09:43:41 | masterpe | Qemu fix this issue in commit 2bbadb08ce272d65e1f78621002008b07d1e0f03, Thank you very much, this is something I can work with. | |
| 10:06:44 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/rocky: fix scsi disk unit number of the attaching volume when cdrom bus is scsi https://review.opendev.org/730312 | |
| 10:08:53 | lyarwood | ops ignore that, just catching up on stable today and didn't check the ML first | |
| 10:30:09 | gibi | stephenfin: I have a question in https://review.opendev.org/#/c/730382 | |
| 10:34:20 | stephenfin | gibi: Replied. Will update now | |
| 10:34:40 | openstackgerrit | Wenping Song proposed openstack/nova master: Admin auth token to call Cyborg API by Nova https://review.opendev.org/739011 | |
| 10:35:19 | gibi | stephenfin: what is your view about notifying the out of tree driver authors? | |
| 10:35:28 | stephenfin | Yup, I'll do that too | |
| 10:36:22 | gibi | cool | |
| 10:36:47 | gibi | regarding tox -e mypy. yes, removing the quotes does not make that command fail | |
| 10:36:55 | gibi | which is strange | |
| 10:37:17 | gibi | I deleted .pyc files and still | |
| 10:41:42 | lyarwood | gmann: just catching up with your work on stable, thanks again for driving all of this. | |
| 10:42:03 | lyarwood | gmann: just trying to fixup stable/rocky for openstack/nova | |
| 10:42:16 | lyarwood | gmann: I'll move the remaining grenade jobs to nv | |
| 10:42:39 | lyarwood | gmann: I also noticed debtcollector is borking ubuntu-xenial based nodes as it requires >= py3.6 | |
| 10:43:09 | lyarwood | gmann: remind me, is it better to handle this in openstack/requirements or each project on stable? | |
| 10:43:23 | lyarwood | https://zuul.opendev.org/t/openstack/build/0e880aa891de40c2ad9d07916cb9bf5b/log/job-output.txt#3312 <- for reference | |
| 10:48:11 | lyarwood | ah wait that isn't a uc issue | |
| 10:49:11 | lyarwood | https://github.com/openstack/devstack-gate/blob/master/devstack-vm-gate-wrap.sh#L519-L520 | |
| 10:51:16 | openstackgerrit | sean mooney proposed openstack/nova master: catch libvirt exception when nodedev not found. https://review.opendev.org/739017 | |
| 10:52:10 | sean-k-mooney1 | bauzas: stephenfin ^ that is the minimal change im working on the full fix now | |
| 10:53:15 | stephenfin | lyarwood: enabling this should resolve that for us, but I'm not sure if it's available there https://github.com/pypa/pip/issues/988 Assuming not, we probably want to be using upper-constraints there? | |
| 10:54:28 | lyarwood | stephenfin: yeah you would think we want to apply uc here somehow | |
| 10:54:44 | lyarwood | stephenfin: but as this is branchless I'm not sure how that works tbh | |
| 10:54:47 | stephenfin | sean--k-mooney: you've a double hyphen there, btw ;) | |
| 10:54:51 | lyarwood | I'm sure there are examples somewhere | |
| 10:54:58 | sean--k-mooney | lyarwood: there is an upperconstratis for each stable branch | |
| 10:54:59 | stephenfin | isn't the branch an environment variable in zuul? | |
| 10:55:13 | sean--k-mooney | ah thanks | |
| 10:55:49 | lyarwood | stephenfin: yup I'm sure there are examples somewhere | |
| 10:56:22 | sean-k-mooney | i shoudl really jsut drop the k since i hate my middel name and never use it but i would have to alther my config file and thats more effort then i care about :) | |
| 10:56:58 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/rocky: Make greande jobs n-v for EM and oldest stable https://review.opendev.org/739020 | |
| 10:58:50 | lyarwood | sean-k-mooney: sorry yeah us isn't branchless, devstack-gate is. | |
| 10:58:56 | lyarwood | uc* | |
| 11:00:15 | sean-k-mooney | ah ok | |
| 11:00:32 | sean-k-mooney | if you set it in the stable/ version of requirements | |
| 11:00:45 | sean-k-mooney | then it will be applied to devstack gate too right | |
| 11:00:53 | gokhani | hi nova folks, I wonder if we can use gpu virtualization on ubuntu kvm compute nodes? In nvidia docs, I can't see support of ubuntu kvm hypervisor ( https://docs.nvidia.com/grid/7.0/product-support-matrix/index.html ). Is there any suggestions for gpu virtualization in an OpenStack environment which works on ubuntu 18.04? | |
| 11:00:55 | sean-k-mooney | unless this is in unit tests | |
| 11:01:12 | sean-k-mooney | even then you can set it via an env var | |
| 11:01:48 | sean-k-mooney | gokhani: if you can install the driver then proably but they dont package for debian | |
| 11:02:42 | sean-k-mooney | if they are using dkms then you could proably use ailen too install the rpm | |
| 11:02:56 | sean-k-mooney | not sure if it would work however | |
| 11:03:15 | sean-k-mooney | gokhani: form a nova point of view we dont care | |
| 11:03:30 | sean-k-mooney | nvida driver support is the limiting factor | |
| 11:04:50 | sean-k-mooney | gokhani: https://www.teradici.com/web-help/ter1702003/2.8/Content/_Graphics%20Agent/Installing/Linux/installing_nvidia_linux_ubuntu.htm | |
| 11:05:50 | sean-k-mooney | that might just be the guest driver | |
| 11:11:55 | gokhani | sean-k-mooney, I have a supermicro server which has 4 nvidia tesla v100-SXM2 gpu cards and nvidia has tesla driver for ubuntu 18.04 (https://www.nvidia.com/Download/driverResults.aspx/160638/en-us). but for virtual gpu software nvidia doesn't give debian package. may be I need to also consult nvidia. | |
| 11:12:27 | sean-k-mooney | gokhani: you need a different driver for grid | |
| 11:12:45 | sean-k-mooney | teslsa cards are supported on ubunut but i dont think grid is | |
| 11:12:52 | sean-k-mooney | on the host at least for vgpu | |
| 11:13:11 | sean-k-mooney | that does not mean you cant get it to work but yes you should contact nvidia | |
| 11:13:49 | sean-k-mooney | you will also need to buy the approriate licenses and set up the server to delegate the licneses to your compute nodes | |
| 11:18:22 | gokhani | sean-k-mooney, ok ı see. initially I wanna test vgpu on openstack and then if everything goes well, we are planning to buy appropriate licenses. If I can't get it to work on ubuntu, I will try centos/rhel. | |
| 11:19:23 | sean-k-mooney | you cna use a low res gpu without cuda without a license i think | |
| 11:20:10 | sean-k-mooney | so you can test you can boot a vm but not use if for useful work beyond a slighly better vnc/spice console experinece | |
| 11:22:09 | gokhani | sorry what do you mean with *res ? | |
| 11:22:32 | sean-k-mooney | resolution e.g i think its capped at 720p | |