| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-12-02 | |||
| 14:26:35 | lyarwood | np | |
| 14:32:44 | gibi | lyarwood: just note that fstring in LOG calls does not delay interpolation | |
| 14:33:38 | lyarwood | yup but in this situation I'm just dumping things to troubleshoot, not landing the changes in master :) | |
| 14:33:48 | gibi | sure | |
| 15:17:02 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Support interface attach with qos ports https://review.opendev.org/c/openstack/nova/+/756530 | |
| 15:18:26 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Enable mypy on scheduler/report.py https://review.opendev.org/c/openstack/nova/+/765152 | |
| 15:22:35 | LarsErikP | gibi: found a workaround =) | |
| 15:23:02 | LarsErikP | gibi: I tweak nvidia's sriov-manage script from creating all the VFs the GPU is capable of, to only create two | |
| 15:23:23 | gibi | LarsErikP: nice | |
| 15:23:25 | LarsErikP | gibi: then I cleaned up the resource providers, and now everything is fine.. Kinda dirty, but it works.. | |
| 15:24:11 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Make remove allocation symmetric with add allocation https://review.opendev.org/c/openstack/nova/+/757110 | |
| 15:24:12 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Factor out port resource deallocation https://review.opendev.org/c/openstack/nova/+/757111 | |
| 15:24:24 | LarsErikP | I've asked nvidia enterprise support if there is a "proper" way of doing this. The specifically say in the grid docs that you should _never_ use anything else than their script to enable the sr-iov functions | |
| 15:24:38 | LarsErikP | but they did no say I shouldn't edit their script... :P | |
| 15:24:50 | gibi | :D | |
| 15:27:35 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Refactor update_pci_request_spec_with_allocated_interface_name https://review.opendev.org/c/openstack/nova/+/757614 | |
| 15:27:42 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Support interface attach with qos ports https://review.opendev.org/c/openstack/nova/+/756530 | |
| 15:29:25 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Enable mypy on scheduler/report.py https://review.opendev.org/c/openstack/nova/+/765152 | |
| 15:35:29 | openstackgerrit | Lee Yarwood proposed openstack/nova-specs master: Image and flavor defined ephemeral storage encryption https://review.opendev.org/c/openstack/nova-specs/+/752284 | |
| 15:41:20 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Enable mypy on scheduler/report.py https://review.opendev.org/c/openstack/nova/+/765152 | |
| 16:33:08 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: Docs: correct cpu_thread_policy explanation https://review.opendev.org/c/openstack/nova/+/765172 | |
| 16:46:50 | lyarwood | gibi / aarents ; I'm going to be out on PTO for the rest of the week btw in regards to the cross cell resize | |
| 16:46:57 | lyarwood | bug* | |
| 16:47:03 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: Docs: correct cpu_thread_policy explanation https://review.opendev.org/c/openstack/nova/+/765172 | |
| 16:48:20 | gibi | lyarwood: thanks for the heads up | |
| 16:48:41 | gibi | I will make sure the backlisting merges | |
| 16:48:51 | lyarwood | ack thanks, I can pick up the fix on Monday | |
| 16:48:59 | lyarwood | if aarents doesn't make progress | |
| 16:49:02 | gibi | have a nice time off | |
| 16:49:43 | lyarwood | lockdown ended today in England and my child is in nursery for the first time tomorrow, so don't worry I'll be having a nice time :D | |
| 16:49:47 | lyarwood | sleeping mostly | |
| 16:50:58 | gibi | sleeping is good | |
| 17:09:07 | kashyap | Yes, it adds years to life. (Cf. https://www.penguin.co.uk/books/295/295665/why-we-sleep/9780141983769.html) | |
| 17:09:34 | kashyap | (Counter-intuitively, enough ;-)) | |
| 17:18:07 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Support interface attach with qos ports https://review.opendev.org/c/openstack/nova/+/756530 | |
| 17:34:46 | efried | +1 Why We Sleep -- life-changing read. | |
| 18:14:05 | gmann | gate is too slow today, this did not get the node yet. waiting since 4 hrs- https://review.opendev.org/c/openstack/nova/+/765141 | |
| 18:55:30 | openstackgerrit | melanie witt proposed openstack/nova master: WIP Omit resource inventories from placement update if zero https://review.opendev.org/c/openstack/nova/+/759348 | |
| 22:28:19 | rm_work | Is there a way to NOT have a default AZ, and to *require* the user specify one in their server-create command? or would that require a patch? | |
| 22:29:04 | rm_work | it seems we just removed the section from our config without thinking about it very much, but that had the effect of just causing the default AZ to be "nova" (default default) which does not exist in our cloud | |
| 22:50:01 | sean-k-mooney | not that i can see no | |
| 22:50:21 | rm_work | yeah looks like it has to be a custom patch | |
| 22:50:27 | sean-k-mooney | vms always need a AZ | |
| 22:50:27 | rm_work | ah well | |
| 22:50:54 | sean-k-mooney | rm_work: well you can propose it upstream or do it with api middelware | |
| 22:51:17 | sean-k-mooney | e.g. you coudl write middleware to reject all server creates that dont have an az | |
| 22:51:50 | rm_work | yeah that might be an interesting approach | |
| 22:51:56 | sean-k-mooney | this is config driven api bevhiaor and will break interoprablity between your cloud and others however | |
| 22:52:21 | sean-k-mooney | e.g. by default you should be able to boot without specifying an az | |
| 22:52:39 | sean-k-mooney | so it will be a qurik of your cloud that its always required | |
| 22:52:50 | rm_work | yeah, unfortunate but documentable | |
| 22:52:58 | rm_work | and internal only cloud so not hugely worried | |
| 23:09:32 | openstackgerrit | DatLQ proposed openstack/nova stable/victoria: Fix unplugging VIF when migrate/resize VM https://review.opendev.org/c/openstack/nova/+/764504 | |
| 23:57:28 | dcapone2004 | https://www.mess.org/2020/06/22/Hyper-V-in-KVM/#:~:text=Hyper%2DV%20on%20Windows%20requires,it%20is%... | |
| 23:57:28 | dcapone2004 | hi, is there any using openstack flavor traits/image metadata to pass a very specific CPU configuration to qemu-kvm in openstack nova when a virtual machine is started? Essentially, we are trying to find a way to implement this solution in an openstack environment | |
| #openstack-nova - 2020-12-03 | |||
| 00:03:22 | sean-k-mooney | dcapone2004: what exactly are you trying to enable | |
| 00:03:53 | sean-k-mooney | dcapone2004:in general the answer is no by design that is not allowed but we may already have a way to do what you want in a more abstract way | |
| 00:04:18 | sean-k-mooney | <feature policy="disable" name="hypervisor"/> | |
| 00:04:20 | sean-k-mooney | <feature policy="require" name="vmx"/> | |
| 00:04:45 | sean-k-mooney | so do you jsut want vmx or do you also want to disabel the hyperviror feature flag | |
| 00:04:49 | sean-k-mooney | you can do both already | |
| 00:05:26 | sean-k-mooney | vmx will be present if you use host-model or host-passthough for the cpu_mode in the libvirt section of the nova.conf | |
| 00:06:14 | sean-k-mooney | https://docs.openstack.org/nova/latest/configuration/config.html#libvirt.cpu_mode | |
| 00:06:52 | sean-k-mooney | if you use cpu_mode=custom then you need to use cpu_model_extra_flags to add vmx https://docs.openstack.org/nova/latest/configuration/config.html#libvirt.cpu_model_extra_flags | |
| 00:07:01 | sean-k-mooney | for <feature policy="disable" name="hypervisor"/> | |
| 00:08:27 | sean-k-mooney | you need to add either hw:hide_hypervisor_id=true in the flavor extra specs or img_hide_hypervisor_id in the image properties | |
| 00:08:36 | sean-k-mooney | dcapone2004:^ | |
| 00:09:11 | sean-k-mooney | dcapone2004: that will allow you to set those two flags in the libvirt xml | |
| 00:10:42 | sean-k-mooney | dcapone2004: note that adding vmx will only work if you actully have nested virt enabled in the host kernel kvm module parmaters | |
| 00:10:51 | sean-k-mooney | in this case the intel_kvm module | |
| 00:11:32 | sean-k-mooney | it also requires you to use virt-type kvm rather then qemu but you should be using kvm by default anyway just tought i would mention it just in case | |
| 00:11:55 | sean-k-mooney | dcapone2004: hopefully that helps | |
| 00:20:58 | dcapone2004 | sean I already tried all you suggested | |
| 00:21:00 | dcapone2004 | it doesn't work | |
| 00:21:21 | dcapone2004 | the hide_hyperivsor_id=true property passes a kvm=no to qemu | |
| 00:21:51 | dcapone2004 | instead of hypervisor=no, I have nested virtualization enabled and it works when my nested hypervisor is Linux/KVM | |
| 00:23:38 | dcapone2004 | but just as described in several google search articles I found, when trying it with hyper-v, once hyper-v is enabled in a VM, the VM locks up and no longer boots... the solution appears to be based on those settings in that article I found | |
| 00:24:11 | dcapone2004 | I am passing the vmx flag to the VM with nova.conf and the cpu_model_extra_flags configuration | |
| 00:31:30 | sean-k-mooney | what version of openstack are you using and what version of the linux kernel are you using | |
| 00:32:34 | sean-k-mooney | dcapone2004: hide_hyperivsor_id=true should not disable kvm | |
| 00:34:01 | sean-k-mooney | oh i see what its doing | |
| 00:35:19 | sean-k-mooney | it will produce something like this by default http://paste.openstack.org/show/800674/ | |
| 00:35:47 | sean-k-mooney | vmx=on,pdcm=on,pcid=on,hypervisor=on, with kvm=off | |
| 00:36:04 | dcapone2004 | ussuri, kernel 4.10, centos 8 standard kernel | |
| 00:36:27 | sean-k-mooney | but i think that changes if you set the image type to windows | |
| 00:36:55 | sean-k-mooney | ussuri has the hyperv change i was wondering about | |
| 00:37:20 | dcapone2004 | so, I don't have as many flags as you enabled | |
| 00:37:32 | dcapone2004 | what happens on mine is that NO hypervisor option is passed | |
| 00:37:40 | sean-k-mooney | https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L5362-L5387 | |
| 00:37:46 | dcapone2004 | and I think I need it to explicitly pass no based on that "fix" article I read | |
| 00:37:49 | sean-k-mooney | this is the addtional logic for windows guest | |
| 00:38:09 | sean-k-mooney | dcapone2004: im using cpu_mode=host-passthough | |
| 00:38:22 | sean-k-mooney | so its adding all of my virutalisable cpu flags by default | |
| 00:38:57 | sean-k-mooney | dcapone2004: can you check if you have os_type=windows in the image metadata | |
| 00:39:12 | sean-k-mooney | dcapone2004: if not that might fix it | |
| 00:39:27 | dcapone2004 | yeah, I'm using custom as we have some different CPUs in our clusters so i use custom to use the lowest common CPU model among them all | |
| 00:39:55 | dcapone2004 | I then use flavor traits to expose higher CPU models to VMs when needed based on the flavor | |
| 00:40:28 | dcapone2004 | aka, AVX2 to expose Haswell and have the scheduler route the VM to a node that has Haswell or better CPUs | |
| 00:40:30 | sean-k-mooney | traits wont make the cpu feature avaiable just so you are aware | |
| 00:40:53 | sean-k-mooney | i assume you are using the recently added support to list multiple cpu models | |