Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2019-09-25
16:22:39 cdent but on the other hand, if nova doesn't gate keep things go sideways
16:24:22 mriedem mlavalle: i added you to https://review.opendev.org/#/c/656885/3 and left a comment there with link to this irc conversation if that helps
16:24:54 mlavalle mriedem: it definitely does. Thanks you very much!
16:29:14 gregwork is it terribly difficult to to fiddle with libvirt <features> and <cpu> in nova?
16:29:30 gregwork i need to figure out how to set these to fool windows into not being terrible at everything because it detects its in kvm
16:29:31 gregwork https://pastebin.com/jw8Duq9S
16:29:51 gregwork it actively checks to see if its in kvm and turns off stuff
16:30:02 gregwork thats how i work around it using regular libvirt
16:30:47 mriedem gregwork: gpu?
16:31:04 mriedem gregwork: see https://review.opendev.org/#/c/579897/
16:31:42 gregwork so not an nvidia badness, i want to enable HyperV server role in my guest so I can run the cloud-base.it image generation git project
16:31:49 gregwork and it wont let you do that becuase HyperV detects KVM
16:31:53 gregwork and says "newp!"
16:32:18 gregwork this thing: https://cloudbase.it/windows-server-2016-openstack-images/
16:32:46 mriedem well i think you're looking for the img_hide_hypervisor_id image property or the hide_hypervisor_id flavor extra spe
16:32:48 mriedem *spec
16:33:03 mriedem the image property isn't in queens but the flavor extra spec might be
16:33:19 mriedem nope https://blueprints.launchpad.net/nova/+spec/hide-hypervisor-id-flavor-extra-spec was rocky
16:33:39 gregwork and there is no way to pass libvirt domain customizations
16:33:52 gregwork even kludgy ones :)
16:33:57 gregwork or even qemu execution lines
16:34:10 mriedem not through the compute api no
16:34:29 mriedem that's not really...cloud
16:35:29 artom Don't we have image props or something to make Windows happy?
16:35:54 mriedem artom: read scrollback
16:36:03 gregwork ever since they started planning to go to core based licensing instead of socket they have implemented some draconian things to prevent the potential for nested virtualization
16:36:11 openstackgerrit Merged openstack/nova master: docs: Scrub available quotas https://review.opendev.org/670125
16:36:31 gregwork especially since you can do performant nested virt with kvm on intel xeon e3-v4 processors using vmcs shadowing and device passthrough of network/storage
16:38:05 gregwork in our lab using those chips and passing through a virtual function off our nic to the L1 guest (hypervisor) we were only seeing a 5-10% difference in perf
16:38:10 gregwork it was really interesting
16:38:27 gregwork this is how hitachi does LPAR's on their x86_64 platform
16:39:04 gregwork hardware logical partitions which can run performant guests using intel xeon chips
16:39:17 gregwork anyhow it sucks i cant fiddle with this on queens
16:39:19 gregwork :/
16:40:51 mriedem i can't believe sean-k-mooney isn't around to chat about this
16:41:07 mriedem gregwork: well you could if you $$$ your vendor to backport a feature
16:43:32 artom mriedem, next time dinner first
16:47:00 mriedem dinner? you mean lunch?
16:47:05 mriedem what are you 80?
16:47:45 artom In my mind :(
16:53:35 mriedem stephenfin: i'm not sure we need this https://review.opendev.org/#/c/684781/ - it appears to already be fixed in master, though i guess we might want it just for backports
16:53:37 mriedem i left some notes inline
17:02:59 gmann mriedem: ohk. did you push the fix to tag tempest on pike gate ?
17:03:15 mriedem gmann: yup
17:03:41 gmann thanks. got it
17:09:17 openstackgerrit Matt Riedemann proposed openstack/nova master: Ignore sqla-migrate inspect.getargspec deprecation warnings on py36 https://review.opendev.org/684781
17:09:18 openstackgerrit Matt Riedemann proposed openstack/nova master: Ignore warning from sqlalchemy-migrate https://review.opendev.org/684772
17:09:18 openstackgerrit Matt Riedemann proposed openstack/nova master: tox: Use common 'command' definition for unit tests https://review.opendev.org/684774
17:09:19 openstackgerrit Matt Riedemann proposed openstack/nova master: tox: Stop overriding the 'install_command' https://review.opendev.org/684775
17:09:19 openstackgerrit Matt Riedemann proposed openstack/nova master: tests: Nuke OS_STDOUT_CAPTURE, OS_STDERR_CAPTURE https://review.opendev.org/684773
17:26:08 gregwork mriedem: what about sean-k-mooney ?
17:33:08 sean-k-mooney gregwork: mriedem sriov testing?
17:34:02 gregwork sean-k-mooney: hi, no actually trying to fool a windows instance on openstack into not thinking it is a guest. either modifying the domain in libvirt or possibly passing args to qemu-kvm
17:34:08 gregwork i have a working libvirt domain that does what i need
17:34:17 gregwork trying to figure out how to do this with nova/kvm
17:34:27 sean-k-mooney i tested doing nested sriov like 3 weeks ago and it does work if you enable a vIOMMU in the l1 guest and use q35 chipset but you need to play with the pci layout to fix the iommu groups
17:34:30 sean-k-mooney oh
17:34:32 sean-k-mooney ok
17:34:44 sean-k-mooney i think we fixed that
17:34:55 sean-k-mooney so you can enable hypervior hideing
17:34:56 gregwork yeah the nested virt works great if you have a chip that can do vmcs shadowing, and do passthrough devices for the L1 guest
17:35:10 gregwork if you dont pass through network/storage it will suck real bad for the L2 guests
17:35:23 gregwork at least then you remove 1 layer of nested virt (storage/network)
17:35:27 sean-k-mooney and we not hardcode a fake vendor id in the hyperv secotion so it thinks its running on a phyical host
17:35:45 gregwork part of it is disabling the hypervisor cpu flag in the guest
17:35:49 gregwork the other is the vendor string thing
17:36:07 sean-k-mooney yes if you set teh image property i think it does both
17:36:42 sean-k-mooney gregwork: have you tried setting img_hide_hypervisor_id
17:36:47 sean-k-mooney in the image to yes
17:37:05 gregwork do you know if a certain hat wearing vendor backported that to their queens release
17:37:26 sean-k-mooney i could check
17:37:35 sean-k-mooney but not off the top of my head
17:37:51 sean-k-mooney the image property woudl not be backportable due to object changes
17:38:03 sean-k-mooney but i belive you can also contol the behavior via the flavor
17:38:14 sean-k-mooney the flavor extra spec would be backportable
17:38:21 sean-k-mooney downstream
17:40:34 sean-k-mooney it looks like the kvm supprot is ther for linux guests
17:40:44 sean-k-mooney which means the image property should be there
17:41:13 sean-k-mooney but the support for windows guest has not been backported
17:41:38 sean-k-mooney http://paste.openstack.org/show/779253/
17:41:54 sean-k-mooney gregwork: ^ that is the downstream code for generating the elements
17:49:49 sean-k-mooney gregwork: assuming you or one of your customers are a customer of said company have you filed a Bugzilla ro case to request the feature backport.
17:50:13 gregwork im initially trying to figure out if this was a thing accomplished another way
17:50:30 mriedem sean-k-mooney: if you're around i think we're waiting on an ack from you for https://review.opendev.org/#/c/683437/
17:50:32 sean-k-mooney gregwork: im not committing to it being granted but in principal i belive this would be a minimal risk
17:51:24 sean-k-mooney mriedem: strictly speaking its my birthday and im off but yes im waiting for windows updates to install so if have a few minutes
17:51:40 gregwork sean-k-mooney: happy bday sean :)
17:51:59 sean-k-mooney thanks you :)
17:52:18 gregwork i think i spoke to you here a few years about getting dpdk working with mellanox cards
17:52:21 gregwork your nic is familiar
17:52:27 gregwork *nick
17:52:43 sean-k-mooney yes we have spoken before
17:52:57 sean-k-mooney an ya i used to work with dpdk alot
17:53:08 sean-k-mooney im hopeing to get a dpdk gate job running soon
17:53:34 gregwork are you still with intel
17:53:57 sean-k-mooney no i moved to redhat about 14 months ago
17:54:14 sean-k-mooney hence why i was able to check the OSP downstream code
17:54:24 gregwork oh i just figured you were more in the know
17:54:46 gregwork that link you posted, was that for osp 15 ?
17:55:01 sean-k-mooney no it was osp 13 which is queens

Earlier   Later