Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2019-08-27
15:31:53 dansmith artom: I assume you have russian mob connections
15:32:03 artom dansmith, I like to pretend I do :)
15:32:25 bauzas sean-k-mooney: honestly, I don't want to overthink this :p
15:32:49 bauzas itertools.chain() is cool with me
15:32:56 sean-k-mooney neither do i but i want something that will merge without me haveing to keep rewriting it
15:33:14 bauzas sean-k-mooney: because of the unpredictability of the dict ordering ?
15:33:14 sean-k-mooney ok
15:33:23 stephenfin bauzas: RE: https://review.opendev.org/#/c/674894/11/, will I just generate a stub 'RequestSpec' for the 'resources_from_flavor' caller?
15:33:38 stephenfin as in to address https://review.opendev.org/#/c/674894/11/nova/scheduler/utils.py@393
15:33:40 bauzas sean-k-mooney: there are ways to predict a dict ordering but whatever
15:33:41 sean-k-mooney no this is the 4 way i have done this
15:33:50 sean-k-mooney in in those pathces
15:33:55 bauzas stephenfin: yeah, I think it would be fine
15:34:03 stephenfin (y)
15:34:17 sean-k-mooney bauzas: it is noting to do with dict ordering
15:34:29 sean-k-mooney that was just a side effect of how i wrote the tests
15:34:29 bauzas stephenfin: I was cool with (flavor, image) as parameters
15:34:42 bauzas stephenfin: but is_bfv really did hurt my guts :p
15:34:56 bauzas sean-k-mooney: ok
15:35:50 stephenfin understandable :)
15:37:41 openstackgerrit Merged openstack/nova stable/stein: lxc: make use of filter python3 compatible https://review.opendev.org/676496
15:37:49 openstackgerrit Merged openstack/nova stable/stein: Add an issue releasenote for placement eventlet stall https://review.opendev.org/676973
15:45:51 openstackgerrit Artom Lifshitz proposed openstack/nova master: DNM: Run LM integration tests with NUMA flavor https://review.opendev.org/678887
15:46:06 artom I'm pretty sure ^^ is entirely broken, but it's a first step
15:48:20 dansmith artom: seems plausible
15:50:00 sean-k-mooney artom: that will fail because we dont have nested verit or a new enough qemu to enable the mttcg backend
15:50:20 artom sean-k-mooney, I thought vexxhost enabled that?
15:50:44 sean-k-mooney they do
15:50:53 sean-k-mooney did you change the nodeset to the vexxhost one
15:51:06 artom ... no :(
15:51:15 sean-k-mooney it could land on vexhost still
15:51:17 sean-k-mooney and pass
15:51:26 sean-k-mooney actuly it will still fail
15:51:34 sean-k-mooney we disable kvm in the gate too
15:51:48 sean-k-mooney you would have to change the node set and then set the virt type to kvm
15:51:53 sean-k-mooney then it should work
15:53:39 dansmith sean-k-mooney: why will it fail without kvm? is it because the host will have no numa info so we'll fail to schedule anything?
15:54:37 sean-k-mooney no it fails becasue when we set hw:numa_node=1 we pin the guest cpus to float over just 1 host numa node
15:54:59 sean-k-mooney we do that using the vcpupin element instad of the cpuset attibute on the vcpu element
15:55:22 sean-k-mooney the vcpupin element which does per core pinning is only supported with kvm or the mttcg backend
15:55:51 dansmith ah okay
15:56:17 sean-k-mooney the normal tsg backend that qemu ueses only support pinning via the <vcpu cpuset=""> method
15:56:45 sean-k-mooney so in pricaipal there is no reason it cant work just the way we generate the xml breaks it
15:57:13 sean-k-mooney or use a newer qemu/libvirt
15:57:33 sean-k-mooney i belive the one in fedroa 31 will be new enough by defualt
15:57:50 sean-k-mooney f29 and i think f30 still need the virt preview repo enabeld
15:58:17 dansmith sean-k-mooney: maybe you could fix up that patch for artom to do whatever it is that needs doing?
15:59:19 sean-k-mooney i can try yes
15:59:25 sean-k-mooney i also need to fix https://review.opendev.org/#/c/652197/
15:59:33 sean-k-mooney that is my upstream nfv job
16:00:05 sean-k-mooney it uses the really new qemu form the virt preview repo but devstack/zuul jobs move a file or change the permisions
16:00:11 sean-k-mooney so its currenly broken
16:00:43 sean-k-mooney you can see i was testing hugepage + numa + pinning in the gate
16:00:45 sean-k-mooney https://review.opendev.org/#/c/652197/18/playbooks/nfv/nfv.yaml
16:01:51 sean-k-mooney if i can get that working again we can test artoms live migration stuff in the gate and stephenfin cpu pinning spec
16:03:23 sean-k-mooney The destination directory (/opt/stack/devstack) is not writable by the current user. Error was: [Errno 13] Permission denied
16:03:38 sean-k-mooney artom: is it /opt/stack/new/devstack?
16:05:17 artom sean-k-mooney, at this point, whatever's quicker/more demonstrative
16:05:50 sean-k-mooney i think if i jsut add "become: yes" to my patch it might work
16:05:51 openstackgerrit Stephen Finucane proposed openstack/nova master: scheduler: Flatten 'ResourceRequest.from_extra_specs', 'from_image_props' https://review.opendev.org/674894
16:05:51 openstackgerrit Stephen Finucane proposed openstack/nova master: Remove 'hw:cpu_policy', 'hw:mem_page_size' extra specs from API samples https://review.opendev.org/675338
16:05:52 openstackgerrit Stephen Finucane proposed openstack/nova master: libvirt: Start reporting PCPU inventory to placement https://review.opendev.org/671793
16:05:52 openstackgerrit Stephen Finucane proposed openstack/nova master: libvirt: '_get_(v|p)cpu_total' to '_get_(v|p)cpu_available' https://review.opendev.org/672693
16:05:53 openstackgerrit Stephen Finucane proposed openstack/nova master: trivial: Rewrap definitions of 'NUMACell' https://review.opendev.org/674395
16:05:53 openstackgerrit Stephen Finucane proposed openstack/nova master: hardware: Differentiate between shared and dedicated CPUs https://review.opendev.org/671800
16:05:54 openstackgerrit Stephen Finucane proposed openstack/nova master: objects: Rename 'fields' import to 'obj_fields' https://review.opendev.org/674103
16:05:54 openstackgerrit Stephen Finucane proposed openstack/nova master: libvirt: Start reporting 'HW_CPU_HYPERTHREADING' trait https://review.opendev.org/675571
16:05:55 openstackgerrit Stephen Finucane proposed openstack/nova master: libvirt: Simplify 'fakelibvirt.HostInfo' object https://review.opendev.org/678861
16:05:55 openstackgerrit Stephen Finucane proposed openstack/nova master: Add support for translating CPU policy extra specs, image meta https://review.opendev.org/671801
16:05:56 openstackgerrit Stephen Finucane proposed openstack/nova master: libvirt: Fold in argument to '_update_provider_tree_for_vgpu' https://review.opendev.org/676729
16:05:56 openstackgerrit Stephen Finucane proposed openstack/nova master: Add reshaper for PCPU https://review.opendev.org/674895
16:05:57 sean-k-mooney ill do that and then look at yours
16:06:14 openstackgerrit Artom Lifshitz proposed openstack/nova master: DNM: Run LM integration tests with NUMA flavor https://review.opendev.org/678887
16:08:14 openstackgerrit sean mooney proposed openstack/nova master: Libvirt: report storage bus traits https://review.opendev.org/666914
16:08:15 openstackgerrit sean mooney proposed openstack/nova master: libvirt: use domain capabilities to get supported device models https://review.opendev.org/666915
16:08:15 openstackgerrit sean mooney proposed openstack/nova master: Add transform_image_metadata request filter https://review.opendev.org/665775
16:09:54 mriedem sean-k-mooney: we can override the virt_type in local.conf for the job to use kvm
16:10:04 mriedem since this is a hack test patch anyway
16:10:07 sean-k-mooney yes we can
16:11:24 sean-k-mooney artom: i think the nodeset you want is ubuntu-bionic-vexxhost but i need to double check
16:11:44 artom sean-k-mooney, yeah, I'm going in completely blind and relying on the gate to tell me what's wrong
16:11:50 artom So that's entirely possible
16:11:54 openstackgerrit Matt Riedemann proposed openstack/nova master: DNM: Run LM integration tests with NUMA flavor https://review.opendev.org/678887
16:11:57 sean-k-mooney you use it like this
16:11:59 sean-k-mooney https://opendev.org/openstack/magnum/src/branch/master/.zuul.yaml#L152-L158
16:12:24 artom mriedem, *tips fedora* your help is appreciated
16:13:33 sean-k-mooney do you want to test master our your change?
16:17:07 openstackgerrit sean mooney proposed openstack/nova master: Libvirt: add nfv job https://review.opendev.org/652197
16:17:43 sean-k-mooney i think ^ will fix my nfv job
16:19:16 sean-k-mooney the multi node version of that enable live migration alther i might need to add the flag to allow that
16:25:02 openstackgerrit sean mooney proposed openstack/nova master: Libvirt: add nfv job https://review.opendev.org/652197
16:36:10 openstackgerrit Stephen Finucane proposed openstack/nova master: Add support for translating CPU policy extra specs, image meta https://review.opendev.org/671801
16:36:11 openstackgerrit Stephen Finucane proposed openstack/nova master: libvirt: Fold in argument to '_update_provider_tree_for_vgpu' https://review.opendev.org/676729
16:36:11 openstackgerrit Stephen Finucane proposed openstack/nova master: Add reshaper for PCPU https://review.opendev.org/674895
16:36:12 openstackgerrit Stephen Finucane proposed openstack/nova master: libvirt: Start checking compute usage in functional tests https://review.opendev.org/678902
16:37:03 stephenfin bauzas: fwiw, I think I've everything in https://review.opendev.org/674894 resolved if you wanted to take another look
16:37:19 stephenfin I, however, am out of here o/
16:39:28 openstackgerrit sean mooney proposed openstack/nova master: DNM: Run LM integration tests with NUMA flavor https://review.opendev.org/678887
16:39:34 sean-k-mooney artom: mriedem dansmith i think ^ will fix it
16:45:46 efried stephenfin: you still around?

Earlier   Later