Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2019-09-09
14:53:56 mriedem i see there is a todo about it in https://docs.openstack.org/nova/latest/user/flavors.html?highlight=vcpu_pin_set
14:54:08 sean-k-mooney mriedem: ah ok its not documented upstream correct. it used to be documented in intels referece architecure as the way we advised people to partition cpu for the host/guest
14:54:47 openstackgerrit Stephen Finucane proposed openstack/nova master: Add reshaper for PCPU https://review.opendev.org/674895
14:55:24 sean-k-mooney mriedem: the behavior if you did not have them the same was that provide all the cores existed on the destinatinon, the migration would suceeed but the vm would use the wrong cores until it was hard rebooted
14:55:39 sean-k-mooney mriedem: if the core did not exist on the dest host then libvirt would reject the migration
14:55:59 sean-k-mooney so it was a self correcting problem once the guest hard rebooted
14:56:16 mriedem super
14:56:34 stephenfin mriedem: can we easily mutate policy in tests?
14:56:38 mriedem so tl;dr artom's series fixes that now so you don't have to have strict isolation and config in aggregates now?
14:56:41 mriedem stephenfin: yes
14:56:48 sean-k-mooney mriedem: yes
14:56:52 mriedem stephenfin: check functional tests thta use the PolicyFixture
14:56:57 stephenfin sweet. ta
14:57:05 artom mriedem, for that particular option, anyways
14:57:15 artom (vcpu_pin_set)
14:57:17 mriedem stephenfin: e.g. self.policy_fixture.set_rules({
14:57:17 mriedem servers_policies.ZERO_DISK_FLAVOR: base_policies.RULE_ADMIN_API},
14:57:17 mriedem overwrite=False)
14:58:39 shilpasd dansmith: yes cleared, will address for now 'complicated comment on the base patch'
14:59:11 dansmith heh okay
15:14:44 openstackgerrit Merged openstack/python-novaclient master: Microversion 2.78 - show server topology https://review.opendev.org/670790
15:15:41 sean-k-mooney artom: mriedem by the way we will need the <vcpu cpuset> xml update code for stephens pcup series too
15:16:16 sean-k-mooney so this is generally good to have anyway. it would be needed for non pinned guests when cpu_share_set is defiended
15:16:41 mriedem i don't really know anything about that series or how it's going to work but ok
15:16:53 sean-k-mooney *when cpu_shared_set is defined to different value on different hosts
15:17:37 sean-k-mooney mriedem: well we are just using cpu_shared_set instead of vcpu_pinned_set for the same behavior
15:17:52 sean-k-mooney e.g. defineing the set of core floating vms can float over
15:21:28 mriedem so do we expect instances using PCPU resources to be able to live migrate in Train with that series?
15:22:10 sean-k-mooney yes
15:22:57 sean-k-mooney if both seris merge we expect to be able to live migrate with PCPUs or VCPUs and have the xmls updated correctly in both cases
15:23:06 bauzas mriedem: this series will only support PCPU allocations once *all* computes are Train
15:23:22 sean-k-mooney mriedem: we defered instance have both pcpus and vcpus at the same time to U or later
15:23:27 bauzas mriedem: once the operator modifies an option
15:24:12 sean-k-mooney bauzas: correct. all of this is opt in. if you dont modify the configs for the PCPU seriese then you keep the old behavior
15:24:53 sean-k-mooney which is what we need for upgrades. and hopeful in U we can start enableing thing by defualt before removing the legacy options in V
15:25:10 mriedem bauzas: that wasn't what i asked
15:25:21 bauzas hum okay
15:26:03 sean-k-mooney bauzas: mriedem was asing will the numa migration feature wokr with instance that have PCPU allocations
15:26:12 sean-k-mooney *asking
15:26:14 bauzas ok
15:27:04 donnyd sean-k-mooney: just an FYI got an electrician out this weekend to do my standby generator. Which means power had to be shutdown for 8 hours.. which means FN was taken out of the pool on Saturday
15:28:01 artom sean-k-mooney, and it will? To me it seems like black magic that it would, but I guess it makes sense
15:28:11 donnyd So the NUMA job won't schedule until it comes back online. If I am really lucky the propane guy will be here today to finish up that install and then FN will be back online whether I have commercial power or not
15:28:25 artom NUMA LM just consumes _get_guest_numa_config, and then plays with the XML
15:28:43 mriedem sean-k-mooney: sort of, but without numa
15:29:15 sean-k-mooney donnyd: yep i saw the update on openstack infra
15:29:17 mriedem sean-k-mooney: since you said the pcpu stuff would need what artom is adding anyway, i was wondering if we expected instances with pcpu allocations to live migrate in train, not specific to numa though
15:29:41 mriedem b/c i think pcpu in train is already very risky, and trying to say that live migration would work for those as well was doubly risky
15:29:44 sean-k-mooney mriedem: all instance with pcpus have a numa toplogy
15:29:50 mriedem oh
15:30:22 sean-k-mooney hw:cpu_policy=dedicate create a numa toplogy of 1 the same as hw:numa_nodes=1
15:30:33 sean-k-mooney same with hw:mem_page_size set to anything
15:30:35 artom sean-k-mooney, I think he means stephenfin's new PCPU resource class
15:30:40 sean-k-mooney yep
15:30:55 sean-k-mooney the only thing that will use that are things with hw:cpu_policy=dedicated
15:30:59 artom Oh, right, that's how we end up with instances with that resource
15:31:02 mriedem hmm, is that just libvirt specific or actually codified into how the code outside of the driver works?
15:31:05 artom By doing anything NUMA-y
15:31:08 sean-k-mooney so all things with PCPUs will have numa
15:31:26 sean-k-mooney mriedem: technically just libvirt but no other dirver currely support pinning
15:31:58 sean-k-mooney mriedem: the api does not require the guest to have a numa toplogy of 1
15:32:05 sean-k-mooney so people should not rely on it
15:32:13 sean-k-mooney but that is what the only implmentaion does
15:34:32 stephenfin sean-k-mooney: bikeshedding time. I need a name for this variable https://review.opendev.org/#/c/674895/30/nova/virt/libvirt/driver.py@7439
15:35:01 stephenfin I can't use allocations because that conflicts with an existing variable, and instance_allocations doesn't work since we're tracking migrations for both instances and migration records
15:35:17 stephenfin instance_migration_allocations is too ugly
15:36:05 efried bad_allocs?
15:36:34 efried although 'bad' isn't really a good adjective for them, in instances_with_bad_allocations either.
15:37:05 stephenfin yeah, I've renamed the latter to 'allocations_needing_reshape'
15:37:07 efried but instances_with_allocations_that_need_to_be_reshaped is unwieldy, as I'm sure you realized while you were working on this.
15:38:11 efried stephenfin: btw, you've noticed there's a tox failure somewhere down the series yah?
15:38:25 stephenfin Damn. I had not
15:39:11 efried looks like https://review.opendev.org/#/c/680983/1
15:39:31 efried stephenfin: at least ^
15:40:12 artom stephenfin, "legacy_instances"?
15:40:32 stephenfin artom: The list also contains UUIDs of migration records
15:40:51 stephenfin so not quite right either
15:41:01 stephenfin think I'll just stick '_' at the end and be done :)
15:41:22 artom What, what are you trying to find a name for? instances_with_bad_allocations?
15:42:19 artom "legacy_consumers", then?
15:42:36 stephenfin oh, legacy_consumers it is
15:42:50 bauzas stephenfin: a bit late but I do propose 'consumer_allocations' for your naming bikeshed
15:45:20 artom mriedem, so, for my own information, did you get what you wanted out of sean-k-mooney, or do you need his "official" vote on that review?
15:46:00 bauzas stephenfin: looks like something is fscked up https://c4d77360c4f137c70770-625a0eb0440aa527fbdb216e8991f5a6.ssl.cf1.rackcdn.com/680108/4/check/openstack-tox-py27/2b51adb/testr_results.html.gz
15:47:09 bauzas stephenfin: I guess you have to modify the conf opt for vcpu_pin_set somewhere obviously :)
15:49:29 stephenfin bauzas: sec
15:49:48 openstackgerrit Stephen Finucane proposed openstack/nova master: Interim follow ups for cpu-resources series https://review.opendev.org/680983
15:49:48 openstackgerrit Stephen Finucane proposed openstack/nova master: Validate CPU config options against running instances https://review.opendev.org/680107
15:49:49 openstackgerrit Stephen Finucane proposed openstack/nova master: trivial: Use sane indent https://review.opendev.org/680229
15:49:49 openstackgerrit Stephen Finucane proposed openstack/nova master: objects: Add 'NUMACell.pcpuset' field https://review.opendev.org/680108
15:49:50 openstackgerrit Stephen Finucane proposed openstack/nova master: hardware: Differentiate between shared and dedicated CPUs https://review.opendev.org/671800
15:49:51 openstackgerrit Stephen Finucane proposed openstack/nova master: libvirt: Start reporting 'HW_CPU_HYPERTHREADING' trait https://review.opendev.org/675571
15:49:51 openstackgerrit Stephen Finucane proposed openstack/nova master: Add support for translating CPU policy extra specs, image meta https://review.opendev.org/671801
15:49:52 openstackgerrit Stephen Finucane proposed openstack/nova master: Add reshaper for PCPU https://review.opendev.org/674895
15:50:14 mriedem artom: i want an ack on the patch
15:50:23 mriedem to show he's actually looked at your code change
15:50:45 bauzas stephenfin: oh heh
15:52:55 artom mriedem, understood
15:54:27 bauzas gibi: still looking at the cpu-resource series but you're next :)
15:54:46 bauzas not sure I'll have time before EOB, but tomorrow you're up :)

Earlier   Later