| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-05-17 | |||
| 13:32:19 | openstackgerrit | sahid proposed openstack/nova master: libvirt: Improve 'qemu-img convert' performance https://review.openstack.org/522067 | |
| 13:33:27 | belmoreira | mriedem If "colour" is a property that we would like to consider during scheduling how this should be defined? | |
| 13:36:29 | dansmith | belmoreira: a property of what? | |
| 13:37:16 | mriedem | Kevin_Zheng: we do'nt need to do that | |
| 13:37:24 | mriedem | Kevin_Zheng: https://review.openstack.org/569112 | |
| 13:37:38 | mriedem | dansmith: of the compute node, | |
| 13:37:49 | mriedem | he wants to put a custom resource class or trait on the compute node resource provider | |
| 13:37:58 | mriedem | belmoreira: traits-based scheduling | |
| 13:38:09 | dansmith | mriedem: ah | |
| 13:38:14 | mriedem | belmoreira: see required traits here https://docs.openstack.org/nova/latest/user/flavors.html#extra-specs | |
| 13:38:29 | mriedem | belmoreira: you put a trait on the compute node resource provider (via osc-placement or REST API or whatever) and then put that required trait in a flavor | |
| 13:38:36 | mriedem | and then that flavor must land on a compute node with that trait | |
| 13:39:34 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Make nova service-list use scatter-gather routine https://review.openstack.org/568271 | |
| 13:39:35 | belmoreira | mriedem: I understand that. What I was thinking is if the compute node can it self advertise the trait | |
| 13:39:52 | mriedem | belmoreira: as i said earlier, the compute node can report standard traits that it knows about, | |
| 13:40:04 | mriedem | for custom stuff, you can do that outside of nova-compute needing to report it for you by proxy | |
| 13:40:16 | Kevin_Zheng | mriedem: if that is the case, then most of the tests can be removed? | |
| 13:41:03 | efried | belmoreira: The virt driver can set any traits it wants. But one would have to make a case for a given trait being a sensible thing for the virt driver to set. | |
| 13:41:31 | mriedem | Kevin_Zheng: i'm starting small | |
| 13:41:38 | openstackgerrit | sahid proposed openstack/os-vif stable/pike: ovs-hybrid: should permanently keep MAC entries https://review.openstack.org/505731 | |
| 13:41:58 | belmoreira | the use case is when deploying a set of nodes with different custom traits all of this needs to be setup up using tha placement api. It would be easier to include them in a nova config option. This case is much easier to handle with a configuration management tool | |
| 13:42:21 | Kevin_Zheng | mriedem: :) | |
| 13:42:28 | efried | belmoreira: In Dublin we agreed that there would be a certain set of traits that the compute service "owns" - has the authority to set/unset on the providers it owns - and anything outside of that circle could be set externally via direct placement API access (via osc or whatever). | |
| 13:43:32 | belmoreira | efried mriedem thanks for the clarification | |
| 13:43:50 | efried | belmoreira: You're suggesting a config option like | |
| 13:43:50 | efried | compute_provider_additional_traits = CUSTOM_FOO, CUSTOM_BAR | |
| 13:43:50 | efried | ? | |
| 13:44:06 | mriedem | yes, and i don't think we should do that | |
| 13:44:07 | belmoreira | efried yes | |
| 13:44:10 | dansmith | you'd have to have a negative as well so you could ever remove traits you had previously set | |
| 13:44:13 | mriedem | it makes nova a proxy, | |
| 13:44:15 | dansmith | mriedem: agree | |
| 13:44:23 | mriedem | and blocks everyone on nova supporting this thing | |
| 13:44:28 | mriedem | when you can already do it external to nova | |
| 13:44:34 | efried | belmoreira: yes, I agree with mriedem and dansmith. | |
| 13:44:47 | mriedem | i already don't really care for the ironic trait proxy stuff we do | |
| 13:45:02 | belmoreira | my issue is how to manage all this things at scale | |
| 13:45:28 | efried | belmoreira: You would be editing config files, one per host, in any case. | |
| 13:45:40 | mriedem | your config mgmt tool is already doing the logic to put the custom traits in the specific compute host config file yes? | |
| 13:45:41 | efried | belmoreira: Rather than doing that, run a placement CLI once per host. | |
| 13:45:47 | belmoreira | a configuration management tool doing API calls doesn't looks good to me | |
| 13:45:56 | mriedem | why can't that same code just put the traits in placement once nova-compute is running and the rp is registered? | |
| 13:46:15 | mriedem | belmoreira: how do you create keystone endpoints? | |
| 13:46:25 | mriedem | and users/projects | |
| 13:46:38 | efried | Are you equating "API calls" with invoking CLIs? | |
| 13:47:07 | mriedem | openstack-ansible does all of this quite a bit i think | |
| 13:47:13 | mriedem | that's how they do the cells v2 setup | |
| 13:47:24 | mriedem | it's really the only way since we don't have rest apis for cell and host mappings | |
| 13:47:55 | belmoreira | mriedem is true for keystone. We built our own machinery to create/delete projects. And the experience is not great | |
| 13:49:36 | belmoreira | efried: no. The problem is given credentials to a configuration management tool to populate these properties | |
| 13:50:19 | belmoreira | changing configuration files is much easier and less worrying | |
| 13:54:20 | openstackgerrit | Matt Riedemann proposed openstack/osc-placement master: Fix error message asserts in functional test https://review.openstack.org/569048 | |
| 13:54:21 | openstackgerrit | Matt Riedemann proposed openstack/osc-placement master: Resource class set (v1.7) https://review.openstack.org/514644 | |
| 13:54:22 | openstackgerrit | Matt Riedemann proposed openstack/osc-placement master: Usages per project and user (v1.8, v1.9) https://review.openstack.org/514646 | |
| 13:54:23 | openstackgerrit | Matt Riedemann proposed openstack/osc-placement master: CLI allocation candidates (v1.10) https://review.openstack.org/514647 | |
| 13:54:24 | openstackgerrit | Matt Riedemann proposed openstack/osc-placement master: New dict format of allocations (v1.11, v1.12) https://review.openstack.org/542819 | |
| 13:54:25 | openstackgerrit | Matt Riedemann proposed openstack/osc-placement master: Transactionally update allocations (v1.13) https://review.openstack.org/546674 | |
| 13:54:26 | openstackgerrit | Matt Riedemann proposed openstack/osc-placement master: Add nested resource providers (v1.14) https://review.openstack.org/546675 | |
| 13:54:27 | openstackgerrit | Matt Riedemann proposed openstack/osc-placement master: Limit allocation candidates (v1.15, v1.16) https://review.openstack.org/548043 | |
| 13:54:28 | openstackgerrit | Matt Riedemann proposed openstack/osc-placement master: Allocation candidates parameter: required (v1.17) https://review.openstack.org/548326 | |
| 13:54:53 | mriedem | gibi: https://review.openstack.org/#/c/514644/ should be ready to go now | |
| 13:55:19 | openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: Add policy to InstanceGroup object and api models. https://review.openstack.org/563375 | |
| 13:55:20 | openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: Add policy field to ServerGroup notification object https://review.openstack.org/563401 | |
| 13:57:08 | gibi | mriedem: done | |
| 13:57:18 | mriedem | yay | |
| 13:57:58 | melwitt | nova meeting in 3 min | |
| 14:09:17 | openstackgerrit | Sylvain Bauza proposed openstack/nova-specs master: Proposes Multiple GPU types https://review.openstack.org/557065 | |
| 14:17:13 | mriedem | tssurya: check the max_attempts config option, if it's 1 then we shouldn't be calculating alternate hosts in the scheduler | |
| 14:17:23 | mriedem | and belmorei_ said in boston that cern doesn't do retries | |
| 14:17:41 | dansmith | mriedem: well, let me just hand you my thunder then | |
| 14:18:28 | mriedem | tssurya: dansmith reminded me that max_attempts=1 means no retries and dansmith reminded me that belmorei_ said in boston that cern doesn't do retries | |
| 14:18:40 | dansmith | haha | |
| 14:20:44 | belmorei_ | mriedem: correct :) we have max_attempts=1 | |
| 14:21:31 | dansmith | so if it's trying to get alternates in that case, it's probably a bug | |
| 14:22:28 | mriedem | yeah need to figure that part out, although i thought edleafe added unit tests for that scenario to assert that we didn't try calculating alternates if max_attempest=1 | |
| 14:22:36 | mriedem | tempest on the brain | |
| 14:23:01 | dansmith | ah, | |
| 14:23:08 | dansmith | max_attempts grabs one alternate it looks like | |
| 14:23:15 | dansmith | instead of max_attempts-1 ? | |
| 14:24:06 | dansmith | https://github.com/openstack/nova/blob/master/nova/scheduler/filter_scheduler.py#L161-L161 | |
| 14:24:16 | edleafe | num_alts = CONF.scheduler.max_attempts if return_alternates else 0 | |
| 14:24:36 | edleafe | so yeah, it will return 1 alternate with max_attempts=1 | |
| 14:24:52 | dansmith | which is wrong | |
| 14:25:20 | mriedem | arvindn05: how are you coming on that traits-in-images + rebuild patch? | |
| 14:25:38 | dansmith | we also would do too much extra work if num_alts is zero | |
| 14:26:06 | dansmith | belmorei_: tssurya: if you can confirm that with max_attempts the scheduler is asking for one extra alternate that would be good | |
| 14:26:29 | dansmith | would mean about an exact doubling of placement and filter load I guess | |
| 14:26:42 | mriedem | shouldn't be any more placement load, | |
| 14:26:44 | mriedem | just filtering | |
| 14:26:58 | mriedem | the alternates are pulled from the compute node list we get after placement allocation candidates are retrieved | |
| 14:26:59 | dansmith | it asks placement again doesn't it? | |
| 14:27:07 | mriedem | not for new allocation candidates | |
| 14:27:09 | edleafe | alternates only get re-filtered when building > 1 instance per request | |
| 14:27:10 | mriedem | or it shouldn't... | |
| 14:27:19 | belmorei_ | dansmith: will do | |
| 14:27:23 | dansmith | mriedem: okay | |
| 14:29:09 | mriedem | there are some unit tests setting max_attempts to 1 but i'm having a hard time seeing what they assert | |
| 14:29:28 | mriedem | probably just need a simple tests where max_attempts=1, single instance in the request, and make sure we don't mess with alternate calculation | |
| 14:29:34 | mriedem | *test | |
| 14:29:42 | openstackgerrit | Stephen Finucane proposed openstack/nova-specs master: Rename spec to match blueprint https://review.openstack.org/568870 | |