| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-02-06 | |||
| 13:59:40 | efried | me? | |
| 13:59:56 | sean-k-mooney | you :) | |
| 14:00:37 | gibi | dansmith: I spent time on the selective refresh of instance.pci_requests based on obj_what_changes(), see the my stab at it here https://review.opendev.org/#/c/706269/1/nova/compute/manager.py@8566 and in the parent patches | |
| 14:02:22 | brinzhang | efried: yeah, but it's in two years ago :) | |
| 14:03:00 | efried | brinzhang: ping me after the nova meeting | |
| 14:04:07 | brinzhang | efried: ok, I am looking into the "def _check_filter_rules()", but cannot get some useful info, need some help :) | |
| 14:06:05 | efried | brinzhang: if this is a policy thing, I'm definitely not the best person to ask. Have you checked with gmann? | |
| 14:06:16 | efried | johnthetubaguy would also be a good resource if he's around... | |
| 14:14:56 | openstackgerrit | sean mooney proposed openstack/nova-specs master: move implemented spec for train https://review.opendev.org/706276 | |
| 14:18:46 | umbSublime | o/ | |
| 14:29:00 | dansmith | gibi_on_call: re: cyborg, know that I'm about +2 on the rest of the set aside from the second patch I've been deferring to efried on.. hopefully no major concerns as it's been a looong road :) | |
| 14:30:38 | bauzas | efried: you're always using this acronym : NTF | |
| 14:30:49 | bauzas | what's this ? | |
| 14:31:55 | efried | bauzas: NumaTopologyFilter, sorry | |
| 14:32:04 | bauzas | oh ah | |
| 14:32:08 | bauzas | gdi | |
| 14:32:12 | bauzas | thanks | |
| 14:38:31 | artom | stephenfin, cheers! I'll do a proper review soon | |
| 14:49:02 | bauzas | sean-k-mooney: question for you | |
| 14:49:28 | bauzas | sean-k-mooney: if I want 8VCPUs, 8GB of RAM and hw:numa_nodes=2 | |
| 14:49:35 | bauzas | does my memory split in twice ? | |
| 14:51:27 | sean-k-mooney | yes and if you cant devidie the vcpus and ram an integage number of times it raise an error | |
| 14:51:41 | sean-k-mooney | so if you didn 8VCPUs, 8GB of RAM and hw:numa_nodes=3 | |
| 14:52:04 | sean-k-mooney | then its an error unless you also use the other args for asymetric numa toplogies | |
| 14:52:24 | bauzas | what kind of error ? | |
| 14:54:00 | bauzas | sean-k-mooney: it only tells that it raises an exception in https://docs.openstack.org/nova/latest/user/flavors.html#extra-specs | |
| 14:54:30 | brinzhang | gmann: are you around? | |
| 14:55:28 | sean-k-mooney | yes it raise an exception and the vm goes to error state | |
| 14:56:10 | sean-k-mooney | bauzas: actully the vm wont go to error | |
| 14:56:22 | sean-k-mooney | it will rais the excptionin the api before we create teh vm db record | |
| 14:56:33 | bauzas | cool, that's what I hoped | |
| 14:56:37 | bauzas | a synchronous 40x | |
| 14:56:53 | sean-k-mooney | proably a 400 bad request | |
| 14:56:57 | bauzas | because we also need to make it for the translation mechanism | |
| 14:57:03 | bauzas | ideally, same exception | |
| 14:57:03 | sean-k-mooney | a 4xx for sure | |
| 14:57:30 | brinzhang | efried: how about now? :) | |
| 14:57:32 | sean-k-mooney | ya so this is all handeled in the hardware.py module | |
| 14:57:46 | sean-k-mooney | and its reused in several places | |
| 14:58:23 | efried | brinzhang: for which? The spec review? | |
| 14:58:56 | sean-k-mooney | bauzas: its all handeled by https://github.com/openstack/nova/blob/014c1ab864cec6213750c5ef57d8080ae8cd973d/nova/virt/hardware.py#L1742 | |
| 14:59:00 | brinzhang | efried: I added a new policy to the os-instance-action https://review.opendev.org/#/c/706179/2/nova/policies/instance_actions.py@27, but while run the unit test in cmd.test_policy, it was failed, and the "passing_rules " cannot get the new rule 'os_compute_api:os-instance-actions:show_details | |
| 14:59:24 | bauzas | sean-k-mooney: thanks, looking | |
| 14:59:38 | bauzas | okay, will look | |
| 14:59:54 | brinzhang | efried:https://github.com/openstack/nova/blob/master/nova/tests/unit/cmd/test_policy.py#L119 the check function is here | |
| 15:00:18 | Sundar | creating ARQs, etc. Do you agree? | |
| 15:00:18 | Sundar | efried, dansmith, sean-k-mooney: Re. https://review.opendev.org/#/c/631243/55/nova/accelerator/cyborg.py@86, I am adding checks for keystone exceptions here. However, if this 'get device profile' call fails, there will be no further calls to Cyborg for that instance. So, there is no point in adding redundant exception checks to other calls for | |
| 15:00:48 | sean-k-mooney | bauzas: the importnt bit for you is https://github.com/openstack/nova/blob/014c1ab864cec6213750c5ef57d8080ae8cd973d/nova/compute/api.py#L925 in _validate_and_build_base_options | |
| 15:01:15 | dansmith | Sundar: you should assume every call to another service could fail | |
| 15:01:29 | bauzas | sean-k-mooney: anyway, I'll write something in the spec and you'll chime in | |
| 15:01:54 | sean-k-mooney | bauzas: cool | |
| 15:01:54 | efried | brinzhang: I'm afraid I have no clue about this. I would have to dig in fresh, and I don't have time to do that right now. However, I think gmann might be able to address your questions much more easily. | |
| 15:02:06 | efried | brinzhang: not sure where he is... | |
| 15:02:25 | bauzas | basically, my concern is 'I want 8 vCPUs, 7GB of RAM and hw:numa_nodes=2', accordingly the RAM has to be provided by two different memory pages that are in each NUMA nodes | |
| 15:02:29 | bauzas | sean-k-mooney: ^ | |
| 15:02:54 | bauzas | meaning that the translation mechanism will split this memory amount in twice (or more) | |
| 15:02:58 | stephenfin | I want to use an unreleased feature in neutronclient in a nova patch. For 'Depends-On' to work, I need to to add 'python-neutronclient' to 'required-projects' in '.zuul.yaml', right? | |
| 15:03:02 | sean-k-mooney | ya you dont need to wory about that really | |
| 15:03:06 | brinzhang | efried: ok, I will wait him, and I pinged him another question too, I will wait for him ,thanks | |
| 15:03:34 | sean-k-mooney | if the requst_spec has a numa_toplogy objct its a numa instnace and all of that has already been calualted | |
| 15:03:41 | efried | bauzas: yes, that sounds correct to me | |
| 15:03:48 | sean-k-mooney | so you just need to read the value form the numa toplogy object | |
| 15:04:22 | efried | stephenfin: yes, that sounds correct. But we wouldn't want to merge that change. | |
| 15:04:28 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Use neutronclient's port binding APIs https://review.opendev.org/706295 | |
| 15:04:31 | stephenfin | efried: Yup, just a WIP for now | |
| 15:04:53 | efried | stephenfin: and that only works for zv3 jobs btw, not for legacy (IIUC) | |
| 15:04:59 | sean-k-mooney | Sundar: im goign to redeploy with the latest patches are they all updated | |
| 15:05:30 | Sundar | dansmith: Yes, but we are talking of failures like EndpointNotFound, MissingAuthPlugin, and Unauthorized. If the first call succeeds, is the second one going to fail for one of these reasons? | |
| 15:05:36 | sean-k-mooney | you said you tought i was using an old set of cybog pataches when you looked at the error i got on monday but that was the latest set that were up at that point | |
| 15:05:44 | Sundar | sean-k-mooney: Great, thanks | |
| 15:05:59 | dansmith | Sundar: no, this is a distributed system.. you should never make that assumption | |
| 15:06:17 | mriosfer | Sean: if host got two sockets , is recomended to "force" hw:numa_nodes=2 ? If vcpus are more 2 / 4 / 6 / 8 etc... | |
| 15:06:26 | efried | Sundar: If you wanted to trap those failures (you can use the superclass ClientException) and convert them to DeviceProfileError("Couldn't communicate with cyborg!") I think that would be okay. | |
| 15:06:42 | dansmith | Sundar: calls from nova to cyborg (and back) may be routed to different api endpoints on subsequent calls, in different states of broken, misconfigured, or transient upgrade | |
| 15:06:47 | openstackgerrit | Stephen Finucane proposed openstack/nova master: WIP: Use neutronclient's port binding APIs https://review.opendev.org/706295 | |
| 15:06:52 | sean-k-mooney | mriosfer: that depens on your workloads but i do for larger vms | |
| 15:06:54 | dansmith | efried: agreed | |
| 15:07:06 | stephenfin | kashyap: np, I figured it would just be easier do it myself real quick. No skin off my back | |
| 15:07:12 | mriosfer | Sean : larger VM from 8 vcpu? | |
| 15:07:15 | mriosfer | or more | |
| 15:07:25 | sean-k-mooney | for small vms of 4-8 CPUs i will often keep them with hw:numa_nodes=1 | |
| 15:07:39 | sean-k-mooney | ya over 8 i tend to always split | |
| 15:07:48 | openstackgerrit | Brian Rosmaita proposed openstack/nova master: Do not inherit cinder_ image properties https://review.opendev.org/706298 | |
| 15:07:49 | sean-k-mooney | to hw:numa_nodes=2 | |
| 15:08:04 | stephenfin | dansmith: That neutron fix yesterday was incomplete, btw. ralonsoh and I worked out the fix this morning if you care to look again https://review.opendev.org/#/c/706213/ | |
| 15:08:22 | dansmith | stephenfin: I'm reading now | |
| 15:08:26 | stephenfin | ta | |
| 15:08:52 | sean-k-mooney | but that is based on host core counts of 10-16 cores per socket. if you have 32 cores per socket then you might adjust what you consider big | |
| 15:08:57 | mtreinish | stephenfin: thanks for the reminder, I'll re-review that PR today or tomorrow | |
| 15:08:58 | dansmith | stephenfin: where is the code that actually uses this? | |
| 15:09:23 | stephenfin | dansmith: Just nova/api/openstack/compute/floating_ips.py | |
| 15:09:52 | dansmith | stephenfin: "port_details" is not in that file | |
| 15:10:00 | dansmith | do you mean it just passes through the structure to the api requester? | |
| 15:10:04 | Sundar | efried, dansmith: Got it. Yes, I would handle service failures in distributed systems in general. I asked because I don't see these specific checks everywhere e.g. https://github.com/openstack/nova/blob/master/nova/image/glance.py . But, I agree it is better to do it everywhere. | |
| 15:10:29 | stephenfin | dansmith: sure it is - line 40 | |
| 15:11:10 | mtreinish | stephenfin: the only thing is we're in prep for 3.0.0 (which removes 2.7). So that PR probably won't get released until then which we're shooting for mid-March | |
| 15:11:30 | dansmith | stephenfin: % grep -c port_details nova/api/openstack/compute/floating_ips.py | |
| 15:11:31 | dansmith | 0 | |
| 15:12:11 | stephenfin | dansmith: It's definitely there :) https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/floating_ips.py#L40 | |
| 15:12:34 | dansmith | oh is this a recent change? /me rebases | |