| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-12-17 | |||
| 10:59:21 | sean-k-mooney | im not talking about the alias | |
| 10:59:38 | sean-k-mooney | im talking about the whitelist where we support devname for nics e.g. eht1 | |
| 10:59:43 | sean-k-mooney | eth1 | |
| 10:59:50 | zigo | We don't do SR-IOV yet. | |
| 11:00:01 | zigo | Just GPUs... | |
| 11:00:47 | sean-k-mooney | vGPU or pci passthough | |
| 11:01:22 | sean-k-mooney | if your using pci passthough via the alias and pci whitelist that is most of the config for neutron sriov | |
| 11:01:50 | sean-k-mooney | well sriov is jsut a tech its not related to networkign some gpus supprot it too | |
| 11:02:22 | sean-k-mooney | e.g. you can create VF on some gpus and passthough those to the guest | |
| 11:02:29 | sean-k-mooney | instead of the PF | |
| 11:04:55 | zigo | sean-k-mooney: Maybe for later, I'll implement it then... Thanks for the details! | |
| 11:05:42 | sean-k-mooney | no worries i just want to make sure you dont implement someitng we want to remove and then have to deal with migratin users off the use of devname | |
| 11:05:49 | sean-k-mooney | in the pci whitelist | |
| 11:07:26 | openstackgerrit | Merged openstack/nova stable/queens: [stable-only] Cap bandit to 1.6.2 https://review.opendev.org/c/openstack/nova/+/767364 | |
| 11:47:52 | stephenfin | sean-k-mooney: fyi I closed this as WONTFIX https://bugs.launchpad.net/nova/+bug/1908507 | |
| 11:47:52 | openstack | Launchpad bug 1908507 in OpenStack Compute (nova) "vif quotas not set for tap interface" [Undecided,Won't fix] | |
| 11:48:00 | stephenfin | lemme know if you disagree | |
| 11:48:55 | sean-k-mooney | hum for calico that should technically work | |
| 11:49:32 | sean-k-mooney | i agree we are unlikely to fix it and they shoudl just use neutron qos | |
| 11:54:07 | openstackgerrit | Elod Illes proposed openstack/nova stable/rocky: [stable-only] Cap bandit to 1.6.2 https://review.opendev.org/c/openstack/nova/+/766492 | |
| 12:07:59 | elod | lyarwood, sorry, one more thing o:) the ussuri gate fixing patch looks good now... if you have a minute: https://review.opendev.org/c/openstack/nova/+/766738 | |
| 12:13:45 | lyarwood | elod: LGTM, could you +2/+W as I own it | |
| 12:14:12 | elod | lyarwood: ACK | |
| 12:23:24 | gibi | stephenfin: thanks for the lot of bugtriage the numbers now looks really good | |
| 12:23:35 | stephenfin | np | |
| 12:27:48 | gibi | I think we have an all time low untriaged bug count | |
| 12:27:56 | gibi | (all time low since I'm looking) | |
| 12:56:10 | Yumeng | hi gibi, good afternoon. | |
| 12:56:16 | gibi | Yumeng: hi | |
| 12:56:35 | Yumeng | are you almost in holiday? :) | |
| 12:57:32 | Yumeng | I saw nova is going to cancel the next two weekly meeting. | |
| 12:57:33 | gibi | I'm off from next week | |
| 12:57:46 | gibi | Yumeng: yes, today is the last meeting this yera | |
| 12:57:48 | gibi | year | |
| 12:58:12 | Yumeng | wow, sounds excited and happy. | |
| 12:58:54 | Yumeng | I'm gonna catch you to discuss vGPU before you off. lol | |
| 12:59:03 | gibi | OK | |
| 13:01:01 | Yumeng | current nova code has this to support get accel_info to resume guest state when a host is booted. https://review.opendev.org/c/openstack/nova/+/767273/1/nova/virt/libvirt/driver.py#3490 | |
| 13:01:45 | Yumeng | and your concern is if cyborg-agent service starts after nova-compute, nova can not get acc_info as expected,how should we solve this issue? | |
| 13:02:47 | sean-k-mooney | we shoudl not in nova, at least not entirely | |
| 13:03:15 | sean-k-mooney | the deployment tools shoudl use systemd before/after to order the service starts | |
| 13:03:30 | gibi | I guess we need to make clear in the doc that we have an service restart ordering dependency on cyborg | |
| 13:04:05 | gibi | other than that nova could simply fail to reboot those VMs during service startup that needs cyborg | |
| 13:04:05 | sean-k-mooney | well ideally the cyborg agent shoudl have a "before: nova-compute.service" requirement | |
| 13:04:10 | sean-k-mooney | not the other way around | |
| 13:04:44 | sean-k-mooney | gibi: well we can and should call cyborgs api and do the async wait for the arq bidnigns | |
| 13:05:13 | sean-k-mooney | if the agent comes online in that tiem and responds it would be fine but yes we coudl skip them if not | |
| 13:05:33 | sean-k-mooney | the resume guest on host reboot feature does not work unless you use system to force the ordering anyway | |
| 13:05:53 | sean-k-mooney | libvirtd and openvswitch for example both need to be started before nova-compute | |
| 13:06:03 | Yumeng | "the resume guest on host reboot feature does not work unless you use system to force the ordering anyway" +1 | |
| 13:06:13 | gibi | Today we don't do async in this code path | |
| 13:06:35 | gibi | at least nova.compute.manager.ComputeManager._get_accel_info does not do that | |
| 13:06:59 | sean-k-mooney | are we just getting the info or rebining on reboot | |
| 13:07:06 | gibi | just getting infor | |
| 13:07:13 | gibi | no rebind as far as I see | |
| 13:07:14 | sean-k-mooney | if its just getting the info there is no depenciy on the agent being running | |
| 13:07:26 | sean-k-mooney | that info shoudl come form the db | |
| 13:07:35 | gibi | yeah, good point | |
| 13:07:46 | sean-k-mooney | if we however need the agent to create mdevs | |
| 13:07:51 | gibi | but I'm not familiar with cyborg internal arch | |
| 13:07:55 | sean-k-mooney | for exampel then we cant use GET | |
| 13:08:35 | sean-k-mooney | or at least if we did we would need to have cyborg reflect the status fo the binding as not active or complete | |
| 13:08:50 | Yumeng | I think we need use GET and also the agent to create mdevs | |
| 13:08:59 | sean-k-mooney | then we coudl poll or better wait for the externa event form the agent to signal cojmplete of its startup | |
| 13:09:07 | sean-k-mooney | like we do for spawn | |
| 13:09:34 | sean-k-mooney | Yumeng: did we reject or at lest strong advise agaisnt makeing GET magic in the cyborg api | |
| 13:10:09 | sean-k-mooney | where it would cause the agent to reporvison the attemnet/device if the host restarted | |
| 13:11:05 | sean-k-mooney | Yumeng: i though we were goign to reflect the status in the db and have the agent automaticaly create the devices on start up and signle that its not finised provioning in the api via a status field | |
| 13:11:44 | sean-k-mooney | gibi: that is why i tought we were doing the async event waiting by the way ^ | |
| 13:12:09 | gibi | ack | |
| 13:13:41 | sean-k-mooney | Yumeng: if we allow GET on the bindings to change state it basically means that cyborg cannot support the READONLY api personces as part of the keyston RBAC/policys effort | |
| 13:14:06 | openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP db: Add machine_type to instance extras https://review.opendev.org/c/openstack/nova/+/767531 | |
| 13:14:06 | openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP objects: Add machine_type to instance https://review.opendev.org/c/openstack/nova/+/767532 | |
| 13:14:07 | openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP libvirt: Record the machine_type of instances during init_host https://review.opendev.org/c/openstack/nova/+/767533 | |
| 13:14:11 | lyarwood | gibi / sean-k-mooney / stephenfin ; http://paste.openstack.org/show/801124/ ^ I'm getting this on instance.save() and can't for the life of me work out why, any ideas? I think I'm missing something basic in the db layer. | |
| 13:15:01 | Yumeng | sean-k-mooney: nope. it is not allowed to change sate in GET | |
| 13:15:02 | lyarwood | I *think* instance_update_and_get_original is trying to update machine_type in the instance db for some reason | |
| 13:15:24 | brinzhang_ | gibi, sean-k-mooney: we found this issue from you comments in vGPU support spec, depends on the "resume_guests_state_on_host_boot=True" config | |
| 13:15:37 | brinzhang_ | https://review.opendev.org/c/openstack/nova-specs/+/750116/9/specs/wallaby/approved/support-vGPU-nova-cyborg-interaction.rst#183 | |
| 13:16:03 | sean-k-mooney | lyarwood: ill take a look but we shoudl not have a machine_type field. it is ment to be img_machine_type in the instance_system_metadata table | |
| 13:16:57 | Yumeng | sean-k-mooney: "the agent automaticaly create the devices on start up" Does this mean cyborg will need another periodic task to sync arq in db with mdevs in the sys path? | |
| 13:16:58 | sean-k-mooney | so "mapper.column_attrs[key], value" looks wrong to me | |
| 13:16:59 | lyarwood | sean-k-mooney: the above series adds machine_type as a field to the instance_extras table etc | |
| 13:17:22 | lyarwood | sean-k-mooney: I've just missed something somewhere leading to this error when I set it in the instance object and try to save | |
| 13:17:48 | sean-k-mooney | lyarwood right but you shoudl not be doing that | |
| 13:18:03 | sean-k-mooney | lyarwood: wasnt the plan to have no db migraiton requireed for this | |
| 13:18:15 | sean-k-mooney | that is what we dicussed at the ptg | |
| 13:19:05 | lyarwood | I think you suggested adding this to system metadata but I then said it may as well go into instance extras | |
| 13:19:17 | lyarwood | it's in the spec as an instance extra | |
| 13:19:22 | openstackgerrit | Elod Illes proposed openstack/nova stable/stein: [stable-only] Cap bandit to 1.6.2 https://review.opendev.org/c/openstack/nova/+/766487 | |
| 13:19:36 | sean-k-mooney | ok i think that is not the right way to do this | |
| 13:19:52 | sean-k-mooney | at least not as a general pattern if we are adding more fileds | |
| 13:20:01 | sean-k-mooney | which is why it wanted it in system metadata to begin with | |
| 13:20:19 | sean-k-mooney | since we will likely want to do this again going forward when we change defaults | |
| 13:20:39 | lyarwood | what's the issue with this being an instance extra? | |
| 13:21:00 | sean-k-mooney | it will require a new column and db migration for every filed for not real value | |
| 13:21:41 | sean-k-mooney | if we use system metadata we dont require either | |
| 13:22:02 | sean-k-mooney | its also where the image metadata is currently sotred | |
| 13:22:28 | sean-k-mooney | so if we recored itn in img_machine_type we dont need to update any code that currently uses it | |
| 13:22:50 | sean-k-mooney | that way we dont miss anythign and it minimsies the code changes | |