Earlier  
Posted Nick Remark
#openstack-nova - 2021-01-19
18:03:36 gmann dansmith: here https://github.com/openstack/tempest/blob/master/zuul.d/integrated-gate.yaml#L378
18:03:39 lyarwood I'm not sure that's the case
18:04:04 gmann sean-k-mooney: its not easy, legacy jobs were left to run on bionic and once they move to zuulv3 it will run on focal
18:04:19 gmann so how much work we need for Focal in devstack-gate is not known
18:04:28 sean-k-mooney gmann: devstack-gate basiclaly wraps devstack i dont think its actully executing os level commands
18:04:30 dansmith gmann: right that's where we inherit it from, correct? we have to do something in nova/.zuul to say "don't run this" ?
18:05:04 lyarwood FWIW I wanted to help move the multinode grenade job to zuulv3 once https://review.opendev.org/q/topic:%2522native-zuulv3-migration%2522+owner:lyarwood%2540redhat.com+status:open had landed for nova-live-migration-ceph
18:05:24 lyarwood ^ that's pretty much ready now I think, just needs core reviews in devstack, devstack-plugin-ceph and eventually nova.
18:05:25 gmann dansmith: i do not think there is a way to say "don't run this". we have to remove it from defined pipeline from template or explicitly added
18:06:04 dansmith gmann: ah, what if we set irrelevant files to "everything" ?
18:06:17 gmann lyarwood: yeah, I need to look into this patch to proceed further https://review.opendev.org/c/openstack/nova/+/742056
18:07:25 gmann dansmith: :) that is nice trick but let's remove it from template so that grenade testing can be added explicitly by projects with base or specific jobs
18:07:58 dansmith gmann: okay I just didn't want to mess with the base template and/or make everyone add grenade themselves
18:09:25 gmann dansmith: integrated-gate-compute is used by nova only so it is fine.
18:09:32 dansmith ah
18:09:56 gmann and we will keep it in integrated-gate so that it can used as complete set of integration + upgrade tests
18:10:07 dansmith oh I see, -compute
18:10:08 dansmith got it
18:10:23 dansmith gmann: I will propose and we can -W until we do the conversion
18:10:46 gmann yeah, i separated those template per integrated services so that we can do such type of optimization
18:10:52 gmann +1
18:11:01 dansmith gmann: you're smart :)
18:11:46 gmann otherwise nova and neutron use to get swift failure and cinder get neutron and vice versa
18:14:15 rouk 2.48 removed lots of kvm details (specifically memory) when standardizing diagnostics, i can get more detail by asking for 2.47, where are these details represented in 2.48+?
18:19:00 sean-k-mooney why are we altering the templates by the way.
18:19:20 sean-k-mooney given grenade and the multi node one are both listed in our .zuul.yaml in the check pipeline
18:19:45 sean-k-mooney https://github.com/openstack/nova/blob/master/.zuul.yaml#L443-L470
18:20:09 sean-k-mooney given noone else use integrated-gate-compute
18:20:22 sean-k-mooney im not sure moving grenade into that nessisarly helps
18:22:00 sean-k-mooney im not sure maintianing https://opendev.org/openstack/tempest/src/branch/master/zuul.d/integrated-gate.yaml#L369-L383 makes sense
18:22:22 sean-k-mooney at least im not sure it should live in tempest
18:22:52 gmann sean-k-mooney: it need to be at central place in QA side.
18:22:59 sean-k-mooney same for the other project for that matter
18:23:07 sean-k-mooney i dont really thing it does
18:23:37 gmann this can be extended in future to add slow test job too which is currently not separated out as such
18:24:10 sean-k-mooney it could but since we would want the project input when doing that
18:24:18 sean-k-mooney does it not make sense to defien it in the proejcts
18:24:52 gmann its both project and QA
18:25:45 sean-k-mooney right but it feels odd that tempest would reference any job not defiend in it in that template
18:27:28 sean-k-mooney gmann: if dansmith is ok with it i guess its fine it just feels odd that the qa team would be defining jobs that run against nova outside of the nova repo
18:27:43 dansmith tons of jobs are like that?
18:27:51 dansmith we define jobs other projects run
18:28:06 sean-k-mooney well i dont know tha tfeels more elective
18:28:19 sean-k-mooney i guess its just greneade the feels weried to me
18:28:22 sean-k-mooney i dotn know why
18:28:34 sean-k-mooney i know all the tox jobs work this way
18:28:53 sean-k-mooney i just wasnt expecting to see grenade in those templates
18:29:35 sean-k-mooney since that was managed in tree by project grenade supported
18:30:44 sean-k-mooney for example neutron https://github.com/openstack/neutron/blob/master/zuul.d/project.yaml#L21-L22
18:32:15 sean-k-mooney although they do not use integrated-gate-networking
18:33:41 sean-k-mooney gmann: ignore me ill get used to it
18:34:07 gmann neutron has done this changes due to the such optimization only like multiple grenade jobs running
18:34:23 gmann template help in long term when we extend it to cover the common things.
18:34:51 sean-k-mooney im not sure what else you would add
18:35:20 gmann slow job is one in list which should be optimize per integrated service and run on gate
18:35:38 sean-k-mooney if this was a PTI template or something sure but this partly feels like a resstion to defining everything in the project_config repo
18:35:39 gmann integrated-gate-compute does not cover all the tempest tests
18:35:58 sean-k-mooney gmann: yes but im not sure we want it too
18:36:14 sean-k-mooney if we did we would need to test multipel storage backend for example
18:36:15 gmann overall idea is have a common template which can cover all the related tests (which might be in different jobs due to requried configuration)
18:36:26 sean-k-mooney so we would need at least 2 jobs running full tempest
18:36:55 gmann 'full tempest' cannot be covered by two jobs. full name is confusing there always :)
18:37:33 sean-k-mooney no i meen we need two jobs running all tempest test with different config
18:38:17 sean-k-mooney for exmple nova libvirt backed has 3 ways to pass sotrage to a guest so if you wante test all 3 with live migraiton you need basially 2 jobs
18:38:43 sean-k-mooney one with lvm/iscis to test cinder voluems and block stoarge and one with ceph to test qemu driect connect
18:38:53 sean-k-mooney *qemu network stoage
18:39:16 sean-k-mooney we also have thigs liek multi cell
18:39:32 sean-k-mooney so if you want to test every thign in gate you have to run most of check again
18:40:32 sean-k-mooney personally i think the way we defien the jobs in the project repo today is better then trying to put service speicic repos in tempest
18:40:52 gmann sure, I mean all tempest tests at least with any one configuration.
18:41:30 gmann we have tests also in Tempest for 6 services so same way jobs. I feel that is easy to maintain and control also
18:42:18 gmann previously infra used to do that, maintain integrated template. and with migration to opendev it is more QA doing those jobs
18:43:31 sean-k-mooney right but i am not sure its adding much value currently at least for nova everythin in the template is also in our project config
18:43:59 sean-k-mooney if we removed - integrated-gate-compute template it would not change the runnign jobs at all
18:45:03 sean-k-mooney we overrite the jobs in repo anyway https://github.com/openstack/nova/blob/master/.zuul.yaml#L451-L471
18:45:11 sean-k-mooney https://github.com/openstack/nova/blob/master/.zuul.yaml#L497-L500
18:45:29 sean-k-mooney so we can pass our own irrelevant-files list
18:59:10 openstackgerrit Merged openstack/nova stable/train: Update pci stat pools based on PCI device changes https://review.opendev.org/c/openstack/nova/+/761725
19:55:23 openstackgerrit sean mooney proposed openstack/nova-specs master: libvirt: support vdpa kernel networking https://review.opendev.org/c/openstack/nova-specs/+/764999
19:59:25 sean-k-mooney artom: hopefully that adds what you wanted ^
20:00:10 sean-k-mooney gibi: stephenfin assuming artom is happy can ye rereivew tommorow
21:26:43 openstackgerrit Lee Yarwood proposed openstack/nova stable/victoria: compute: Lock by instance.uuid lock during swap_volume https://review.opendev.org/c/openstack/nova/+/758730
21:27:18 openstackgerrit Lee Yarwood proposed openstack/nova stable/stein: libvirt: Skip encryption metadata lookups if secret already exists on host https://review.opendev.org/c/openstack/nova/+/765772
21:27:36 openstackgerrit Lee Yarwood proposed openstack/nova stable/victoria: Use absolute path during qemu img rebase https://review.opendev.org/c/openstack/nova/+/757098
22:42:15 openstackgerrit Ghanshyam proposed openstack/nova master: DNM: Testing system scope in tempest https://review.opendev.org/c/openstack/nova/+/740124
#openstack-nova - 2021-01-20
07:07:01 openstackgerrit Hemanth N proposed openstack/nova stable/stein: Update pci stat pools based on PCI device changes https://review.opendev.org/c/openstack/nova/+/761727
08:49:45 openstackgerrit Brin Zhang proposed openstack/nova master: Replaces tenant_id with project_id from List SG API https://review.opendev.org/c/openstack/nova/+/766726
08:49:46 openstackgerrit Brin Zhang proposed openstack/nova master: Replaces tenant_id with project_id from List/Show usage APIs https://review.opendev.org/c/openstack/nova/+/768509
08:49:46 openstackgerrit Brin Zhang proposed openstack/nova master: Replaces tenant_id with project_id from Flavor Access APIs https://review.opendev.org/c/openstack/nova/+/767704
08:49:47 openstackgerrit Brin Zhang proposed openstack/nova master: Replace os-simple-tenant-usage with os-simple-project-usage https://review.opendev.org/c/openstack/nova/+/768852
08:49:47 openstackgerrit Brin Zhang proposed openstack/nova master: Replace tenants* with projects* of policies https://review.opendev.org/c/openstack/nova/+/765315
09:54:35 brinzhang stephenfin, gibi: there is a small change for the host.nodename, pls review, it's updated the sean-k-monney's comments in the shelve/unshelve patch https://review.opendev.org/c/openstack/nova/+/762499
10:09:22 stephenfin brinzhang: ack
10:10:18 stephenfin lyarwood: Does the 'nova server-migration-list' command only list *ongoing* migrations or does it list all migrations in the past?
10:10:21 stephenfin (I don't have a multi-node deployment or I'd test this myself)
10:10:48 stephenfin I tried to migrate a server on single node deployment, which justifiably failed, but it doesn't appear in that list
10:16:10 brinzhang stephenfin: thanks
10:16:50 lyarwood stephenfin: I think it's all
10:17:00 lyarwood stephenfin: I don't have an env to check
10:20:36 stephenfin Okay, I'll say all for the OSC docs so

Earlier   Later