| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-05-12 | |||
| 14:50:10 | sean-k-mooney | which job | |
| 14:50:12 | sean-k-mooney | ceph | |
| 14:50:32 | sean-k-mooney | i think its converted but ill check | |
| 14:51:53 | openstackgerrit | Ghanshyam Mann proposed openstack/python-novaclient master: Bump hacking min version to 3.0.1 https://review.opendev.org/727214 | |
| 14:52:18 | sean-k-mooney | devstack-plugin-ceph-tempest-py3 i think is a zullv3 job. we are not defining any legacy playbooks for ti but it comes form devstack not zuul config | |
| 14:52:19 | dansmith | sean-k-mooney: jsuchome needs to take that job, tweak the config on the compute node slightly, and get a one-off run of it at least | |
| 14:52:54 | sean-k-mooney | dansmith: ah ok ill jsut triple check that its zuulv3 if so that is simpel to do | |
| 14:54:15 | gmann | that is zuulv3, derived from tempest-full-py3. | |
| 14:54:16 | lyarwood | https://review.opendev.org/#/c/708038/ is an example of me messing around with the ceph job recently | |
| 14:54:26 | sean-k-mooney | yep its zuul v3 https://github.com/openstack/devstack-plugin-ceph/blob/master/.zuul.yaml#L57-L130 | |
| 14:55:04 | sean-k-mooney | jsuchome: what sepcfically do you need to add | |
| 14:55:49 | dansmith | lyarwood: ah nice | |
| 14:56:15 | dansmith | might need a DNM change against devstack to hack the half behavior into place and then control it with something like lyarwood's example | |
| 14:56:48 | sean-k-mooney | dansmith: you should not need too you can create a job that uses it as a parrent and then add your changes | |
| 14:56:51 | dansmith | sean-k-mooney: he needs to set up all the ceph stuff, but configure the compute to *not* use rbd backend, and have a new conf option set to enable direct-from-ceph download | |
| 14:57:44 | sean-k-mooney | so jsuchome just need to override the imagebackend in the nova.conf to be qcow2 | |
| 14:57:45 | dansmith | sean-k-mooney: depends on how the ceph bit works in devstack right? in lyarwood's example above, he had https://review.opendev.org/#/c/708035/ for that reason I think | |
| 14:58:14 | sean-k-mooney | e.g. lev devstack and the plugin do its thing but just tell nova not to use it | |
| 14:58:21 | dansmith | sean-k-mooney: probably enough, as long as that sticks and devstack or something downstream doesn't override | |
| 14:58:36 | sean-k-mooney | ceph is set up by https://github.com/openstack/devstack-plugin-ceph | |
| 14:58:49 | sean-k-mooney | but if jsuchome does something like https://review.opendev.org/#/c/724387/3/.zuul.yaml | |
| 14:59:30 | sean-k-mooney | which is using the local.conf [[post-config:/etc/nova/nova.conf]] mechanism to set config options that will run after the plugin | |
| 14:59:36 | dansmith | sean-k-mooney: will that override what the plugin does? | |
| 15:00:13 | sean-k-mooney | ya i belive the order is intree modules then plugins then post-config form local.conf | |
| 15:00:17 | lyarwood | wait, to disable ceph on Nova that plugin has a few variables you can set in the job | |
| 15:00:24 | lyarwood | ENABLE_CEPH_NOVA=false etc iirc | |
| 15:00:39 | sean-k-mooney | that would deploy it for cinder only then? | |
| 15:00:46 | lyarwood | glance etc | |
| 15:00:46 | sean-k-mooney | or glance i guess | |
| 15:00:53 | lyarwood | I think that's the point of this test | |
| 15:01:06 | dansmith | needs to be set for glance, yeah | |
| 15:01:06 | lyarwood | but that might be missing the required creds to download over RBD that I assume is the point here | |
| 15:01:08 | sean-k-mooney | ya so that sound like it would work | |
| 15:01:10 | dansmith | right | |
| 15:01:21 | dansmith | he still needs all the regular rbd config, just not the imagebackend part | |
| 15:02:07 | sean-k-mooney | ya so basicaly what lyarwood example is doing is exactly what needs to be done. | |
| 15:02:12 | dansmith | yup | |
| 15:02:19 | sean-k-mooney | is jsuchome about | |
| 15:02:37 | sean-k-mooney | if not i can submit a ptach that does that but i dont know what to put it on top | |
| 15:02:54 | dansmith | hang on | |
| 15:03:04 | jsuchome | sean-k-mooney: tweak few options, mostly for nova and one for glance | |
| 15:03:26 | dansmith | sean-k-mooney: https://review.opendev.org/#/c/574301/ | |
| 15:03:29 | jsuchome | (sorry I wasn't following for a while) | |
| 15:04:14 | sean-k-mooney | clip notes the devstack-ceph plugin has an env varible that you can set to disable just the nova change it does | |
| 15:04:25 | sean-k-mooney | so you can have it deploy cpeh for just glance and cinder | |
| 15:05:02 | sean-k-mooney | so that should be easy to do im not sure what else you need to set but there is a simple way to set config options we can use | |
| 15:05:35 | sean-k-mooney | if you need to do something more involved then you need to use a pre playbook to configure the jobs properly or a local.sh script | |
| 15:06:35 | jsuchome | I think I need to test if nova correctly downloads image and spawns VM, and I need ceph as glance backend, and few options for glance and nova set for that | |
| 15:07:21 | dansmith | jsuchome: what I'm asking for is to just configure fordirect download, make sure tempest runs normally, and ten we can look at the logs to convince ourselves that it's working | |
| 15:07:23 | sean-k-mooney | ok ill put up a DNM patch that disablel the unnned jobs and just disables using ceph for nova | |
| 15:07:28 | sean-k-mooney | then we can tweak that | |
| 15:07:35 | dansmith | jsuchome: not a direct test that confirms it was somehow downloaded direct -- that would be very hard | |
| 15:08:18 | jsuchome | true, tempest run should indeed be enough | |
| 15:08:37 | dansmith | (and logs) | |
| 15:08:57 | dansmith | jsuchome: if you think that you need to add some logs to be able to validate it from the outside, you should go ahead and do that | |
| 15:09:24 | dansmith | jsuchome: perhaps a LOG.debug('Downloading %(image)s from per-scheme handler %(handler)s') that we can look for | |
| 15:11:10 | jsuchome | There's already "Successfully transferred using rbd" log line | |
| 15:11:21 | dansmith | okay cool | |
| 15:11:26 | jsuchome | LOG.info I beleive | |
| 15:12:08 | dansmith | jsuchome: ah you mean the "attempting to export" one | |
| 15:12:17 | dansmith | oh, no, | |
| 15:12:20 | dansmith | I see that one too | |
| 15:12:26 | dansmith | okay cool, should be covered and easy to validate | |
| 15:17:25 | openstackgerrit | Takashi Natsume proposed openstack/nova master: Remove six.moves https://review.opendev.org/727224 | |
| 15:18:12 | lyarwood | jsuchome / sean-k-mooney ; https://review.opendev.org/727225 might work | |
| 15:18:16 | sean-k-mooney | dansmith: so before i push this | |
| 15:18:31 | lyarwood | ah sorry you're also working on it | |
| 15:18:34 | lyarwood | I didn't think you were | |
| 15:18:49 | sean-k-mooney | that is updating the plugin | |
| 15:18:59 | sean-k-mooney | im working on a patch to do it for nova | |
| 15:19:17 | lyarwood | it's the same either way | |
| 15:19:19 | sean-k-mooney | did you need to make those nova con changes too | |
| 15:19:31 | lyarwood | well no, you'd just use the job in Nova | |
| 15:19:41 | lyarwood | this change already pulls in the Nova changes | |
| 15:19:45 | dansmith | jsuchome: I dunno where you got so much karma, but enjoy this overly exuberant clamor to help while you can :D | |
| 15:20:05 | lyarwood | I'm just trying to hack around with zuul as much as I can at the moment | |
| 15:20:25 | lyarwood | I've still got the live migrastion job migration to zuulv3 in my backlog | |
| 15:20:29 | lyarwood | migration* | |
| 15:20:56 | tosky | lyarwood: is there something specific in that job compared to a "usual" devstack job? Maybe I can help | |
| 15:21:23 | lyarwood | tosky: the LM jobs? | |
| 15:21:50 | tosky | lyarwood: that one (and in general any job that requires to move from legacy to native zuulv3) | |
| 15:23:16 | lyarwood | tosky: http://lists.openstack.org/pipermail/openstack-discuss/2020-March/013207.html covers some of it, it's currently three jobs in one | |
| 15:23:51 | lyarwood | tosky: I ran out of time in U to break things up but feel free to poke the changes early in V if you have time before I get around to it | |
| 15:24:54 | tosky | lyarwood: sure - I will ping everyone with pending legacy jobs as part of the work on the community goal | |
| 15:25:09 | openstackgerrit | sean mooney proposed openstack/nova master: [DNM] ceph direct download testing https://review.opendev.org/727228 | |
| 15:25:29 | sean-k-mooney | ok well that is just push to have it there. it will do the excat same thing as lyarwood version | |
| 15:25:40 | sean-k-mooney | its just in nova rather then the devstack plugin | |
| 15:26:54 | lyarwood | tosky: ack understood thanks :) | |
| 15:31:13 | jsuchome | lyarwood: sean-k-mooney: thanks a lot ... so, where exactly do I set those nova+glance config values? under $NOVA_CPU_CONF for nova? And the one for glance? | |
| 15:32:49 | openstackgerrit | Jiri Suchomel proposed openstack/nova-specs master: Add spec for downloading images via RBD https://review.opendev.org/572805 | |
| 15:35:49 | lyarwood | jsuchome: glance should be configured automatically, we only had to add the two specific configurables your change is using in Nova as we disabled the configuration of Nova by the ceph devstack plugin. | |
| 15:36:57 | lyarwood | just corrected a mistake in my change, I'll check back in on it later. | |
| 15:38:06 | jsuchome | lyarwood: for glance I need DEFAULT.show_image_direct_url=true, are you telling me this is set by default? | |
| 15:38:43 | sean-k-mooney | im not sure its in the base job | |
| 15:38:48 | sean-k-mooney | so we might need to set that | |
| 15:38:57 | jsuchome | that's what I would expect | |
| 15:38:58 | dansmith | jsuchome: I think it must be, otherwise nova wouldn't be able to tell that the image is in the same rbd it is configured for, with the rbd backend | |
| 15:39:31 | jsuchome | I see, so you mean it already _is_ default for ceph jobs? | |
| 15:39:33 | dansmith | i.e. we already look at the locations field of the image, that's what you need right? | |
| 15:39:36 | dansmith | jsuchome: I expect | |