Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2020-05-12
14:18:16 openstackgerrit Jiri Suchomel proposed openstack/nova-specs master: Add spec for downloading images via RBD https://review.opendev.org/572805
14:18:17 openstackgerrit Jiri Suchomel proposed openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD https://review.opendev.org/574301
14:32:06 dansmith jsuchome: +2 on the spec, thanks
14:32:47 jsuchome cool
14:48:22 jsuchome dansmith: two questions: 1. should I add that admin guide change into the same PS as the one with code or rather a new one? 2. where is that ceph CI job I should try to copy& adapt? (I've never done this part before)
14:48:50 dansmith jsuchome: no, do it in a separate patch please
14:49:32 dansmith jsuchome: I'm not super up on the state of the job (i.e. whether it's a legacy or converted job), nor where those bits live depending
14:49:36 dansmith but I bet sean-k-mooney knows
14:50:10 sean-k-mooney which job
14:50:12 sean-k-mooney ceph
14:50:32 sean-k-mooney i think its converted but ill check
14:51:53 openstackgerrit Ghanshyam Mann proposed openstack/python-novaclient master: Bump hacking min version to 3.0.1 https://review.opendev.org/727214
14:52:18 sean-k-mooney devstack-plugin-ceph-tempest-py3 i think is a zullv3 job. we are not defining any legacy playbooks for ti but it comes form devstack not zuul config
14:52:19 dansmith sean-k-mooney: jsuchome needs to take that job, tweak the config on the compute node slightly, and get a one-off run of it at least
14:52:54 sean-k-mooney dansmith: ah ok ill jsut triple check that its zuulv3 if so that is simpel to do
14:54:15 gmann that is zuulv3, derived from tempest-full-py3.
14:54:16 lyarwood https://review.opendev.org/#/c/708038/ is an example of me messing around with the ceph job recently
14:54:26 sean-k-mooney yep its zuul v3 https://github.com/openstack/devstack-plugin-ceph/blob/master/.zuul.yaml#L57-L130
14:55:04 sean-k-mooney jsuchome: what sepcfically do you need to add
14:55:49 dansmith lyarwood: ah nice
14:56:15 dansmith might need a DNM change against devstack to hack the half behavior into place and then control it with something like lyarwood's example
14:56:48 sean-k-mooney dansmith: you should not need too you can create a job that uses it as a parrent and then add your changes
14:56:51 dansmith sean-k-mooney: he needs to set up all the ceph stuff, but configure the compute to *not* use rbd backend, and have a new conf option set to enable direct-from-ceph download
14:57:44 sean-k-mooney so jsuchome just need to override the imagebackend in the nova.conf to be qcow2
14:57:45 dansmith sean-k-mooney: depends on how the ceph bit works in devstack right? in lyarwood's example above, he had https://review.opendev.org/#/c/708035/ for that reason I think
14:58:14 sean-k-mooney e.g. lev devstack and the plugin do its thing but just tell nova not to use it
14:58:21 dansmith sean-k-mooney: probably enough, as long as that sticks and devstack or something downstream doesn't override
14:58:36 sean-k-mooney ceph is set up by https://github.com/openstack/devstack-plugin-ceph
14:58:49 sean-k-mooney but if jsuchome does something like https://review.opendev.org/#/c/724387/3/.zuul.yaml
14:59:30 sean-k-mooney which is using the local.conf [[post-config:/etc/nova/nova.conf]] mechanism to set config options that will run after the plugin
14:59:36 dansmith sean-k-mooney: will that override what the plugin does?
15:00:13 sean-k-mooney ya i belive the order is intree modules then plugins then post-config form local.conf
15:00:17 lyarwood wait, to disable ceph on Nova that plugin has a few variables you can set in the job
15:00:24 lyarwood ENABLE_CEPH_NOVA=false etc iirc
15:00:39 sean-k-mooney that would deploy it for cinder only then?
15:00:46 lyarwood glance etc
15:00:46 sean-k-mooney or glance i guess
15:00:53 lyarwood I think that's the point of this test
15:01:06 dansmith needs to be set for glance, yeah
15:01:06 lyarwood but that might be missing the required creds to download over RBD that I assume is the point here
15:01:08 sean-k-mooney ya so that sound like it would work
15:01:10 dansmith right
15:01:21 dansmith he still needs all the regular rbd config, just not the imagebackend part
15:02:07 sean-k-mooney ya so basicaly what lyarwood example is doing is exactly what needs to be done.
15:02:12 dansmith yup
15:02:19 sean-k-mooney is jsuchome about
15:02:37 sean-k-mooney if not i can submit a ptach that does that but i dont know what to put it on top
15:02:54 dansmith hang on
15:03:04 jsuchome sean-k-mooney: tweak few options, mostly for nova and one for glance
15:03:26 dansmith sean-k-mooney: https://review.opendev.org/#/c/574301/
15:03:29 jsuchome (sorry I wasn't following for a while)
15:04:14 sean-k-mooney clip notes the devstack-ceph plugin has an env varible that you can set to disable just the nova change it does
15:04:25 sean-k-mooney so you can have it deploy cpeh for just glance and cinder
15:05:02 sean-k-mooney so that should be easy to do im not sure what else you need to set but there is a simple way to set config options we can use
15:05:35 sean-k-mooney if you need to do something more involved then you need to use a pre playbook to configure the jobs properly or a local.sh script
15:06:35 jsuchome I think I need to test if nova correctly downloads image and spawns VM, and I need ceph as glance backend, and few options for glance and nova set for that
15:07:21 dansmith jsuchome: what I'm asking for is to just configure fordirect download, make sure tempest runs normally, and ten we can look at the logs to convince ourselves that it's working
15:07:23 sean-k-mooney ok ill put up a DNM patch that disablel the unnned jobs and just disables using ceph for nova
15:07:28 sean-k-mooney then we can tweak that
15:07:35 dansmith jsuchome: not a direct test that confirms it was somehow downloaded direct -- that would be very hard
15:08:18 jsuchome true, tempest run should indeed be enough
15:08:37 dansmith (and logs)
15:08:57 dansmith jsuchome: if you think that you need to add some logs to be able to validate it from the outside, you should go ahead and do that
15:09:24 dansmith jsuchome: perhaps a LOG.debug('Downloading %(image)s from per-scheme handler %(handler)s') that we can look for
15:11:10 jsuchome There's already "Successfully transferred using rbd" log line
15:11:21 dansmith okay cool
15:11:26 jsuchome LOG.info I beleive
15:12:08 dansmith jsuchome: ah you mean the "attempting to export" one
15:12:17 dansmith oh, no,
15:12:20 dansmith I see that one too
15:12:26 dansmith okay cool, should be covered and easy to validate
15:17:25 openstackgerrit Takashi Natsume proposed openstack/nova master: Remove six.moves https://review.opendev.org/727224
15:18:12 lyarwood jsuchome / sean-k-mooney ; https://review.opendev.org/727225 might work
15:18:16 sean-k-mooney dansmith: so before i push this
15:18:31 lyarwood ah sorry you're also working on it
15:18:34 lyarwood I didn't think you were
15:18:49 sean-k-mooney that is updating the plugin
15:18:59 sean-k-mooney im working on a patch to do it for nova
15:19:17 lyarwood it's the same either way
15:19:19 sean-k-mooney did you need to make those nova con changes too
15:19:31 lyarwood well no, you'd just use the job in Nova
15:19:41 lyarwood this change already pulls in the Nova changes
15:19:45 dansmith jsuchome: I dunno where you got so much karma, but enjoy this overly exuberant clamor to help while you can :D
15:20:05 lyarwood I'm just trying to hack around with zuul as much as I can at the moment
15:20:25 lyarwood I've still got the live migrastion job migration to zuulv3 in my backlog
15:20:29 lyarwood migration*
15:20:56 tosky lyarwood: is there something specific in that job compared to a "usual" devstack job? Maybe I can help
15:21:23 lyarwood tosky: the LM jobs?
15:21:50 tosky lyarwood: that one (and in general any job that requires to move from legacy to native zuulv3)
15:23:16 lyarwood tosky: http://lists.openstack.org/pipermail/openstack-discuss/2020-March/013207.html covers some of it, it's currently three jobs in one
15:23:51 lyarwood tosky: I ran out of time in U to break things up but feel free to poke the changes early in V if you have time before I get around to it
15:24:54 tosky lyarwood: sure - I will ping everyone with pending legacy jobs as part of the work on the community goal
15:25:09 openstackgerrit sean mooney proposed openstack/nova master: [DNM] ceph direct download testing https://review.opendev.org/727228
15:25:29 sean-k-mooney ok well that is just push to have it there. it will do the excat same thing as lyarwood version
15:25:40 sean-k-mooney its just in nova rather then the devstack plugin
15:26:54 lyarwood tosky: ack understood thanks :)
15:31:13 jsuchome lyarwood: sean-k-mooney: thanks a lot ... so, where exactly do I set those nova+glance config values? under $NOVA_CPU_CONF for nova? And the one for glance?
15:32:49 openstackgerrit Jiri Suchomel proposed openstack/nova-specs master: Add spec for downloading images via RBD https://review.opendev.org/572805
15:35:49 lyarwood jsuchome: glance should be configured automatically, we only had to add the two specific configurables your change is using in Nova as we disabled the configuration of Nova by the ceph devstack plugin.
15:36:57 lyarwood just corrected a mistake in my change, I'll check back in on it later.

Earlier   Later