Earlier  
Posted Nick Remark
#openstack-nova - 2017-07-17
19:51:33 mriedem just modify nova.conf
19:52:00 mriedem nova.conf can be totally blank and it won't override any defaults - the defaults are all in code
19:52:08 mriedem so if you want to override any defaults, it happens in nova.conf
19:52:25 mriedem nova_override.conf is probably some package-specific trick
19:52:33 Ctesias .....Oh.
19:52:46 Ctesias Well awesome. Thanks for your help, really
19:52:50 mriedem yw
19:52:51 Ctesias I've been pulling my hair out for days
20:00:12 openstackgerrit Matt Riedemann proposed openstack/nova master: Support tag instances when boot(4/4) https://review.openstack.org/469800
20:00:55 mriedem Kevin_Zheng: ^ fixed up the functional test failures; it was pretty simple but not obvious until i injected some debug code and ran the tests, and then also had to tweak the tests a bit
20:03:30 mriedem sdague: can you take a gander at ^ ? it's pretty straight-forward and well tested
20:05:49 openstackgerrit Matt Riedemann proposed openstack/nova master: Optimize creating servers with tags https://review.openstack.org/484170
20:06:38 sdague mriedem: I'll add it to the morning list
20:06:56 mriedem thanks - alex_xu might get it overnight then, he was reviewing it before too
20:08:24 oomichi mriedem: thanks, +2
20:10:10 Ctesias Hi again. I'm getting the same behavior with the changes directly in my nova.conf file. I've tried pointing at the directory with --config-dir and directly at the nova.conf file with --config-file with no change in behavior
20:10:20 Ctesias the api_class value is still the default
20:11:19 mriedem Ctesias: which service?
20:11:33 Ctesias nova service
20:11:45 mriedem which of the nova services, there are several
20:11:50 mriedem nova-osapi_compute?
20:11:57 mriedem nova-compute, etc
20:12:21 Ctesias nova-compute
20:13:59 mriedem when you restart nova-compute, do you have debug logging enabled so you can see it dump which config files are being used to and it will dump the options
20:16:46 Ctesias the file is pretty long, there something I can grep for to get the file it's using?
20:17:57 mriedem yeah
20:17:58 mriedem "command line args"
20:18:02 mriedem "config files"
20:18:07 mriedem like here http://logs.openstack.org/47/484447/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/b2fbd0c/logs/screen-n-cpu.txt.gz#_Jul_17_18_47_11_345788
20:18:22 mriedem and then it dumps the options it's using
20:19:05 mriedem Ctesias: you're using the wrong group
20:19:09 mriedem it's not [keymgr]
20:19:13 mriedem it's [key_manager]
20:19:21 mriedem http://logs.openstack.org/47/484447/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/b2fbd0c/logs/screen-n-cpu.txt.gz#_Jul_17_18_47_11_670125
20:19:28 Ctesias yeah, that was a typo earlier. I've got [key_manager] in the file
20:21:05 Ctesias If I put a breakpoint in nova/keymgr/conf_key_mgr.py I can go to the line after it grabs the nova configuration and see it's the same
20:21:10 Ctesias (Pdb) CONF['key_manager']['api_class'] 'nova.keymgr.conf_key_mgr.ConfKeyManager'
20:23:35 mriedem and the debug log output when you restart nova-compute shows the same when it dumps the options?
20:23:58 Ctesias yes
20:24:26 Ctesias 2017-07-17 16:20:13.483 DEBUG oslo_service.service [req-ece128f3-fb7c-4da3-af58-78c39fca910c None None] key_manager.api_class = nova.keymgr.conf_key_mgr.ConfKeyManager from (pid=14641) log_opt_values /opt/pf9/venv/lib/python2.7/site-packages/oslo_config/cfg.py:2626-07-17 16:20:13.485 DEBUG oslo_service.service [req-ece128f3-fb7c-4da3-af58-78c39fca910c None None] osapi_v21.project_id_regex = None from (pid=14641)
20:25:19 mriedem hmm, api_class comes from castellan
20:25:24 mriedem which version of that library do you have installed?
20:26:05 Ctesias 0.4.0
20:26:14 mriedem kfarr: ^ have you heard of anything like this?
20:26:40 mriedem Ctesias: which version of nova? master (pike)? or ocata?
20:26:47 mriedem because that version is old for master https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L227
20:27:10 Ctesias Newton, actually
20:27:14 mriedem ew
20:27:21 Ctesias speed of business, man
20:28:01 mriedem so things were different in newton https://github.com/openstack/nova/blob/stable/newton/nova/conf/key_manager.py
20:28:53 mriedem looks like it should still set those options
20:30:38 mriedem Ctesias: this might be your problem https://github.com/openstack/nova/blob/stable/newton/nova/keymgr/__init__.py#L29
20:30:50 mriedem not totally sure
20:31:02 mriedem need to probably talk to kfarr
20:32:12 Ctesias I don't see api_class as an option in /nova/conf/key_manager.py
20:32:34 mriedem that's not the options registry,
20:32:40 mriedem that's the default impl
20:32:59 mriedem the options are registered here https://github.com/openstack/nova/blob/stable/newton/nova/conf/key_manager.py
20:33:20 mriedem and then there is some backward compat magic in https://github.com/openstack/nova/blob/stable/newton/nova/keymgr/__init__.py
20:37:16 Ctesias yeah commenting out the lines in __init__.py fixes it
20:38:36 Ctesias Is this behavior fixed upstream from Newton anywhere yet?
20:41:19 mriedem i think that stuff in init was all removed in ocata
20:41:33 mriedem oh i guess not ocata https://github.com/openstack/nova/blob/stable/ocata/nova/keymgr/__init__.py
20:41:44 mriedem or master https://github.com/openstack/nova/blob/master/nova/keymgr/__init__.py
20:41:44 mriedem damn
20:42:14 mriedem so the fact it's setting that b/c of devstack is a total hack
20:42:21 mriedem let me see if that's at least set in devstack
20:43:27 mriedem Ctesias: https://review.openstack.org/#/c/439855/
20:44:42 Ctesias cool. Thanks
20:45:03 mriedem Ctesias: so did you just remove this line? https://github.com/openstack/nova/blob/stable/newton/nova/keymgr/__init__.py#L29 ?
20:45:08 mriedem or all of the stuff in there
20:46:58 Ctesias I only commented out the lines that re-set the api_class value
20:47:18 Ctesias but if you're curious I can try to get rid of all of it and see what happens
20:47:34 mriedem i'm curious if just commenting out https://github.com/openstack/nova/blob/stable/newton/nova/keymgr/__init__.py#L29 resolves your issue
20:47:41 mriedem because that would be easy for me to change on master and backport through to newton
20:47:55 Ctesias Yes.
20:47:59 mriedem ok
20:48:28 Ctesias If you would be so kind as to post that change once it comes in so I can follow it back and get upgraded to it that would be excellent.
20:48:29 mriedem i can mess around with pushing that change later then - i can't say i totally understand *why* it would cause an issue since it should just set a default, not override your value
20:48:35 mriedem unless it thinks that your value was the default or something?
20:48:42 Ctesias beats the hell out of me
20:49:09 mriedem i'll just remove it on the grounds that we have the value set in devstack so removing the hack is good enough
20:50:40 mriedem Ctesias: reporting a bug against nova would also help with the backports
20:50:51 mriedem https://bugs.launchpad.net/nova/+filebug
20:52:08 Ctesias will do
21:13:23 openstackgerrit Matt Riedemann proposed openstack/nova master: Update policy descriptions for base. https://review.openstack.org/472622
21:13:23 openstackgerrit Matt Riedemann proposed openstack/nova master: Consistent policies https://review.openstack.org/479774
21:14:39 openstackgerrit Matt Riedemann proposed openstack/nova master: Update policy descriptions for base. https://review.openstack.org/472622
21:15:21 mriedem oomichi: another easy one and the final patch for the policy docs bp https://review.openstack.org/#/c/472622/
21:27:48 mriedem who here feels like adding back in the ability to load up out of tree scheduler drivers? https://bugs.launchpad.net/nova/+bug/1704788
21:27:49 openstack Launchpad bug 1704788 in OpenStack Compute (nova) "Hardcoded choices for nova scheduler driver" [Undecided,Confirmed]
21:30:03 dansmith heh
21:30:24 mriedem bauzas: since you were +W on that thing, how do you feel about ^
21:30:32 mriedem answer tomorrow when you're awake
21:30:56 mriedem because we really probably should have made that (1) a deprecation cycle and (2) ffs at least reno it
21:33:22 openstackgerrit Merged openstack/nova master: Handle Cinder 3.27 style attachments in swap_volume https://review.openstack.org/456971
21:34:11 openstackgerrit Merged openstack/nova master: [placement] Update allocation-candidates.yaml for gabbi 1.35 https://review.openstack.org/484356
21:34:23 cdent \o/
21:34:34 mriedem cdent: btw, just so you know,
21:34:49 mriedem we went hiking, toured a historic village, and went swimming yesterday

Earlier   Later