| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-07-14 | |||
| 15:35:08 | superdan | melwitt: the universe wanted that to merge as bad as we did | |
| 15:35:25 | melwitt | heh | |
| 15:43:18 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Set wsgi.keep_alive=False globally for tests https://review.openstack.org/483972 | |
| 15:47:14 | gibi | mriedem: I have a theory about the unshelve host mismatch | |
| 15:47:41 | gibi | mriedem: the test first shelve offload the instance then unshelve it | |
| 15:48:06 | gibi | mriedem: the compute manager sets the state of the instance to SHELVE_OFFLOADED earlier than clearing the host of the instance | |
| 15:48:10 | gibi | mriedem: here https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L4446-L4457 | |
| 15:48:15 | openstackgerrit | melanie witt proposed openstack/nova master: Make security_group_rules use check_deltas() for quota https://review.openstack.org/477700 | |
| 15:48:17 | openstackgerrit | melanie witt proposed openstack/nova master: Remove 'reserved' count from used limits https://review.openstack.org/446242 | |
| 15:48:18 | openstackgerrit | melanie witt proposed openstack/nova master: Make key_pairs use check_deltas() for quota https://review.openstack.org/477699 | |
| 15:48:21 | openstackgerrit | melanie witt proposed openstack/nova master: Remove useless quota_usage_refresh from nova-manage https://review.openstack.org/446243 | |
| 15:48:22 | openstackgerrit | melanie witt proposed openstack/nova master: Count instances to check quota https://review.openstack.org/416521 | |
| 15:48:28 | openstackgerrit | melanie witt proposed openstack/nova master: Make Quotas object favor the API database https://review.openstack.org/410945 | |
| 15:48:33 | openstackgerrit | melanie witt proposed openstack/nova master: Add online migration to move quotas to API database https://review.openstack.org/410946 | |
| 15:48:54 | gibi | mriedem: the test waits for the instance to change state to SHELVE_OFFLOADED to start the unshelve | |
| 15:49:19 | gibi | mriedem: so in theory we can have unshelve.start sent earlier than the compute manager setting the instance host to null | |
| 15:49:33 | mriedem | gibi: ah yeah i think i fixed something like that when tempest was race failing on shelve tests too | |
| 15:49:35 | mriedem | similar thing | |
| 15:50:00 | mriedem | so need to wait for the shelved_offloaded vm_state and instance.host is none | |
| 15:50:14 | gibi | OK, I will code that up | |
| 15:50:58 | mriedem | gibi: cool, i'll report a bug for it | |
| 15:51:29 | openstackgerrit | Jan Gutter proposed openstack/os-vif master: Add support for VIFPortProfileOVSRepresentor https://review.openstack.org/483921 | |
| 15:52:10 | gibi | mriedem: thanks | |
| 15:52:30 | mriedem | https://bugs.launchpad.net/nova/+bug/1704423 | |
| 15:52:31 | openstack | Launchpad bug 1704423 in OpenStack Compute (nova) "_test_unshelve_server intermittently fails in functional versioned notification tests" [Medium,Triaged] | |
| 15:53:14 | leakypipes | figleaf just quoted Forrester on the OpenStack ML. I think he needs to Unprison his Think Rhino. | |
| 15:54:08 | mriedem | leakypipes: have you entered the 'hosted projects' circus? | |
| 15:55:25 | leakypipes | mriedem: nope. | |
| 16:06:27 | openstackgerrit | Maciej Kucia proposed openstack/nova master: Add JSON schema validation to PCI whitelist https://review.openstack.org/476098 | |
| 16:11:10 | openstackgerrit | Matt Riedemann proposed openstack/python-novaclient master: Add functional test for resize-confirm plus quota validation https://review.openstack.org/483559 | |
| 16:18:03 | figleaf | leakypipes: to be fair, Forrester was *in* the quote. It wasn't a Forrester quote | |
| 16:18:50 | leakypipes | figleaf: I know, I was just joking with ya. :) | |
| 16:18:56 | openstackgerrit | Jay Pipes proposed openstack/nova master: claim resources in placement API during schedule() https://review.openstack.org/483566 | |
| 16:18:57 | openstackgerrit | Jay Pipes proposed openstack/nova master: add dict of allocation requests to select_dests() https://review.openstack.org/483565 | |
| 16:18:57 | openstackgerrit | Jay Pipes proposed openstack/nova master: scheduler: isolate _get_sorted_hosts() https://review.openstack.org/483564 | |
| 16:19:07 | figleaf | leakypipes: :) | |
| 16:19:19 | leakypipes | figleaf: fixed your comments in the above patches ^^. | |
| 16:21:09 | figleaf | leakypipes: thx. Will get to them shortly | |
| 16:24:47 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: fix unshelve notification test instability https://review.openstack.org/483986 | |
| 16:25:07 | gibi | mriedem: fix for unshelve test is up ^^ | |
| 16:26:27 | mriedem | thanks | |
| 16:26:55 | gibi | mriedem: I'm leaving now for the weekend. See you on Monday | |
| 17:01:39 | openstackgerrit | Stephen Finucane proposed openstack/nova master: conf: Deprecate 'keymap' options https://review.openstack.org/483994 | |
| 17:13:17 | rbartra | Hello stephenfin, I have a question regarding https://review.openstack.org/#/c/449288/19/nova/api/openstack/compute/flavor_manage.py ... I am wondering how to retrieve the current policy value from the verify_deprecated_policy method? I am trying with oslo_policy.policy, but I keep getting an empty rules list. I am also unable to import 'from nova import policy' which is how the current rule is retrieved in flavor_manage.py . | |
| 17:17:01 | stephenfin | rbartra: How come you can't import nova.policy? | |
| 17:17:57 | stephenfin | Ah, wait - that'd be a circular import | |
| 17:18:28 | stephenfin | rbartra: You could just move that function to nova/policy.py instead? | |
| 17:18:30 | rbartra | stephenfin: correct, that is is the issue I am seeing | |
| 17:18:49 | rbartra | stephenfin: yes, I am cool with that as well | |
| 17:19:00 | stephenfin | As am I | |
| 17:19:12 | rbartra | stephenfin: Great! Thank you! | |
| 17:19:19 | stephenfin | Thanks for sticking with that, btw. I realize I've made you jump through a few hoops for it :) | |
| 17:19:24 | stephenfin | but it'll be worth it in the end | |
| 17:19:41 | rbartra | stephenfin: I appreciate all the reviews and feedback :) | |
| 17:49:08 | ralonsoh | stephenfin: hi, do you have time for https://review.openstack.org/#/c/451433? | |
| 17:49:44 | stephenfin | ralonsoh: Not for a while yet. If you want to take it over, by all means go for it | |
| 17:49:59 | ralonsoh | stephenfin: I was going to say that | |
| 17:50:05 | ralonsoh | stephenfin: thanks! | |
| 17:50:11 | stephenfin | Heck, you can abandon that and start from scratch. There probably isn't that much of value there | |
| 17:50:21 | stephenfin | ralonsoh: Cool. Ping me if/when you want reviews :) | |
| 17:50:25 | ralonsoh | stephenfin: I'll start on Monday | |
| 17:50:30 | ralonsoh | stephenfin: perfect | |
| 17:50:53 | stephenfin | (y) | |
| 18:16:56 | mriedem | we should get this in to classify the failure https://review.openstack.org/#/c/483939/ | |
| 18:17:02 | mriedem | i just had something else fail on that same test | |
| 18:21:04 | openstackgerrit | Chris Dent proposed openstack/nova master: Add functional test for two-cell scheduler behaviors https://review.openstack.org/452006 | |
| 18:21:18 | mriedem | good idea | |
| 18:22:16 | cdent | I think that’s my final act for the day | |
| 18:22:24 | mriedem | smoke bomb exit? | |
| 18:22:43 | cdent | poof | |
| 18:35:50 | openstackgerrit | Matt Riedemann proposed openstack/python-novaclient master: Add functional test for resize-confirm plus quota validation https://review.openstack.org/483559 | |
| 18:37:29 | mriedem | oh also so everyone knows, | |
| 18:37:39 | mriedem | there is a bug killing a lot of jobs b/c of some eventlet thread switch in cinder-volume | |
| 18:37:42 | mriedem | spiking since 7/11 | |
| 18:37:52 | mriedem | eventlet seems to be the devil | |
| 18:38:22 | smcginnis | Unfortunately not sure where to even start with that one. If anyone has any expertise in that area, would appreciate the help. | |
| 18:38:50 | smcginnis | Searches show it's usually do to either patching or not patching something and multiple threads. | |
| 18:38:53 | mriedem | i'm interested in anything that went into upper-constraints around 7/10 or 7/11 that cinder depends on and which has something to do with locking | |
| 18:39:06 | mriedem | or threading | |
| 18:39:17 | mriedem | i checked the latest privsep release but that looked like mostly docs changes | |
| 18:41:48 | superdan | mriedem: what does the failure look like? | |
| 18:41:50 | mriedem | oslo.service updates went into upper-constraints then too | |
| 18:42:06 | leakypipes | cdent, figleaf, mriedem, superdan: looks like I fixed the issues with the num_instances > 1 tempest test failures in the placement-claims series. | |
| 18:42:09 | mriedem | https://bugs.launchpad.net/cinder/+bug/1694509 | |
| 18:42:10 | openstack | Launchpad bug 1694509 in Cinder "eventlet errors and cannot switch to a different thread" [High,Confirmed] | |
| 18:42:23 | mriedem | http://logs.openstack.org/49/483149/2/check/gate-novaclient-dsvm-functional-neutron-ubuntu-xenial/d37b26f/logs/screen-c-vol.txt.gz#_Jul_13_20_07_49_514341 | |
| 18:42:50 | mriedem | there is also a GMR in this other one http://logs.openstack.org/00/469800/31/check/gate-tempest-dsvm-cells-ubuntu-xenial/7156eed/logs/screen-c-vol.txt.gz | |
| 18:43:02 | smcginnis | Just looked at this one: http://logs.openstack.org/62/468262/4/gate/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/e3ad57c/logs/screen-c-vol.txt.gz#_Jul_14_17_05_58_531817 | |
| 18:43:07 | mriedem | http://logs.openstack.org/00/469800/31/check/gate-tempest-dsvm-cells-ubuntu-xenial/7156eed/logs/screen-c-vol.txt.gz#_Jul_14_13_59_21_489470 | |
| 18:43:11 | smcginnis | Slightly different signature. | |
| 18:44:14 | mriedem | so, | |
| 18:44:16 | mriedem | cinder uses taskflow, | |
| 18:44:22 | mriedem | and it looks like taskflow uses futursit | |
| 18:44:25 | mriedem | *futurist | |
| 18:44:32 | mriedem | and futurist had an update in upper-constraints on 7/11 | |
| 18:44:57 | smcginnis | Hmm, suspicious. | |
| 18:45:20 | mriedem | https://review.openstack.org/#/c/482273/ | |
| 18:45:59 | mriedem | clarkb: ^ | |
| 18:46:36 | mriedem | maybe we should try blacklisting that and see if things trend back down | |
| 18:46:57 | superdan | sounds plausible to me | |