| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-12-11 | |||
| 08:34:51 | gmann | alex_xu: now i am thinking to remove all_tenants policies things mentioned in ocata implemented spec which actually did not get implemented and start new policy rule things as fresh in Rocky | |
| 08:35:38 | gmann | so that people does not get confused with new policy rules for all_tenants mentioned in spec | |
| 08:41:50 | ludovic | Hello all, maybe someone can help to determine what i have a lot of urllib3.connectionpool full in nova.conf ? | |
| 08:42:33 | ludovic | When i use nova host-evacuate , a lot of error VMs are in Error state with Gateway timeout Error | |
| 08:42:43 | ludovic | So i really need help | |
| 08:55:18 | openstackgerrit | Ghanshyam Mann proposed openstack/nova-specs master: Few correction in the server filter/sort spec https://review.openstack.org/527019 | |
| 08:56:27 | gmann | alex_xu: ^^ | |
| 09:02:08 | openstackgerrit | jichenjc proposed openstack/nova master: [Placement] Add create inventories doc for placement https://review.openstack.org/512215 | |
| 09:11:03 | openstackgerrit | Alvaro Lopez Garcia proposed openstack/nova master: Ensure that periodic reclaim cleans DB deleted instances https://review.openstack.org/323250 | |
| 09:20:14 | openstackgerrit | Merged openstack/nova stable/pike: Fix binary name https://review.openstack.org/524531 | |
| 09:27:57 | openstackgerrit | sahid proposed openstack/nova master: libvirt: disconnect volume from host during detach https://review.openstack.org/515008 | |
| 09:29:58 | alex_xu | gmann: thanks, I will check it | |
| 09:30:25 | alex_xu | gmann: btw, I'm on PTO, will back to work on Thursday | |
| 09:31:08 | openstackgerrit | jichenjc proposed openstack/nova master: deprecate fping_path config option https://review.openstack.org/526602 | |
| 09:41:36 | gmann | alex_xu: oh, sure no hurry. enjoy | |
| 09:43:06 | ludovic | someone is familiar with networking issue like urllib3 connection pool full in nova or cinder ? | |
| 09:49:16 | openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Add instance action record for snapshot instances https://review.openstack.org/525921 | |
| 09:58:53 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Add server filters whitelist in server api-ref https://review.openstack.org/527042 | |
| 10:10:11 | openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: [DNM] test https://review.openstack.org/527045 | |
| 10:12:50 | openstackgerrit | Lee Yarwood proposed openstack/nova master: conf: Do not inherit image signature props with snapshots https://review.openstack.org/527046 | |
| 11:50:50 | openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: [DNM] test https://review.openstack.org/527045 | |
| 11:51:26 | dtantsur | morning, compute overlords and overladies | |
| 11:51:41 | dtantsur | we're experiencing a new nova-related failure in the ironic multinode job: https://bugs.launchpad.net/ironic/+bug/1737395 | |
| 11:51:42 | openstack | Launchpad bug 1737395 in Ironic "n-cpu fails to start in the multinode job: Conflicting resource provider name: <uuid> already exists" [High,Confirmed] | |
| 11:51:49 | dtantsur | do you think any recent merge could cause it? | |
| 12:00:23 | cdent | dtantsur: might be https://review.openstack.org/#/c/524263/ ? | |
| 12:00:28 | cdent | when did it start? | |
| 12:00:36 | dtantsur | cdent: over the weekend, maybe Friday evening | |
| 12:01:12 | cdent | hmmm, that’s a bit older than that | |
| 12:02:37 | cdent | dtantsur: is this the thing that https://review.openstack.org/#/c/508555/ is supposed to fix? | |
| 12:04:29 | dtantsur | cdent: it looks so, but it's the first time I see this patch | |
| 12:04:37 | dtantsur | johnthetubaguy: around? re ^^^ | |
| 12:05:41 | cdent | It might be that the first patch I linked makes the problem addressed by the second more noticeable. Because in the past a 409 would return a None, masking that anthing went wrong. | |
| 12:07:36 | dtantsur | (moving conversation from #openstack-ironic) | |
| 12:07:46 | dtantsur | sambetts: so yeah, seems like we need to rebase and merge this.. | |
| 12:07:56 | dtantsur | cdent: do you know if johnthetubaguy is around nowadays? | |
| 12:08:14 | dtantsur | one of us can rebase the patch, but I don't want to step on his shoes | |
| 12:08:28 | cdent | I haven’t seen him much lately, so I would think it would be okay to adopt | |
| 12:09:51 | dtantsur | sambetts or vdrok, wanna do ^^^ or should I? | |
| 12:14:14 | dtantsur | okie | |
| 12:27:17 | openstackgerrit | Dmitry Tantsur proposed openstack/nova master: Re-use existing ComputeNode on ironic rebalance https://review.openstack.org/508555 | |
| 12:27:19 | dtantsur | I'm not sure I fully understand what is going on in the functional tests, but here is my attempt ^^^ | |
| 12:42:50 | openstackgerrit | Merged openstack/nova stable/pike: Document the real behavior of notify_on_state_change https://review.openstack.org/521870 | |
| 13:17:45 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Transform instance.exists notification https://review.openstack.org/403660 | |
| 13:42:08 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Add server filters whitelist in server api-ref https://review.openstack.org/527042 | |
| 13:42:25 | jaypipes | happy Monday morning, supernovas! Who's still working this week? | |
| 13:43:02 | gibi | jaypipes: good morning! I'm still here until 20th of Dec | |
| 13:43:09 | jaypipes | gibi: cool :) | |
| 13:43:12 | openstackgerrit | Matthew Booth proposed openstack/nova master: Add uuid column to BlockDeviceMapping https://review.openstack.org/242602 | |
| 13:43:13 | edleafe | jaypipes: unfortunately, me | |
| 13:43:13 | jaypipes | glad to hear it! | |
| 13:43:17 | jaypipes | edleafe: :) | |
| 13:46:32 | openstackgerrit | Matthew Booth proposed openstack/nova master: Make BlockDeviceMapping object support uuid https://review.openstack.org/242603 | |
| 13:46:33 | openstackgerrit | Matthew Booth proposed openstack/nova master: Add an online migration for BDM.uuid https://review.openstack.org/525599 | |
| 13:46:55 | cdent | jaypipes: I’ll be around until… uh 22nd I guess | |
| 13:47:42 | openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: [DNM] test https://review.openstack.org/527045 | |
| 13:48:56 | jaypipes | cdent: cool beans. | |
| 13:50:10 | edleafe | For those around, nova scheduler subteam meeting in 10 minutes in #openstack-meeting-alt | |
| 13:53:17 | mdbooth | jaypipes: Speaking of which I just respun https://review.openstack.org/#/c/242602/25 following comments from mriedem (is he around this week?). I just added comments, but I fixed your nits from the previous patch as well as rebasing for a merge conflict later in the series. | |
| 13:54:15 | mdbooth | Would also appreciate a second opinion on the subject of unique constraints on nullable columns, but I did research that one carefully. | |
| 13:54:27 | mdbooth | In short, I'm very much in favour of them. | |
| 13:57:22 | jaypipes | mdbooth: will re-review shortly. | |
| 13:57:29 | mdbooth | jaypipes: Thanks | |
| 14:10:06 | mriedem | jaypipes: is it correct to say that nothing done in a db api method is committed until we start to exit a pick_context_manager_writer context? | |
| 14:10:19 | mriedem | like if we're updating multiple tables in a single method | |
| 14:13:44 | cdent | mriedem: or flush is callewd | |
| 14:13:56 | cdent | (which sometimes happens to find out an id() | |
| 14:14:12 | cdent | keyboards in the cold suck, especially when you already suck at typing | |
| 14:14:16 | mriedem | trying to figure out if there is a better way to fix the deadlock we're seeing in https://review.openstack.org/#/c/507473/15/nova/db/sqlalchemy/api.py w/o using the retry_on_deadlock decorator | |
| 14:14:26 | mriedem | cdent: radiant space heater for xmas | |
| 14:18:51 | jaypipes | mriedem: that is correct. | |
| 14:20:03 | mriedem | jaypipes: ok - so i guess we just have ot use the deadlock decorator in ^ then | |
| 14:20:09 | mriedem | unless anyone else has bright ideas | |
| 14:20:16 | jaypipes | mriedem: looking at it now. | |
| 14:26:23 | dtantsur | folks, can someone please take a look at https://review.openstack.org/#/c/508555/ ? it fixes our CI apparently | |
| 14:26:28 | dtantsur | mriedem, jaypipes ^^^ | |
| 14:26:55 | jaypipes | dtantsur: yes, will do. | |
| 14:27:08 | cdent | dtantsur: so that was it? I’m surprised it didn’t show up a bit sooner. | |
| 14:27:25 | dtantsur | cdent: all I can say that a patch with Depends-On it has passed the CI :) | |
| 14:28:07 | cdent | well it presumably needs to happen anyway, so motion in the right direction | |
| 14:28:16 | dtantsur | yep | |
| 14:28:42 | openstackgerrit | Merged openstack/python-novaclient master: Remove deprecated command in nova.rst https://review.openstack.org/526569 | |
| 14:29:02 | jaypipes | mriedem: yeah, that's sort of an odd place for the deadlock to occur. that basically means there are two greenthreads that are attempting to simultaneously (or near-simultaneously) calling action_event_finish() on an action with the *same* request ID. | |
| 14:29:20 | jaypipes | mriedem: which doesn't seem like it should happen, no? | |
| 14:29:41 | jaypipes | mriedem: i.e. there should not be >1 greenthread attempting to "finish" a particular task/event at the same time. | |
| 14:30:04 | jaypipes | mriedem: unless request ID is not a UUID? | |
| 14:30:16 | jaypipes | mriedem: if request ID is an auto-inc, it could happen. | |
| 14:30:58 | mriedem | request ID should be unique per user request | |
| 14:31:19 | mriedem | generated by some keystone or oslo middleware i tihnk | |
| 14:31:32 | jaypipes | mriedem: hmm, not necessarily... | |
| 14:31:33 | mriedem | https://github.com/openstack/oslo.middleware/blob/master/oslo_middleware/request_id.py | |
| 14:31:58 | mriedem | the failures all seem to happen on a resize test | |
| 14:32:04 | jaypipes | mriedem: see the comment and code on line 6302-6310 | |
| 14:32:37 | diga | jaypipes: Hi | |
| 14:32:38 | jaypipes | mriedem: seems that on a service restart, the action is retrieved by getting the "last created by instance UUID" | |
| 14:32:57 | jaypipes | mriedem: I'm wondering if that is returning an action ID that another greenthread might be operating on? | |
| 14:33:15 | mriedem | jaypipes: maybe, | |
| 14:33:15 | jaypipes | diga: hey. just saw your email. will email you an answer, ok? | |
| 14:33:22 | mriedem | we wouldn't have a compute restart in the middle of this tempest run | |
| 14:33:22 | diga | jaypipes: I have my setup ready but how to reproduce the issue is the big changel I am facing | |