| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-01-26 | |||
| 03:01:04 | dansmith | but maybe got lucky on the race | |
| 03:01:21 | dansmith | so I think the above code, using the _lookup for the refresh and bailing if we get None is probably right | |
| 03:01:24 | melwitt | okay, so the code in the paste should catch all of those cases. I think | |
| 03:01:27 | dansmith | yeah | |
| 03:01:48 | dansmith | the dep chain for this is like five deep so I just can't keep the sequencing of the errors in my head I guess | |
| 03:02:10 | openstackgerrit | Dan Smith proposed openstack/nova: Move instance creation to conductor https://review.openstack.org/319379 | |
| 03:03:31 | dansmith | and looks like the lowest dep is going to get kicked out of the gate.. yay | |
| 03:03:36 | dansmith | #fml | |
| 03:03:53 | melwitt | guh | |
| 03:11:53 | dansmith | I'm still kinda unsure.. this must be a fantastic race that we only hit occasionally | |
| 03:12:18 | dansmith | because I think it ran a bunch of times in a row without hitting it when I was dicking with the listing patch | |
| 03:12:29 | dansmith | but whatever | |
| 03:15:35 | melwitt | back when I was working on the patch to pass the cells v1 job, it failed often enough with the ObjectActionError in that block that I knew to add something. guess I was "lucky" | |
| 03:16:00 | dansmith | right but that was a race, | |
| 03:16:08 | dansmith | this is a race in the race handler :) | |
| 03:16:43 | melwitt | yes. fwiw it got really stable after adding the catch block, it's just the instance.refresh() wasn't really doing anything | |
| 03:16:51 | dansmith | I mean, I'm not saying this doesn't make sense, I'm just wondering why murphy hates me | |
| 03:17:04 | melwitt | yeah, I get you | |
| 03:17:31 | dansmith | I think it was, but only in the cases where we get there from a buildrequest and when we didn't race with another delete right? | |
| 03:19:08 | melwitt | hm, yeah. I guess it would have had an orphaned error itself when it tried to reload itself if it came from a build request | |
| 03:19:23 | dansmith | at least those deps got reset so I get another go at the gate without a recheck | |
| 03:19:36 | dansmith | even though it estimates 43h until completion :/ | |
| 03:20:24 | melwitt | it's showing 1 hour estimate on my view for what's running right now | |
| 03:20:51 | dansmith | it's now 15h for those | |
| 03:20:52 | dansmith | 19: (421228,2) Add --verbose option to discover_hosts command (4h26m/++~~~~~~~/rem:15h43m) | |
| 03:21:26 | dansmith | 1h for this conductor patch | |
| 03:21:35 | melwitt | oh, I see | |
| 03:22:02 | melwitt | the gate was nuts today | |
| 03:22:16 | melwitt | (busy) | |
| 03:22:26 | dansmith | the queues aren't very long right now, but it's still estimating long runtimes, | |
| 03:22:31 | dansmith | so something might be failing a lot | |
| 03:25:58 | dansmith | it's dropping. maybe just a big recalculation and pessimism | |
| 03:26:28 | melwitt | haha | |
| 03:26:55 | melwitt | yeah, I was thinking, most of what's in the gate has only a 1 hr wait left, but I assume that doesn't account for resets | |
| 03:29:15 | melwitt | bbiab | |
| 03:36:48 | openstackgerrit | OpenStack Proposal Bot proposed openstack/nova: Updated from global requirements https://review.openstack.org/424828 | |
| 03:38:03 | openstackgerrit | Takashi NATSUME proposed openstack/nova: api-ref: Fix parameters and examples in aggregate API https://review.openstack.org/425512 | |
| 04:05:09 | openstackgerrit | ChangBo Guo(gcb) proposed openstack/nova: Enable more virt.xenapi tests on Python 3 https://review.openstack.org/414421 | |
| 04:16:22 | dansmith | melwitt: powerkvm passed | |
| 04:16:37 | dansmith | but jenkins is going to fail | |
| 04:16:47 | melwitt | ah, I see that. checking what it is | |
| 04:17:21 | melwitt | it's that identity error again from keystone. I've seen that before but I dunno if anyone's documented it in a bug yet | |
| 04:18:01 | dansmith | see the sql failure? | |
| 04:18:08 | dansmith | http://logs.openstack.org/79/319379/82/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/72d1a95/logs/screen-n-api.txt.gz?level=TRACE#_2017-01-26_04_09_09_706 | |
| 04:18:20 | dansmith | so fingers crossed it's not related | |
| 04:18:29 | dansmith | but it means I have to recheck uh-gain | |
| 04:18:54 | melwitt | yeah, looking at those now. weird | |
| 04:20:00 | melwitt | I've seen sql errors on other failed runs before lately | |
| 04:21:13 | dansmith | well, | |
| 04:21:26 | dansmith | I'm not going to be able to stay up for the end of the next run of this | |
| 04:21:45 | dansmith | so I hope that we can get this happy tomorrow | |
| 04:23:14 | melwitt | I'll keep an eye on it | |
| 04:24:18 | dansmith | the powervm fail is a secgroup thing, FYI | |
| 04:25:05 | dansmith | melwitt: okay thanks | |
| 04:25:15 | melwitt | oh, why did it run it two on the same PS | |
| 04:25:26 | melwitt | s/two/twice/ | |
| 04:25:36 | melwitt | oh, powervm vs powerkvm | |
| 04:25:44 | dansmith | yeah | |
| 04:25:48 | melwitt | haha, they look too similar to me | |
| 04:25:49 | dansmith | and powervm is the out of tree driver | |
| 04:26:02 | dansmith | and non-voting | |
| 04:26:16 | melwitt | okay, yeah | |
| 04:31:14 | openstackgerrit | Matt Riedemann proposed openstack/nova: Scheduler calling the Placement API https://review.openstack.org/417961 | |
| 04:35:39 | openstackgerrit | Hironori Shiina proposed openstack/nova: ironic: Add trigger crash dump support to ironic driver https://review.openstack.org/376548 | |
| 04:38:27 | takashin | alex_xu: Are you aroud? | |
| 04:41:18 | takashin | oomichi: Are you aroud? | |
| 04:42:43 | cristicalin | hello, I have an issue with a nova which I upgraded from juno to mitaka | |
| 04:42:58 | cristicalin | after the upgrade it started flooding the neutron server with requests | |
| 04:43:07 | cristicalin | is there any way to make it less aggressive ? | |
| 04:43:39 | cristicalin | neutron is still running juno version at the moment | |
| 04:44:43 | cristicalin | I see a lot of security group updates being sent to the neutron server which look redundant as they trigger no actual changes | |
| 04:45:26 | cristicalin | and nova logs messaages like "Creating event network-changed:None" | |
| 04:50:59 | mriedem | mnestratov: fyi http://lists.openstack.org/pipermail/openstack-dev/2017-January/111007.html re https://review.openstack.org/#/c/312488/ | |
| 04:51:18 | mriedem | bauzas: for your morning pleasure http://lists.openstack.org/pipermail/openstack-dev/2017-January/111006.html | |
| 04:54:51 | mikal | I must say I find this PTG thing very depressing | |
| 04:57:13 | openstackgerrit | Ghanshyam Mann proposed openstack/nova-specs: Few updates on server filter/sort spec https://review.openstack.org/425533 | |
| 05:37:50 | openstackgerrit | Ghanshyam Mann proposed openstack/nova-specs: Few updates on server filter/sort spec https://review.openstack.org/425533 | |
| 06:16:41 | openstackgerrit | Takashi NATSUME proposed openstack/nova: Fix doc generation warnings https://review.openstack.org/425549 | |
| 06:17:55 | openstackgerrit | Takashi NATSUME proposed openstack/nova: Fix doc generation warnings https://review.openstack.org/425549 | |
| 06:52:43 | openstackgerrit | melanie witt proposed openstack/nova: Move instance creation to conductor https://review.openstack.org/319379 | |
| 07:58:41 | openstackgerrit | Ghanshyam Mann proposed openstack/nova-specs: Few updates on server filter/sort spec https://review.openstack.org/425533 | |
| 08:35:20 | openstackgerrit | Ghanshyam Mann proposed openstack/nova: Add new policy for server list/detail with all_tenants https://review.openstack.org/415330 | |
| 09:19:07 | mnestratov | mnes | |
| 09:19:56 | mnestratov | mriedem: thanks | |
| 09:46:52 | johnthetubaguy | mikal: whats depressing? | |
| 09:48:04 | johnthetubaguy | bauzas: let me know if I can lend a hand with some of the grenade stuff, I was helping with the zero downtime job where we added nova-api on the subnode | |
| 09:58:44 | BlackDex | hello | |
| 09:58:55 | BlackDex | i have some trouble with nova-consoleauth | |
| 09:59:02 | BlackDex | i have an HA setup | |
| 09:59:12 | BlackDex | and i added memcached for the console tokens | |
| 09:59:16 | openstackgerrit | Stephen Finucane proposed openstack/nova: Use a service account to make vendordata requests. https://review.openstack.org/415597 | |
| 09:59:17 | openstackgerrit | Stephen Finucane proposed openstack/nova: Optionally make dynamic vendordata failures fatal. https://review.openstack.org/416391 | |
| 09:59:17 | openstackgerrit | Stephen Finucane proposed openstack/nova: Cache boot time roles for vendordata. https://review.openstack.org/417780 | |
| 09:59:34 | BlackDex | the servers are added to the config | |
| 09:59:42 | BlackDex | but they don't appear to be used | |
| 10:04:42 | gmann | johnthetubaguy: alex_xu can you check spec updates for policy things - https://review.openstack.org/#/c/425533/ | |
| 10:04:51 | gmann | updating patch with alex_xu comment | |
| 10:07:11 | openstackgerrit | Michael Still proposed openstack/nova: Cache boot time roles for vendordata. https://review.openstack.org/417780 | |
| 10:07:11 | openstackgerrit | Michael Still proposed openstack/nova: Use a service account to make vendordata requests. https://review.openstack.org/415597 | |
| 10:07:12 | openstackgerrit | Michael Still proposed openstack/nova: Optionally make dynamic vendordata failures fatal. https://review.openstack.org/416391 | |