| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-05-02 | |||
| 19:31:58 | mriedem | ihrachys: logstash doesn't show that hitting on stable | |
| 19:32:08 | mriedem | novnc should only be enabled on master according to that d-g change | |
| 19:32:48 | ihrachys | mriedem, see this just failed for https://review.openstack.org/#/c/461827/ | |
| 19:32:50 | ihrachys | it's ocata | |
| 19:33:03 | ihrachys | the gate-tempest-dsvm-py35-ubuntu-xenial | |
| 19:33:31 | ihrachys | maybe there is something wrong about the job that it picks master, I dunno | |
| 19:34:07 | ihrachys | definitely enabled there: http://logs.openstack.org/27/461827/1/check/gate-tempest-dsvm-py35-ubuntu-xenial/6805498/logs/devstacklog.txt.gz#_2017-05-02_16_15_56_894 | |
| 19:34:08 | mriedem | ihrachys: huh yeah novnc is enabled http://logs.openstack.org/27/461827/1/check/gate-tempest-dsvm-py35-ubuntu-xenial/6805498/logs/local.conf.txt.gz | |
| 19:35:47 | clarkb | I think that actually enabled the feature across the board | |
| 19:35:53 | mriedem | ihrachys: https://review.openstack.org/#/c/344892/5 was ocata so maybe n-novnc is just always enabled, but not used in devstack before ocata | |
| 19:36:02 | clarkb | since its in the base nova list which is used in all the branches | |
| 19:36:08 | mriedem | ok that explains it then | |
| 19:37:04 | mriedem | oh i see logstash won't show the py35 results because of the goofy formatting in the console dump | |
| 19:37:05 | mriedem | b'AssertionError: True is not false : Token must be invalid because the connection closed.' | |
| 19:37:44 | sdague | dansmith: I think I've sorted the systemd issues that crept up, but if you find another one, let me know | |
| 19:37:48 | mriedem | there we go | |
| 19:37:53 | mriedem | ihrachys: (message:"AssertionError: True is not false : Token must be invalid because the connection closed." OR message:"b'AssertionError: True is not false : Token must be invalid because the connection closed.'") AND tags:"console" | |
| 19:38:09 | dansmith | sdague: I'm just grasping at straws about why something is behaving differently all of a sudden | |
| 19:38:18 | mriedem | dansmith: oh, | |
| 19:38:20 | mriedem | the wsgi changes? | |
| 19:38:26 | sdague | dansmith: what kind of different? | |
| 19:38:35 | mriedem | dansmith: did you see the wsgi changes merge? | |
| 19:38:41 | mriedem | i didn't think devstack was using that yet though | |
| 19:38:44 | dansmith | mriedem: ooh, which wsgi changes? | |
| 19:39:00 | dansmith | because I swear that some request id stuff is broken now | |
| 19:39:16 | mriedem | nvm didn't merge yet https://review.openstack.org/#/c/459413/ | |
| 19:39:25 | mriedem | but this one did https://review.openstack.org/#/c/457283/ | |
| 19:39:44 | sdague | mriedem: sure, but that's not getting run in the gate yet | |
| 19:39:55 | mriedem | right because of https://review.openstack.org/#/c/457715/ | |
| 19:40:11 | dansmith | ah, so | |
| 19:40:29 | dansmith | that was kindof what I was wondering.. something that kicked us out of eventlet or something | |
| 19:40:42 | sdague | nope | |
| 19:40:45 | mriedem | ihrachys: re-opened https://bugs.launchpad.net/nova/+bug/1669468 | |
| 19:40:45 | openstack | Launchpad bug 1669468 in OpenStack Compute (nova) "tempest.api.compute.servers.test_novnc.NoVNCConsoleTestJSON.test_novnc fails intermittently in neutron multinode nv job" [Medium,Confirmed] | |
| 19:41:07 | dansmith | mriedem: sdague: so I would love to lead one of you through an exercise to prove that something is broken or that I'm crazy | |
| 19:41:38 | sdague | dansmith: I'm kind of borked today, as the TC meeting is in 20, and I've got a hard stop after that. Tomorrow I'd be fine | |
| 19:42:00 | mriedem | dansmith: i can be your huckleberry here in a bit | |
| 19:42:01 | ihrachys | mriedem, thanks | |
| 19:42:17 | ihrachys | mriedem, is it intermittent or total stop? | |
| 19:42:24 | ihrachys | I mean for ocata | |
| 19:43:26 | mriedem | ihrachys: intermittent i think | |
| 19:43:32 | mriedem | 21 hits in 7 days | |
| 19:43:36 | mriedem | and we've been merging ocata changes | |
| 19:43:56 | ihrachys | ok, will recheck then | |
| 19:48:12 | melwitt | dansmith: yes, I did the scatter-gather here https://review.openstack.org/#/c/416521/29/nova/quota.py@1903 | |
| 19:49:01 | dansmith | melwitt: cool thanks | |
| 19:56:32 | cdent | mriedem: I will be at summit, and when I found out I updated the etherpad that had that list of names of who will or won't be there. The foundation requested my presence as api-wg dood gave me a room. | |
| 19:56:44 | mriedem | cdent: ooo | |
| 19:56:50 | mriedem | that's news to me, obviously | |
| 19:57:03 | cdent | I am, however, off work tomorrow, walking in the woods | |
| 19:57:09 | EmilienM | iiuc I should not do recheck on nova patches right? live migration is broken in the gate? | |
| 19:57:23 | mriedem | EmilienM: fixed a few hours ago | |
| 19:57:26 | EmilienM | ack | |
| 19:57:50 | mriedem | cdent: that's allowed as long as you promise to ponder nova onboarding and other work-related issues while in nature | |
| 19:57:56 | cdent | mriedem: i intend to attend all the placement related sessions (forum and conference) and in general be around | |
| 19:58:01 | cdent | mriedem: thanks so much, I'll do that | |
| 19:58:25 | cdent | I shall think upon things that made me go WTF | |
| 20:00:23 | openstackgerrit | Steve Noyes proposed openstack/nova master: Add Cinder v3 detach to shutdown_instance https://review.openstack.org/456877 | |
| 20:33:33 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: shared resources when finding providers https://review.openstack.org/461574 | |
| 20:33:33 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: get providers sharing capacity https://review.openstack.org/460798 | |
| 20:33:34 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: tests for non-shared with shared https://review.openstack.org/461899 | |
| 20:33:34 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: test non-shared out of inventory https://review.openstack.org/461900 | |
| 20:33:35 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: test for agg association not sharing https://review.openstack.org/461901 | |
| 20:33:51 | jaypipes | cdent: added those additional tests you were looking for ^^ | |
| 20:34:15 | cdent | you are a star, will look tomorrow | |
| 20:34:16 | cdent | actually no I won't | |
| 20:34:18 | cdent | I will look Thursday. I'm gone tomorrow | |
| 20:34:51 | jaypipes | cdent: cool beans, thanks! | |
| 20:37:03 | jaypipes | mriedem: this onboarding thing is for potential new Nova contributors, yes? | |
| 20:37:21 | mriedem | jaypipes: that's my understanding | |
| 20:37:25 | jaypipes | kk | |
| 20:37:35 | jaypipes | mriedem: just wanted to make sure... | |
| 20:43:18 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Transform instance.volume_attach notification https://review.openstack.org/401992 | |
| 20:43:19 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Transform instance.volume_detach notification https://review.openstack.org/408676 | |
| 20:43:20 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Transform instance.volume_attach.error notification https://review.openstack.org/455801 | |
| 20:46:56 | mriedem | ^ +2 on those 3 now | |
| 20:47:09 | mriedem | dansmith: did you figure out your dilemma yet? | |
| 20:57:16 | dansmith | mriedem: no | |
| 20:58:06 | dansmith | mriedem: I want to trace this delete call: http://logs.openstack.org/94/436094/23/check/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/83b5f81/console.html#_2017-05-02_18_17_34_903731 | |
| 20:58:16 | dansmith | here's the api log: http://logs.openstack.org/94/436094/23/check/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/83b5f81/logs/screen-n-api.txt.gz | |
| 20:59:01 | dansmith | the request-id for that is req-bc378dc5-41f0-4df8-95cf-4226ae088007 right? | |
| 20:59:06 | dansmith | so search for that in the api log, there is one hit | |
| 20:59:11 | dansmith | it's the return of the http call | |
| 20:59:23 | dansmith | but it should have been logged a bunch of times before that doing the actual delete | |
| 20:59:44 | dansmith | so, grab the instance uuid: 121af6e1-981e-4b5b-96c4-c9c19cd8b955 and search for that in the api log | |
| 21:00:14 | dansmith | the delete of that instance is here: http://logs.openstack.org/94/436094/23/check/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/83b5f81/logs/screen-n-api.txt.gz#_May_02_17_55_49_123287 | |
| 21:00:24 | dansmith | four minutes after the http call returned | |
| 21:00:33 | dansmith | and with a different req-id | |
| 21:01:01 | dansmith | (brb) | |
| 21:08:28 | mriedem | dansmith: my guess would be the first delete request is ignored/lost somewhere in the api because the instance isn't in a cell yet, and the 2nd delete request is when the test tears down after a timeout | |
| 21:08:46 | mriedem | so when the first delete request comes in, i'm guessing we're building the instance in conductor | |
| 21:09:10 | dansmith | mriedem: it doesn't run any of the debugging messages that I have sprinkled throughout the delete-while-building code | |
| 21:09:46 | mriedem | do we know what the nova-osapi_compute is at all? | |
| 21:09:51 | mriedem | version i mean | |
| 21:10:10 | dansmith | what do you mean? that's not an upgrade test | |
| 21:10:32 | mriedem | i mean this check https://review.openstack.org/#/c/461513/2/nova/compute/api.py@1762 | |
| 21:11:15 | sdague | req-bc378dc5-41f0-4df8-95cf-4226ae088007 is the req id on the metadata server, right? | |
| 21:11:19 | dansmith | hmm, good point, I thought we removed that | |
| 21:11:49 | dansmith | sdague: why do you say that? | |
| 21:12:01 | mriedem | req-bc378dc5-41f0-4df8-95cf-4226ae088007 is the request id in the original response for DELETE | |