| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-01-06 | |||
| 19:20:32 | mriedem | if it's just a matter of using the scheduler report client right now because it's available and easy, then just do that and we can split apart and cleanup later | |
| 19:20:49 | bauwser | leakypipes: I wrote an encapsulation like cdent asked | |
| 19:20:56 | leakypipes | k | |
| 19:21:07 | bauwser | leakypipes: I wrote an inheritance because I was lazy | |
| 19:23:15 | bauwser | mriedem: just a question : we created a stable 14.0.2 pin but we have a DB migration in it, which requires a db sync, shouldn't we have created a 14.1.0 ? | |
| 19:23:36 | jroll | mriedem: I see you in my meeting agenda, are you attening or did you just want me to say words about that | |
| 19:23:46 | jroll | I'm up to date on the statuses of those things | |
| 19:25:46 | leakypipes | superdan: your eyeballs on https://review.openstack.org/#/c/415031/ would be appreciated. I know it's a blocker for mlavalle :) | |
| 19:25:49 | mriedem | bauwser: do we have rules anywhere about versions on stable branches that include a db migration? | |
| 19:25:54 | mriedem | bauwser: it was additive | |
| 19:26:22 | mriedem | bauwser: fyi our next stable/newton is going to have an online data migration bug fix in it too | |
| 19:26:26 | mriedem | not a schema migration though | |
| 19:27:27 | superdan | leakypipes: I have to figure out this cellsv1 thing before I can do anything else or we're all fscked | |
| 19:27:33 | superdan | so yeah, maybe but not today sorry | |
| 19:27:38 | leakypipes | superdan: not a problem. | |
| 19:27:59 | leakypipes | superdan: lemme know if I can assist on the cellsv1 issues. | |
| 19:28:07 | superdan | leakypipes: got any guns? | |
| 19:28:47 | mriedem | he does live in FL... | |
| 19:29:00 | mriedem | there are probably some just lying around | |
| 19:29:05 | superdan | I could loan him one | |
| 19:29:28 | jroll | he could just send floridaman your way | |
| 19:29:30 | superdan | sdague: back around yet? | |
| 19:29:55 | bauwser | mriedem: sorry, was diverted | |
| 19:30:10 | bauwser | mriedem: lemme look at semver rules in the governance repo | |
| 19:30:28 | bauwser | mriedem: but AFAIR, .z versions means just apt-get and then restarty | |
| 19:30:34 | bauwser | or yum :) | |
| 19:30:38 | bauwser | erf | |
| 19:30:39 | bauwser | dnf even | |
| 19:30:57 | bauwser | (shhhht, don't tell my employer :p ) | |
| 19:31:04 | jroll | heh | |
| 19:31:05 | mriedem | heh | |
| 19:31:21 | jroll | feels like db migrations would be a .y but I'd probably ask release folks | |
| 19:31:28 | mriedem | either way, | |
| 19:31:35 | mriedem | that ship has kind of sailed... | |
| 19:31:40 | mriedem | as of like a month ago | |
| 19:31:45 | bauwser | yeah I know | |
| 19:31:56 | bauwser | mriedem: it's somehow an internal discussion, y'know | |
| 19:32:04 | mriedem | bauwser: i figured | |
| 19:32:07 | bauwser | just popping up here :) | |
| 19:32:08 | mriedem | tell them i'm sorry, | |
| 19:32:18 | mriedem | bauwser: however, if they care about how upstream stable releases are versioned, | |
| 19:32:25 | mriedem | there is a way they can get involved in monitoring that... | |
| 19:32:52 | bauwser | mriedem: no worries, I'll ask them to leave tar and feather at home | |
| 19:33:29 | openstackgerrit | Dan Smith proposed openstack/nova: WTFWIP: Multicell support for instance listing https://review.openstack.org/396775 | |
| 19:33:30 | openstackgerrit | Dan Smith proposed openstack/nova: Make the SingleCellSimple fixture a little more comprehensive https://review.openstack.org/410472 | |
| 19:33:42 | melwitt | superdan: I dunno if you saw the scrollback but I was thinking I wonder if the hosts api call is going out on the wrong topic ('compute' instead of 'cells' topic, since the rpc connects get cached via cell uuid) and that's why it doesn't get a response there. I just don't get how that would start up with your patch and not being failing as-is | |
| 19:33:47 | openstackgerrit | Matthew Edmonds proposed openstack/nova: update policy UT fixtures https://review.openstack.org/398610 | |
| 19:35:14 | superdan | melwitt: hmm | |
| 19:35:45 | superdan | melwitt: I just put up a test what just comments out the fanout to the cells, which will fail a bunch of things, but I want to see if it affects the host bit | |
| 19:36:04 | mriedem | bauwser: so where are we at with cleaning up https://review.openstack.org/#/c/392569/ ? | |
| 19:36:29 | leakypipes | superdan: I live in Florida. of course I do. | |
| 19:36:37 | melwitt | because what's failing is this 'intercell' communication, the 'cells' topic | |
| 19:37:02 | superdan | melwitt: well, it's not actually.. if you look, the cells-child is failing to call to the compute via compute topic, which is cascading up | |
| 19:38:28 | melwitt | superdan: I thought this is showing a send to the 'cells' topic? http://logs.openstack.org/75/396775/21/check/gate-tempest-dsvm-cells-ubuntu-xenial/2d615a2/logs/screen-n-api.txt.gz?#_2017-01-06_16_06_16_678 | |
| 19:38:40 | superdan | melwitt: right, but hang on | |
| 19:38:51 | melwitt | lemme look in the other logs again | |
| 19:38:56 | superdan | melwitt: http://logs.openstack.org/75/396775/21/check/gate-tempest-dsvm-cells-ubuntu-xenial/2d615a2/logs/screen-n-cell-child.txt.gz?level=TRACE#_2017-01-06_16_01_16_493 | |
| 19:39:08 | superdan | that's what gets called, which makes a call to compute, which times out | |
| 19:43:04 | melwitt | it says FANOUT topic 'cells.intercell.response' for the same req-id. you're saying the call to compute will go on the 'compute' topic though, and that's not responding and thus doesn't end up responding on the cells topic | |
| 19:43:29 | superdan | melwitt: but it's a call to compute_rpcapi | |
| 19:43:48 | superdan | File "/opt/stack/new/nova/nova/compute/rpcapi.py", line 920, in get_host_uptime | |
| 19:44:19 | melwitt | yeah. okay. so it goes on cells topic -> compute topic then replies go backward. hmm | |
| 19:44:29 | superdan | right | |
| 19:46:02 | cdent | leakypipes: you might find this amusing or interesting: https://tank.peermore.com/_/8760ec93-b39a-4dd5-849f-d880572fb2cd | |
| 19:46:39 | cdent | that's a gabbit using a new $HISTORY feature in gabbi + some yaml anchors to play games with the placement api | |
| 19:47:22 | cdent | ./stack.sh && openrc admin && gabbi-run http://localhost < that.yaml | |
| 19:47:44 | cdent | gonna flesh it out a bit more, but going to dinner now | |
| 19:48:18 | cdent | s/openrc/. openrc/ | |
| 19:50:00 | melwitt | superdan: for cells v1 do we have a host mapping set up that has the child cell transport_url in it? | |
| 19:50:27 | melwitt | sorry cell mapping | |
| 19:50:41 | superdan | melwitt: yeah, should, but hmm, I wonder if that points to the wrong thing | |
| 19:50:56 | superdan | melwitt: in the devstack job, do we really have any different mq exchanges or anything? | |
| 19:51:01 | melwitt | I noticed the nova.conf and nova-cells.conf have different transport urls. but I don't get how it ever worked then | |
| 19:51:09 | superdan | ooooh | |
| 19:51:10 | superdan | because | |
| 19:51:17 | superdan | I just changed that in a not yet merged dep patch :) | |
| 19:51:21 | superdan | check the depends-on | |
| 19:52:40 | melwitt | ahhh | |
| 19:53:22 | superdan | please oh please tell me you spot something wrong in there :D | |
| 19:53:26 | superdan | PUHLEASE | |
| 19:53:43 | superdan | otherwise leakypipes will have to shoot me, | |
| 19:53:50 | superdan | and I hear he has bad aim and might have to take a few shots | |
| 19:54:20 | melwitt | thinking ... I think we need two cells, one for the api and one for the compute, being that they have different transport urls? I dunno, still thinking | |
| 19:54:53 | superdan | no, because the cellsv1 messaging isn't switched I think | |
| 19:55:00 | superdan | but we do need the cell mappings we have to point to the right place, | |
| 19:55:13 | superdan | so that when something calls on compute, it does so on the right bus | |
| 19:55:39 | melwitt | right ... so is that get_transport_url getting the right thing, because it needs to get it out of the nova-cells.conf | |
| 19:55:41 | superdan | so, | |
| 19:55:58 | superdan | right, I was going to say, get_transport_url is probably the api cell url, | |
| 19:56:09 | superdan | not the compute-cell url, which is what we need right? | |
| 19:56:22 | mlavalle | leakypipes thanks for the help :-) | |
| 19:56:24 | melwitt | yeah, I'm hoping that's what's happening because otherwise I dunno | |
| 19:56:35 | melwitt | looking for what get_transport_url does | |
| 19:56:59 | superdan | yeah, | |
| 19:57:04 | superdan | I need "get_transport_url child_cell" | |
| 19:57:09 | superdan | sonofa | |
| 19:57:29 | melwitt | yeah, need to pass the virtual_host. I really hope that fixes things | |
| 19:58:21 | superdan | yeah | |
| 19:58:42 | openstackgerrit | Sylvain Bauza proposed openstack/nova: WIP/DNM : Put all the magic in a PlacementClient https://review.openstack.org/417111 | |
| 19:58:43 | openstackgerrit | Sylvain Bauza proposed openstack/nova: Expose a REST API for a specific list of RPs https://review.openstack.org/392569 | |