| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-09-29 | |||
| 13:52:51 | superdan | computenode.host = self.host | |
| 13:52:53 | superdan | done | |
| 13:52:55 | johnthetubaguy | yeah, instead of add a new one | |
| 13:53:10 | johnthetubaguy | that's what I just attempted to say, badly | |
| 13:53:20 | superdan | I was going to suggest that we set it so we could do that once it was, but if it's already done we should be able to do that right away | |
| 13:54:15 | johnthetubaguy | I will take a look at doing that | |
| 13:54:29 | johnthetubaguy | in the ironic driver, or where we create the compute nodes already? | |
| 13:54:46 | superdan | um | |
| 13:54:59 | superdan | I'd have to go look at that.. I guess there's a bit of a layering violation in there some where | |
| 13:55:19 | superdan | maybe we can just make compute manager check for this situation and do the re-homing | |
| 13:56:36 | johnthetubaguy | yeah, I just worry about hostname clashes | |
| 13:56:38 | johnthetubaguy | in none ironic cases | |
| 13:56:45 | superdan | well, | |
| 13:56:54 | superdan | the hostnames have to be unique today or nothing works anyway | |
| 13:57:03 | superdan | but you could also is_uuid_like() on it for a total hack :) | |
| 13:57:22 | johnthetubaguy | good point, placement has that constraint now, hence the bug in the first place | |
| 13:57:23 | superdan | or set some capability attribute on the driver: CAN_REBALANCE_NODES | |
| 13:57:27 | superdan | LIKES_TO_SHARE=True | |
| 13:57:32 | johnthetubaguy | heh | |
| 13:57:35 | superdan | PLAYS_WELL_WITH_OTHERS=True | |
| 13:57:48 | johnthetubaguy | that doesn't sound right... | |
| 13:58:03 | superdan | we have to have unique hostnames for rpc to work anyway | |
| 13:58:30 | superdan | maybe not hypervisor_hostname I guess, but they should be the same for non-ironic ones anyway right? | |
| 13:58:50 | johnthetubaguy | isn't that one on the service, but yeah thats the same for regular virt | |
| 13:58:59 | johnthetubaguy | OK, I am convinced, will give that a whirl | |
| 13:59:36 | superdan | yes it's service.host that has to be unique but should be the same for virt systems | |
| 14:00:39 | johnthetubaguy | cool, just making sure, keep getting it all twisted | |
| 14:03:31 | cdent | register headline: OpenStack switches back to twisted | |
| 14:06:24 | superdan | mriedem: I hadn't seen your second flavor sysmeta patch.. I didn't test with it applied as well | |
| 14:06:55 | johnthetubaguy | cdent: heh | |
| 14:07:02 | mriedem | superdan: that shouldn't make a difference during instance list | |
| 14:07:15 | mriedem | since it's just used during (1) save and (2) lazy-loading of flavor i think | |
| 14:07:28 | superdan | mriedem: well, unless we started lazy-loading it, but yeah, I was checking for that in the logs anyway | |
| 14:11:44 | figleaf | cdent: heh, I remember the discussions that led to the switch from twisted to eventlet | |
| 14:13:42 | openstackgerrit | Merged openstack/nova-specs master: Update a URL https://review.openstack.org/489028 | |
| 14:25:16 | bauzas | superdan: https://review.openstack.org/#/c/498948/10/nova/compute/manager.py@3640 I'm not super expert of all the migration states but I guess a migration revert is not having an 'in-progress state' ? | |
| 14:25:45 | bauzas | I just want to make sure that we don't do the math if we're at the middle of a revert | |
| 14:26:14 | bauzas | wait | |
| 14:26:33 | bauzas | if we get allocations, we know we have nothing to do | |
| 14:26:46 | bauzas | so we shouldn't care of the migration state then ? | |
| 14:29:46 | superdan | bauzas: right that's just a short-circuit | |
| 14:48:36 | openstackgerrit | priyaduggirala proposed openstack/nova master: Rename arguments in call() of nova/image/glance.py https://review.openstack.org/508533 | |
| 14:50:10 | bauzas | superdan: corrolary question, if we are reverting and if we have allocations related to the migration, we of course don't remove them. But then, we will remove them once it's calling finish_revert_resize() right? | |
| 14:50:29 | leakypipes | cdent: I presume you found the scheduler presentation links? the links to the presentations are http://bit.ly/scheduler-wars-a-new-hope and http://bit.ly/scheduler-wars-revenge-of-the-split | |
| 14:50:39 | bauzas | superdan: nevermind, just saw https://review.openstack.org/#/c/498949/11/nova/compute/manager.py | |
| 14:50:45 | bauzas | okay, so +W | |
| 14:50:52 | cdent | leakypipes: i did not, thank you | |
| 14:51:06 | superdan | bauzas: check out the functional tests.. unless you find a gap, they're pretty obsessive about the allocations at all the steps | |
| 14:51:18 | bauzas | cool with me | |
| 14:51:43 | leakypipes | cdent: BTW, thanks again for continuing your resource provider update emails. they really are very helpful. | |
| 14:52:29 | leakypipes | cdent: also, nice use of the word "passel" | |
| 14:52:34 | cdent | leakypipes: you’re welcome. I decided this week I’d go short and focused, in part because that seemed like good timing, but also because sometimes I’m so far behind myself that I haven’t got time to do the big version. we are moving a _ton_ of code these days | |
| 14:58:15 | melwitt | superdan: I dunno if you saw this but I think I found a bug with the get_instance_object_sorted when there are faults. I explained it here https://review.openstack.org/#/c/505417/7/nova/tests/functional/compute/test_instance_list.py@453 | |
| 14:59:50 | superdan | melwitt: so we're not going to merge the patch that pre-joins faults | |
| 14:59:57 | superdan | so that test can go away | |
| 15:00:10 | superdan | is there actually a problem based on how the API works now, or just that that test failed? | |
| 15:01:12 | melwitt | superdan: it's that _from_db_object doesn't accept pre-joined attrs, i.e. it won't set them. so even after you pre-join it lazy-loads it. and with an untargeted _context, it won't be able to and will get a None fault | |
| 15:01:16 | superdan | and that test was intentionally not 3 cells (see mriedem's comment above) but only because it wasn't really needed | |
| 15:01:32 | superdan | melwitt: okay but the api isn't asking for fault to be joined | |
| 15:02:02 | superdan | melwitt: the api loads the faults it wants in a batch after having collected the full list | |
| 15:02:07 | melwitt | superdan: you mean nova-api? | |
| 15:02:15 | superdan | compute/api and above but yeah | |
| 15:02:23 | melwitt | okay | |
| 15:02:45 | superdan | so you can delete that test if you want and I can re-add it if I make the fault-joining patch work better | |
| 15:03:02 | superdan | melwitt: this is out of the stack at the moment: https://review.openstack.org/#/c/505456/10 | |
| 15:03:51 | melwitt | superdan: okay, so you're saying get_instance_object_sorted won't ever be used the way it is in that test | |
| 15:04:13 | superdan | not until I fix the above patch yeah | |
| 15:05:02 | melwitt | okay. yeah, I guess the only thing to look out for is if you want lazy-loads to work on the resulting cross-cell list, you'll have to make sure each of their _context are targeted to their cell | |
| 15:05:32 | superdan | yeah I'm not sure why they wouldn't be in this case, but it's not a scenario we request at the moment anyway | |
| 15:06:00 | melwitt | I think each Instance object is inited with the same untargeted context | |
| 15:06:03 | superdan | you could make the test use 3 cells and make it an xfail with a comment and I can come back to it when I work on the patch if you want | |
| 15:06:29 | melwitt | so lazy-loads wouldn't work | |
| 15:06:33 | superdan | melwitt: but it should be initialized with the context that scatter_gather_all_cells gave to the ... | |
| 15:06:34 | superdan | ohhh | |
| 15:06:35 | superdan | I see | |
| 15:06:44 | superdan | yep, I get it | |
| 15:06:47 | melwitt | k | |
| 15:07:12 | superdan | anyway, feel free to disable or remove that test for your immediate purposes and I'll circle back to it when I try to optimize the fault bit | |
| 15:07:45 | openstackgerrit | Chris Dent proposed openstack/nova master: [placement] gabbi tests for shared custom resource class https://review.openstack.org/485209 | |
| 15:09:11 | mriedem | for anyone that cares, the change to get this legacy nnet job out of nova is here https://review.openstack.org/#/c/508519/ | |
| 15:09:14 | mriedem | we're blocked until then | |
| 15:10:16 | superdan | bummer | |
| 15:11:48 | mriedem | superdan: btw, i was going to propose a forum session to brainstorm ideas for some automated perf testing like what was done this week, for a few reasons, | |
| 15:11:59 | mriedem | like automating it, but also find out what other projects have done, if anything, | |
| 15:12:13 | superdan | mriedem: we've discussed that a few times, and in boston even | |
| 15:12:21 | melwitt | some other projects use rally for that | |
| 15:12:28 | superdan | always comes back to not having stable enough stuff | |
| 15:12:38 | mriedem | and because there are several work group sessions, like the public cloud one, where they are talking about "what features do we want?!" and i want to say "what scale testing do we need?!" | |
| 15:12:47 | mriedem | this wouldn't be voting | |
| 15:13:07 | superdan | it's just a matter of having useful data, and as you saw, it's hard to compare two runs | |
| 15:13:21 | superdan | even if not voting, if you can't actually draw conclusions... | |
| 15:13:25 | mriedem | was thinking experimental queue so it's on-demand for things we know might impact performance | |
| 15:13:51 | mriedem | my thought was the job pulls master, runs some baselines, then applies the change, runs the same tests and compares for the relative difference | |
| 15:13:51 | superdan | you can compare normalized metrics like number of db queries or something, but runtime and cpu usage are not really doable without dedicated hardware | |
| 15:14:08 | superdan | noisy neighbor problems will still skew those | |
| 15:14:17 | superdan | the window is smaller, granted, but.. | |
| 15:14:20 | mriedem | ok, so maybe a requirement is it runs on baremetal? | |
| 15:14:33 | superdan | that would be better yeah | |
| 15:14:39 | mriedem | point being, | |
| 15:14:43 | mriedem | there is an obvious need, | |