Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2018-08-29
15:33:31 mriedem i don't really have any news; some info is coming in on the cross-cell migration stuff and i'm trying to probe internally (yes wording intended) on how our product team did this for cascading aka cells v1
15:33:51 dansmith tssurya: oh so you'll be in denver yeah?
15:33:57 tssurya yes :)
15:34:01 mriedem Kevin_Zheng knows more about what our product team did than i ever will
15:34:27 dansmith tssurya: that's cool, although I'm disappointed you'll be seeing the least nice venue in our fair country :/
15:34:49 tssurya dansmith: haha really ? its actually gonna be my first time in your country
15:35:04 dansmith tssurya: I know, which is why I'm disappointed :/
15:35:05 mriedem if i remember kevin's email correctly, tl;dr was that ports and volumes are accessible across cells for them
15:35:24 mriedem colorado is "nice" depending on where you are
15:35:32 mriedem out by the airport is not so much
15:35:40 dansmith yes, colorado is for sure
15:35:49 dansmith but the hotel and area we're in sucks
15:35:54 tssurya heh, I booked into the same venue as the conference
15:35:56 tssurya oops
15:35:59 mriedem everyone did
15:36:02 dansmith unless you like living next to a freeway onramp with a big train
15:36:05 dansmith tssurya: you have to be there, yeah
15:36:15 dansmith tssurya: it'snot close to anything, which is part of the problem
15:36:21 mriedem i just hope you like ihop
15:36:22 mriedem every
15:36:24 mriedem morning
15:36:31 dansmith mriedem: don't think we're not
15:36:35 mriedem oh i know
15:36:43 mriedem my stretch pants are on order
15:36:47 dansmith we will put 20lbs on tssurya before she's gone
15:36:49 tssurya rolf
15:36:53 dansmith her family won't recognize her
15:37:07 tssurya :P that is gonna be hard considering the amount I eat
15:37:09 dansmith tssurya: the denver ptg comes with a complimentary case of type 2 diabetes
15:37:21 kashyap LOL
15:37:27 tssurya :D
15:37:40 mriedem luckily she probably gets free health care in switzerland
15:37:55 dansmith they won't know what to do with her
15:37:58 kashyap Is the venue so bad? I read somethings about a train being noisy apparently last time.
15:38:04 dansmith they don't have the IHOP antidote
15:38:07 mriedem kashyap: that is reportedly fixed
15:38:12 kashyap (And you're in the same venue this time -- assuming that problem is fixed)
15:38:15 kashyap mriedem: Ah, I see.
15:38:18 tssurya you both are making it sound really bad, hopefully you are just kidding
15:38:22 dansmith mriedem: med made it sound like maybe not
15:38:30 dansmith tssurya: it's pretty bad
15:38:33 mriedem i'm bringing my white noise machine either way
15:38:47 jroll that's an odd name for your child
15:38:48 tssurya :(
15:38:52 dansmith tssurya: last year my room had a hole in the wall because they weren't finished with the remodel
15:39:00 tssurya really ?!
15:39:20 tssurya so its not really gonna like the Dublin PTG then..
15:39:20 dansmith tssurya: the foundation got a *smashing* deal..
15:39:34 dansmith tssurya: probably less snow, but no promises
15:39:49 jroll I missed the last one in denver, dansmith is making me so excited
15:39:55 tssurya heh,
15:40:04 dansmith jroll: HOOOOOOOOOONK
15:40:14 dansmith jroll: HOOOOOOOOOOOOOOOOOOOOOOOOOOOONK
15:40:22 jroll :P
15:40:23 dansmith every ten minutes
15:40:27 dansmith every
15:40:27 dansmith ten
15:40:29 dansmith minutes
15:40:35 tssurya I will be there on Thursday, so I have like 4 days to go around, maybe I can see the nice part of colorado
15:40:37 dansmith sometimes at night I still hear it
15:41:05 dansmith jroll: you know it's bad when at checkin they hand you a noise machine and earplugs
15:41:09 dansmith literally.
15:41:17 dansmith until they ran out of course
15:41:21 jroll yeah, so I heard
15:41:22 edleafe tssurya: Rocky Mountain National Park may help you if you're missing the Alps
15:41:36 jroll I get in monday night. so. I guess I'll bring my own
15:42:00 tssurya edleafe: nice I will see if I can go there, just waiting for the visa to be in my hand..
15:42:31 mriedem tssurya: you're in luck! https://www.google.com/search?q=denver+broncos+schedule&ie=utf-8&oe=utf-8&client=firefox-b-1-ab#sie=m;/g/11hdb0xw6z;6;/m/059yj;dt;fp;1
15:42:49 mriedem you can go watch the broncos get destroyed at home!
15:43:04 tssurya mriedem: ha!
15:43:22 mriedem https://deadspin.com/why-your-team-sucks-2018-denver-broncos-1828078886
15:46:00 cfriesen mriedem: the "four friends kitchen" in Denver is really good, but a bit further away.
15:54:28 mriedem gibi: i think i know what's going on in https://bugs.launchpad.net/nova/+bug/1781648
15:54:28 openstack Launchpad bug 1781648 in OpenStack Compute (nova) "heal_allocations test randomly failing with "ValueError: Field `compute_node_uuid' cannot be None"" [Medium,Confirmed]
15:54:40 mriedem we're racing with the caching scheduler starting up and initializing the cache of compute nodes
15:54:50 mriedem so by the time we hit the scheduler, the cache is empty
15:56:07 gibi mriedem: that sounds like a reasonable explanation. I guess I missunderstood the logs when I stated in the bug that the host creation overlaps with the scheduling
15:59:07 gibi mriedem: so I guess the fix is that we need to wait in the test a bit
16:00:43 openstackgerrit Matt Riedemann proposed openstack/nova master: Restart scheduler in TestNovaManagePlacementHealAllocations https://review.openstack.org/597571
16:00:45 mriedem sort of ^
16:02:09 mriedem i thought about also changing this https://github.com/openstack/nova/blob/master/nova/scheduler/caching_scheduler.py#L78 to "if not self.all_host_states:" to handle the empty list case, but that could still be a weird race failure if we have 1 host but not both in the cache
16:02:23 gibi mriedem: your proposed start / stop is way better than a simple sleep in the test
16:02:34 mriedem i learned it from watching you gibi
16:04:09 gibi :)
16:05:32 melwitt .
16:05:51 gibi mriedem: I'm wondering how many other functional tests uses CachingScheduler and therefore might be affected by the same race
16:06:10 mriedem gibi: some do, but they might start the scheduler after the computes, i was just starting to audit that
16:06:43 gibi mriedem: cool
16:14:37 mriedem mlavalle: smcginnis: on this cross-cell cold migration thing nova will definitely need some pre-validation of the selected host,
16:15:04 mriedem i'm wondering if simply trying to create a volume attachment/port binding on the selected target host *in another cell* would be enough to tell us if that's not going to work for storage/networking
16:15:20 mriedem or in the case of port bindings, will neutron only fuss when we try to activate the target host port binding?
16:16:26 jaypipes zigo, mriedem: we have a rough timeframe of when this began occurring (the allocation ratio 0 thing...)?
16:17:28 mriedem earliest i know of is when naichuans reported it in the ML
16:18:01 mlavalle mriedem: the port binding is the result of asking the mechanism managers if they can bind the port in the indicated host. so the binding process is what you call the pre-validation of the selected host
16:18:11 melwitt dansmith: +1 to meeting skippage
16:18:12 mlavalle mechanism drivers^^^^
16:19:38 mlavalle so when you say create_port_binding, you are asking the mechanism drivers whether any of them can bind the port in the designated host
16:20:02 mriedem mlavalle: and if the network that the port is in doesn't cover that dest host, the port binding creation should fail?
16:20:48 sean-k-mooney mriedem: it will fail of non of the ml2 driver can bind the port to the correct network
16:20:53 mlavalle mriedem: correct. the question that the drivers ask themselves is whether they can a segment of the network reachable in that host

Earlier   Later