| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-04-30 | |||
| 15:02:44 | bauzas | owalsh: like I said, I think it's not a nova problem | |
| 15:02:45 | jaypipes | not sure I helped much :) | |
| 15:03:03 | bauzas | owalsh: rather a configuration issue because of the HTTP503 | |
| 15:03:23 | bauzas | jaypipes: you did, dude ,) | |
| 15:03:44 | bauzas | jaypipes: I'm a bit said to no longer be a Placement expert | |
| 15:04:01 | bauzas | jaypipes: so having you telling me if I'm right is definitely helping me :) | |
| 15:05:27 | owalsh | jaypipes, bauzas: thanks guys, helps me a lot if we can rule out placement as the root cause :-) | |
| 15:05:45 | bauzas | owalsh: I think Placement is a canary | |
| 15:06:02 | bauzas | like we had NoValidHost for something else | |
| 15:06:20 | owalsh | bauzas: yea, was just about to say... NoValidHost is the canary | |
| 15:06:48 | bauzas | fortunately, we now have a separate exception | |
| 15:07:59 | bauzas | efried: jaypipes: stephenfin: oh btw. thanks for having reviewed my vGPU series. FWIW, https://twitter.com/sylvainbauza/status/990884997010685953 :) | |
| 15:10:38 | melwitt | mriedem: I noticed the novaclient change on "Add host/hostId to instance action events API" https://review.openstack.org/#/c/564667 has merged. is everything done for that bp now and time to remove from runway? | |
| 15:11:08 | mriedem | melwitt: yeah, i marked the bp complete on friday i think, but forgot to remove it from runways | |
| 15:11:35 | melwitt | mriedem: k, cool | |
| 15:19:04 | stephenfin | bauzas: :) | |
| 15:23:52 | dansmith | jaypipes: why are we not migrating the records for allocations that were created before user/project were required? | |
| 15:24:27 | melwitt | dansmith: those should be auto-healed right, by compute updates | |
| 15:24:38 | dansmith | melwitt: I don't think so | |
| 15:25:00 | melwitt | dansmith: that was the thinking as to why no migration was added when user/project were added | |
| 15:25:02 | dansmith | making them auto-heal is what I mean by migrating | |
| 15:25:24 | melwitt | any update to allocations should add user/project if not already existing | |
| 15:25:48 | dansmith | right, but does the reportclient re-write the allocation if just project/user is missing/ | |
| 15:25:53 | dansmith | I thought it just counted resources | |
| 15:26:42 | dansmith | reportclient has become too complicated for me to be able to reasonably look I think | |
| 15:26:44 | jaypipes | dansmith: cdent doesn't think user and project should be NOT NULL... | |
| 15:26:58 | dansmith | jaypipes: because why? | |
| 15:27:04 | melwitt | I'm gonna look again | |
| 15:27:27 | dansmith | jaypipes: I was asking because we're making things nullable to add the consumer generation, | |
| 15:27:32 | jaypipes | dansmith: I'm not sure. he thinks that consumers in placement shouldn't need a project or user. so that placement can be used "for more things than just nova" was his answer. | |
| 15:27:42 | dansmith | jaypipes: but I guess unless we bump the minimum microversion we have to support those continuing to be created | |
| 15:27:55 | jaypipes | dansmith: yes, I would like to see those be NOT NULL, but there was stiff resistance from both cdent and edleafe | |
| 15:28:00 | dansmith | jaypipes: user/project is required in later microversions right? | |
| 15:28:39 | dansmith | if clients use older microversions just to get themselves an allocation without user/project, things are going to fall apart pretty quick | |
| 15:29:05 | jaypipes | dansmith: 1.8 added them. 1.12 made them required for allocations. | |
| 15:29:21 | jaypipes | dansmith: yes, I've argued this with both cdent and edleafe. | |
| 15:30:38 | dansmith | jaypipes: yeah, so not enforcing them in schema because people could be using older microversions is valid, but expecting people to use 1.5 going forward just because the want to create non-multitenant allocations is crazypants | |
| 15:33:25 | jaypipes | dansmith: I agree with you. | |
| 15:34:44 | openstackgerrit | Vladyslav Drok proposed openstack/nova master: ironic: Report resources as reserved when needed https://review.openstack.org/517921 | |
| 15:35:31 | fishbone_ | hello all, I receive an error in the instance log when loading windows instances: pywintypes.com_error: (-2147352567, 'Exception occurred.', (0, 'Session', 'Access is denied. ', None, 0, -2147024891), None) | |
| 15:36:15 | fishbone_ | My first assumption is updating the cloudbase-init package on the images but would anyone know another possible cause? | |
| 15:37:38 | melwitt | dansmith: looks like any update of allocations will delete the already existing allocations, so because user/project is required >= 1.8, compute updates should result in ensuring user/project exist for allocations https://github.com/openstack/nova/blob/master/nova/api/openstack/placement/objects/resource_provider.py#L2065 | |
| 15:38:01 | dansmith | melwitt: right, but computes don't just update allocations all the time | |
| 15:38:36 | openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Remove support for Intel CMT `perf` events https://review.openstack.org/565242 | |
| 15:38:54 | melwitt | okay, I had thought there was a periodic update, but that was temporary right? I think that was happening back when microversion 1.8 was added | |
| 15:39:59 | dansmith | melwitt: we don't heal active instances since ocata | |
| 15:41:12 | melwitt | dansmith: okay, I think 1.8 was added in pike. so it sounds like we are missing a migration of already existing instances | |
| 15:41:39 | dansmith | melwitt: well, it doesn't matter if we're not going to do the needful on the placement side | |
| 15:41:45 | dansmith | I mean, doesn't matter for my question above | |
| 15:41:55 | dansmith | matters for us using that data for quotas later, but not what I was asking about | |
| 15:42:07 | dansmith | hmm, I have op for some reason.. do we need a topic update before I drop it? | |
| 15:42:24 | melwitt | yeah, need to swap a runway | |
| 15:42:41 | melwitt | one of them has merged as of friday | |
| 15:43:11 | dansmith | it would help if you could make sure the actual blueprint tag is in the runway description somewhere | |
| 15:43:16 | dansmith | so I can just copy that in and not have to look it up | |
| 15:43:25 | melwitt | okay, can do | |
| 15:43:30 | dansmith | s/you/whoever is doing the runway jostling/ | |
| 15:46:57 | melwitt | thanks | |
| 15:47:04 | dansmith | aye | |
| 15:50:07 | melwitt | yikun: fyi, your blueprint add-host-to-instance-action-events has been removed from the review runway as all the related code has merged. please feel free to add feedback about your experience with review runways at L186 https://etherpad.openstack.org/p/nova-runways-rocky | |
| 16:38:37 | openstackgerrit | Aditya Vaja proposed openstack/nova master: remove IVS plug/unplug as they're moved to separate plugin https://review.openstack.org/534371 | |
| 17:00:57 | openstackgerrit | Jay Pipes proposed openstack/nova-specs master: Standardize CPU resource tracking https://review.openstack.org/555081 | |
| 17:11:59 | jaypipes | stephenfin: you there? do you see "(provider network" clipped to "rovider network)" on the graphics in http://logs.openstack.org/90/541290/9/check/build-openstack-sphinx-docs/0278227/html/specs/rocky/approved/numa-aware-vswitches.html? | |
| 17:12:18 | jaypipes | not sure if I'm the only one that sees it because of my browser or something | |
| 17:15:14 | artom | jaypipes, FWIW, I see it too | |
| 17:15:43 | artom | Both FF and Chrome | |
| 17:27:07 | jaypipes | mriedem, dansmith: mgagne mentioned on the ML that the latest Nova no longer includes user_id in the request spec. Is that true? Did we remove user_id from the request spec somehow? I don't see user_id in the request spec object, but I also don't see a major object version bump so I'm unsure if user_id was ever there? | |
| 17:27:46 | mgagne | jaypipes: could be that when RequestSpec was created/used, user_id was dropped without mention | |
| 17:28:52 | dansmith | jaypipes: pretty sure it wasn't dropped | |
| 17:29:18 | mgagne | I think there are no filter using it so maybe people saw no need to still support it | |
| 17:30:28 | mgagne | I know it used to be available in filter_properties['instance_properties']['user_id'] | |
| 17:30:38 | mgagne | in fact | |
| 17:30:53 | mgagne | filter_properties['request_spec']['instance_properties']['user_id'] | |
| 17:31:04 | jaypipes | hmm.. | |
| 17:31:19 | dansmith | oh in filter_properties | |
| 17:31:25 | dansmith | that wouldn't require a bump | |
| 17:31:54 | dansmith | mgagne: this is an internal nova object, what are you concerned about it being missing for? | |
| 17:31:58 | dansmith | because of scheduling? | |
| 17:31:59 | mgagne | dropped -> forgot to reimplement it | |
| 17:32:26 | mgagne | dansmith: for a custom filter http://lists.openstack.org/pipermail/openstack-dev/2018-April/130022.html | |
| 17:33:25 | dansmith | okay so you care that it's not coming to your filter | |
| 17:33:36 | mgagne | yes | |
| 17:33:47 | dansmith | is this where I say it's bad that we say we have a plugin interface we know is not stable because we don't test it and pass internal data structures to it? :) | |
| 17:34:16 | mgagne | ¯\_(ツ)_/¯ don't care much, it fits my need ;) | |
| 17:44:34 | mgagne | If there is a defined object/interface, I will use it. Otherwise I will find a way to make it work. No much I can do to avoid that when the business I work for needs it. | |
| 17:44:44 | mgagne | If I can contribute something back (and don't forget about it), I will. If it's too much work/time, it's gonna go in the backlog and will try to contribute when time is available. | |
| 17:47:43 | mriedem | i don't see anything specific to instance_properties['user_id'], the request spec 'instance_properties' looks like it's getting built from build_request_spec in certain flows, but that's using the instance object, which should have user_id on it | |
| 17:48:29 | mriedem | build_request_spec is also used when a really old instance is moved and doesn't have a request spec | |
| 17:48:58 | mriedem | mgagne: i think i know what you're probably hitting | |
| 17:49:04 | mriedem | mnaser hit it too | |
| 17:49:07 | mriedem | and reported it | |
| 17:49:49 | mriedem | https://review.openstack.org/#/c/529185/ | |
| 17:49:50 | mgagne | I already have an internal patch I can contribute: https://gist.github.com/mgagne/ed1fd3251997b2e60564fed43f47d96f | |
| 17:50:27 | mgagne | just need to port it for master, currently against mitaka | |
| 17:51:17 | mriedem | mgagne: my guess is you are hitting a symptom of the same bug that ^ is working around | |
| 17:51:31 | mriedem | in that data migrations for instances that didn't have request specs used an admin context, which doesn't have project_id or user_id set | |
| 17:51:46 | mgagne | project_id is available for me | |
| 17:51:57 | mgagne | but the object just doesn't have the user_id attribute | |
| 17:51:59 | mriedem | because that workaround puts it into the request spec | |
| 17:52:17 | mriedem | are you hitting this on a move operation? | |