| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-09-25 | |||
| 20:25:07 | mriedem | so it's different and weird | |
| 20:25:25 | mriedem | when efried did the ksa-ification there was a spec so i don't remember what he did between releases | |
| 20:25:35 | mriedem | we might have just never completed the blueprint until that work was done, idk | |
| 20:26:29 | efried | Personally I really don't care how we track it. We already marked the current bp complete for Train, but... is it possible to un-mark it and instead push it to ussuri? | |
| 20:27:08 | efried | I marked it complete because we completed part of the work, and I figured we would want a new proposal for ussuri that describes what we got done, what we're going to do next, and what, if anything, has changed about the roadmap. | |
| 20:27:27 | efried | but that's more a statement of the spec than the bp | |
| 20:29:36 | efried | dustinc, mriedem: yeah, that seemed to work fine https://blueprints.launchpad.net/nova/+spec/openstacksdk-in-nova | |
| 20:29:41 | efried | so just reuse the same bp dustinc ^ | |
| 20:30:26 | efried | but I think the new spec should differ as noted, so probably not a fast-approval thing. | |
| 20:30:35 | efried | but still should be fairly trivial. | |
| 20:31:41 | openstack | bug 1841481 in OpenStack Compute (nova) "Race during ironic re-balance corrupts local RT ProviderTree and compute_nodes cache" [Medium,In progress] https://launchpad.net/bugs/1841481 - Assigned to Eric Fried (efried) | |
| 20:31:41 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add functional recreate test for bug 1841481 https://review.opendev.org/684840 | |
| 20:31:42 | mriedem | efried: ^ hopefully with all of the comments that is clear enough | |
| 20:31:54 | efried | ack | |
| 20:32:08 | mriedem | efried: for multi-release things we usually mark the bp as partially complete | |
| 20:32:15 | mriedem | and then create a new bp with the -<new release> | |
| 20:32:18 | mriedem | like with mox removal | |
| 20:32:24 | efried | yeah | |
| 20:32:41 | efried | Where/how/why does it matter which way we do it? | |
| 20:32:49 | efried | aka "who cares?" | |
| 20:33:02 | mriedem | idk that it does all that much, you'll just be carrying that spec forward for a long time potentially | |
| 20:33:17 | mriedem | but that's what you did with ksa-ification i think | |
| 20:33:33 | efried | which still isn't complete, really :( | |
| 20:33:49 | mriedem | cinder was the only one not done wasn't it? or also barbican/castellan? | |
| 20:34:01 | efried | cinder yes. I think we decided barbican was a no-op. | |
| 20:35:36 | mriedem | ah crap need to add the test | |
| 20:36:06 | openstack | bug 1841481 in OpenStack Compute (nova) "Race during ironic re-balance corrupts local RT ProviderTree and compute_nodes cache" [Medium,In progress] https://launchpad.net/bugs/1841481 - Assigned to Eric Fried (efried) | |
| 20:36:06 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add functional recreate test for bug 1841481 https://review.opendev.org/684840 | |
| 20:49:00 | efried | I will pay attention to this after RC1 | |
| 20:49:10 | efried | noting that I'm going to look for an opportunity to take some pto soon. | |
| 21:03:55 | openstackgerrit | Eric Fried proposed openstack/nova master: doc: attaching virtual persistent memory to guests https://review.opendev.org/680300 | |
| 21:07:22 | efried | alex_xu, stephenfin: Please merge this ^ asap assuming you're happy. | |
| 21:21:20 | efried | mriedem, stephenfin: Can one/both of you +A the prelude patch https://review.opendev.org/#/c/683327/ at this point so it gets in line after the deps? | |
| 21:22:34 | mriedem | done | |
| 21:22:50 | efried | thx | |
| 21:23:45 | mriedem | zzzeek: if you're about, i have a test which keeps failing trying to insert a resource to the db with this: | |
| 21:23:46 | mriedem | sqlalchemy.exc.InvalidRequestError: This session is in 'inactive' state, due to the SQL transaction being rolled back; no further SQL can be emitted within this transaction. | |
| 21:24:01 | mriedem | it's using a transaction factory context manager thing from oslo.db, | |
| 21:24:05 | zzzeek | mriedem: that woudl suggest someting went wrong prior to the thing you are trying t do | |
| 21:24:23 | zzzeek | like, youre in an exception handler or something like that | |
| 21:24:24 | mriedem | i would think if there was a problem with the insert, like a unique constraint failure or something, it'd be logged but i'm not seeing that | |
| 21:24:30 | mriedem | ah... | |
| 21:24:38 | mriedem | yes there is one of those in play | |
| 21:24:59 | zzzeek | mriedem: so, say you're in an exception throw, then you try to do somethign with an object, and something on it isn't loaded | |
| 21:25:03 | zzzeek | mriedem: that would cause this | |
| 21:25:24 | zzzeek | err inside a catch, that is | |
| 21:26:14 | mriedem | yeah it's blowing up from the transaction context manager added here: https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L691 | |
| 21:26:25 | mriedem | and likely from something in https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L703 | |
| 21:26:56 | mriedem | the weird thing is i'm hitting this https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L716 | |
| 21:26:59 | mriedem | so it shouldn't be re-raising | |
| 21:29:44 | mriedem | oh maybe this is failing https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L745 | |
| 21:29:50 | mriedem | adding some try/except/log | |
| 21:30:20 | mriedem | nope not hitting that | |
| 21:30:33 | mriedem | i'm definitely getting here https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L716 | |
| 21:39:34 | openstackgerrit | Eric Fried proposed openstack/nova master: Conf option cross-reference in config docs https://review.opendev.org/583025 | |
| 21:41:12 | zzzeek | mriedem: these are hard to debug | |
| 21:41:50 | mriedem | so we have another test that does this same thing but only within 1 nova-compute service, so i'm wondering if it's something with the thread local context stuff in oslo.db | |
| 21:41:55 | mriedem | b/c this test has 2 services using the same context | |
| 21:42:30 | mriedem | the other one was https://review.opendev.org/#/c/675496/ and things worked like a charm there | |
| 21:42:48 | mriedem | we hit DBDuplicateEntry, then do a get-and-update and squash the re-raise | |
| 21:42:52 | mriedem | but that's not working this time | |
| 21:47:38 | efried | dustinc: It looks like the ironic CI is failing again on service discovery, but I'm not sure why... | |
| 21:51:29 | efried | maybe not discovery | |
| 22:09:38 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Clear RT.compute_nodes entry if re-balance update fails https://review.opendev.org/684849 | |
| 23:10:57 | openstackgerrit | Merged openstack/nova master: Ignore sqla-migrate inspect.getargspec deprecation warnings on py36 https://review.opendev.org/684781 | |
| 23:11:04 | openstackgerrit | Merged openstack/nova master: Ignore warning from sqlalchemy-migrate https://review.opendev.org/684772 | |
| 23:11:10 | openstackgerrit | Merged openstack/nova master: docs: Clarify everything CPU pinning https://review.opendev.org/683437 | |
| 23:11:17 | openstackgerrit | Merged openstack/nova master: docs: Update CPU topologies guide to reflect the new PCPU world https://review.opendev.org/683485 | |
| 23:11:28 | openstackgerrit | Merged openstack/nova master: Move HostNameWeigher to a common fixture https://review.opendev.org/683874 | |
| 23:11:39 | openstackgerrit | Merged openstack/nova master: Correct link to placement upgrade notes https://review.opendev.org/684661 | |
| #openstack-nova - 2019-09-26 | |||
| 02:12:05 | openstackgerrit | Brin Zhang proposed openstack/nova master: Filter migrations by user_id/project_id https://review.opendev.org/674243 | |
| 02:51:35 | LiangFang | hi, could anybody share how to add agenda for next weekly meeting? Is there any etherpad link? thanks | |
| 05:42:21 | gibi | LiangFang: add your item to the agend be editing the wiki https://wiki.openstack.org/wiki/Meetings/Nova | |
| 06:27:56 | openstackgerrit | zhurong proposed openstack/nova master: [WIP] add cyborg tempest job https://review.opendev.org/670999 | |
| 08:13:41 | kashyap | ozzzo: Hi, just saw a few mentions in the scrollback; /me goes to look for the salient bits | |
| 08:14:52 | kashyap | ozzzo: Okay, saw your question: if you're using (a) 'host-passthrough'; and (b) mismatched microcode b/n Compute nodes, then no, you will _not_ be able migrate an instance across the said nodes. | |
| 08:16:54 | kashyap | ozzzo: In my talk, I did mention the impact of microcode on live migration, when using 'host-passthrough': | |
| 08:17:08 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Reset forced_destination before migration at a proper time https://review.opendev.org/684546 | |
| 08:17:08 | kashyap | ozzzo: efried: See slide-18: https://kashyapc.fedorapeople.org/Effective-Virtual-CPU-Configuration-in-Nova-Berlin2018.pdf | |
| 08:17:08 | openstack | bug 1845291 in OpenStack Compute (nova) "migration is not recheduled if the server originally booted with --availability-zone |
|
| 08:17:08 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Functional reproduction for bug 1845291 https://review.opendev.org/684545 | |
| 08:18:18 | kashyap | ozzzo: To quote at note at the end of slide-18 (which talks about 'host-passthrough': "Along with identical CPUs, identical kernel and microcode are a must for VM live migration!" | |
| 08:20:30 | kashyap | ozzzo: I'd also toss in, "identical BIOS settings" b/n the two COmpute nodes, too. | |
| 09:45:50 | victor286 | hello,so many people! | |
| 09:55:17 | openstackgerrit | Ivaylo Mitev proposed openstack/nova master: Fix incorrect usages of fake moref in VMware tests https://review.opendev.org/685020 | |
| 09:56:29 | kashyap | ozzzo: Also responded on e-mail | |
| 10:00:53 | openstackgerrit | Ivaylo Mitev proposed openstack/nova master: Fix incorrect usages of fake moref in VMware tests https://review.opendev.org/685020 | |
| 11:27:55 | openstackgerrit | Merged openstack/nova master: doc: attaching virtual persistent memory to guests https://review.opendev.org/680300 | |
| 11:28:02 | openstackgerrit | Merged openstack/nova master: Add a prelude for the Train release https://review.opendev.org/683327 | |
| 11:41:14 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: [WIP] add cyborg tempest job https://review.opendev.org/670999 | |
| 11:46:30 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Reset forced_destination before migration at a proper time https://review.opendev.org/684546 | |
| 11:46:30 | openstack | bug 1845291 in OpenStack Compute (nova) "migration is not recheduled if the server originally booted with --availability-zone |
|
| 11:46:30 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Functional reproduction for bug 1845291 https://review.opendev.org/684545 | |
| 13:12:40 | openstack | Launchpad bug 1845243 in OpenStack Compute (nova) stein "Nested 'path' query param in console URL breaks serialproxy" [High,Confirmed] | |
| 13:12:40 | mriedem | efried: we might want to consider https://bugs.launchpad.net/nova/+bug/1845243 as train-rc-potential for rc2 since the regression was introduced in train, it was also backported and released on stein and rocy | |
| 13:12:41 | mriedem | *rocky | |
| 13:13:26 | mriedem | so i think we have 2 potential bugs for rc2 https://bugs.launchpad.net/nova/+bugs?field.tag=train-rc-potential but i think we could still release rc1 today | |
| 13:16:48 | mriedem | i've updated the rc1 release patch https://review.opendev.org/#/c/684086/ | |
| 13:17:53 | mriedem | yaawang: were you able to test this fix for the numa live migration bug you reported? https://review.opendev.org/#/c/684409/ | |
| 13:28:21 | kashyap | sean-k-mooney: efried This was my answer to ozzzo, in an "FAQ form" :D - https://kashyapc.fedorapeople.org/CPU-microcode-host-passthrough-and-live-migration.txt | |