| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-09-28 | |||
| 16:12:36 | lyarwood | bauzas: and even if it had that's on os-brick not nova | |
| 16:12:54 | bauzas | do we have a reproduction test ? | |
| 16:12:58 | bauzas | e0ne: ^ | |
| 16:12:58 | lyarwood | tbh this just smells like a poorly tested codepath | |
| 16:13:17 | e0ne | lyarwood: there was an issue with CI. it's fixed now | |
| 16:13:50 | bauzas | e0ne: you mean that CI wasn't using the latest osbrick hence not seeing the issue ? | |
| 16:13:54 | e0ne | mellanox CI should fail with this issue on os-brick patches now | |
| 16:14:00 | bauzas | ack | |
| 16:14:51 | bauzas | fwiw, gibi also has another bugfix he wants to merge that's not a regression, so I guess we will provide a Xena stable release like 2 weeks after GA | |
| 16:15:05 | e0ne | bauzas: when I merged that patch I was confused by mellanox CI Cinder-tgtadm | |
| 16:15:14 | lyarwood | yup either way I don't think this needs to land in rc | |
| 16:15:29 | gibi | bauzas: yupp this is a 1/3 xena regression and 2/3 existing bug in wallaby https://bugs.launchpad.net/nova/+bug/1945310 | |
| 16:15:59 | gibi | bauzas: and I'm fine to include it in 24.0.1 later | |
| 16:16:09 | bauzas | ok, then let's do this | |
| 16:16:12 | e0ne | lyarwood: ok, I totally understand you. thanks for letting me discuss it | |
| 16:16:24 | bauzas | e0ne: ping me when you're done with the reno patch | |
| 16:16:34 | e0ne | bauzas: ok, will do | |
| 16:16:35 | bauzas | e0ne: use the 'bugs' section for it please | |
| 16:16:50 | bauzas | cool | |
| 16:17:06 | bauzas | and for the fix itself, let's review it sooner than later in master | |
| 16:17:30 | bauzas | so we could backport it to stable/xena as quickly as we can | |
| 16:17:46 | bauzas | lyarwood: do you had time to review the fix itself ? | |
| 16:18:02 | lyarwood | I already have several times | |
| 16:18:12 | bauzas | nice | |
| 16:18:25 | bauzas | so we need a second core volunteering for reviewing it :) | |
| 16:18:27 | lyarwood | https://review.opendev.org/c/openstack/os-brick/+/800014/7/os_brick/initiator/connectors/nvmeof.py#199 and FWIW I think this is a regression in os-briclk | |
| 16:18:42 | bauzas | hah | |
| 16:18:52 | bauzas | so, no nova impact ? | |
| 16:19:00 | e0ne | lyarwood: I'll discuss it in cinder meeting tomorrow too | |
| 16:19:11 | bauzas | ok, then let's clarify the solution later | |
| 16:19:29 | bauzas | the reno doc is the priority, the fix itself needs a bit more care I guess | |
| 16:19:31 | bauzas | moving on | |
| 16:19:41 | bauzas | #topic Gate status | |
| 16:19:48 | bauzas | Nova gate bugs #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure | |
| 16:19:55 | bauzas | we triaged a few other ones | |
| 16:20:00 | bauzas | but, | |
| 16:20:05 | bauzas | CI is blocked due to nova-grenade-multinode issue and apache placement issue | |
| 16:20:08 | bauzas | gmann: your turn | |
| 16:20:38 | gmann | frickler: ianw_pto figured it out on apache2 security bugs, you might have seen in email | |
| 16:21:03 | gmann | we have two option 1. no trailing '/' 2. having trailing '/' in both url and target | |
| 16:21:26 | gmann | later one seems causing keystone error so we might need to go with first one | |
| 16:21:30 | bauzas | grabbing the link for the sake of understanding | |
| 16:21:45 | gibi | that is the current fix proposal #link https://review.opendev.org/c/openstack/devstack/+/811399 | |
| 16:21:54 | bauzas | #link http://lists.openstack.org/pipermail/openstack-discuss/2021-September/025101.html | |
| 16:22:12 | gmann | but we need to do it on stable branches first due to grenade jobs , I will try to push changes in stable in reverse order and see if it all work till master. | |
| 16:22:25 | bauzas | tl:dr: apache config is swallowing the placement endpoint URL | |
| 16:22:46 | gmann | so in summary it may take time, hope today we get fixes in | |
| 16:23:08 | gibi | gmann: the stable/victoria fix failing with ceph issue now https://review.opendev.org/c/openstack/devstack/+/811399 | |
| 16:23:08 | gmann | gibi: yeah and ceph things on victoria is another thing | |
| 16:23:17 | bauzas | gmann: any pointer for the nova-grenade-multinode issue ? | |
| 16:23:20 | gibi | gmann: yepp, it is not relataed but it is blocking | |
| 16:23:26 | gmann | true | |
| 16:23:39 | bauzas | gmann: can't see any bug for either the apache issue or the grenade thing | |
| 16:23:51 | gmann | bauzas: nova-grenade-multinode you mean for neutron-truck extension right? | |
| 16:23:56 | bauzas | this is correct | |
| 16:23:57 | gibi | gmann: right | |
| 16:24:20 | gmann | yeah, I have lyarwood patch in list. let's get this apache things in then I will take a look into that | |
| 16:24:28 | lyarwood | https://review.opendev.org/c/openstack/grenade/+/811117 is the fix for that | |
| 16:24:31 | lyarwood | I can create a bug | |
| 16:24:32 | gibi | yepp we need to fix the apache first anyhow | |
| 16:24:34 | gmann | yeah ^^ | |
| 16:24:55 | gmann | lyarwood: that will be good to track, please file | |
| 16:25:00 | bauzas | #link https://review.opendev.org/c/openstack/grenade/+/811117 | |
| 16:25:15 | bauzas | gmann: if you can do the same for the devstack bug, it would be appreciated | |
| 16:25:36 | gmann | bauzas: sure, we have not logged yet :). will do | |
| 16:25:47 | gmann | lyarwood: is nova-grenade-multinode breaking in stable too? | |
| 16:26:06 | lyarwood | Yeah everything with focal | |
| 16:26:10 | lyarwood | oh wait | |
| 16:26:11 | bauzas | \o/ | |
| 16:26:15 | lyarwood | I'm mixing things | |
| 16:26:26 | gmann | we did extension cap in devstack stable/ but need to check if we have neutron-truck in the list there or no | |
| 16:26:34 | lyarwood | no AFAICT that's just stable/xena to master I think | |
| 16:27:04 | gmann | lyarwood: ok, stable/xena is not capped with extension yet | |
| 16:27:08 | bauzas | we definitely need bug reports to understand the impact :) | |
| 16:27:22 | gibi | I also think wallaby is not affecte by the trunk testing problem in grenade | |
| 16:27:43 | bauzas | stable/xena is the top priority I'd say | |
| 16:27:49 | lyarwood | gmann: would you have a link to the cap on stable/wallaby? | |
| 16:27:56 | gmann | gibi: ok, need to check if that extension is enbaled or not may be we are just skipping it :) but I will check | |
| 16:28:02 | bauzas | we can delay stable releases | |
| 16:28:10 | bauzas | but we can't delay Xena GA | |
| 16:28:27 | gmann | lyarwood: https://github.com/openstack/devstack/blob/stable/wallaby/lib/tempest#L669-L685 | |
| 16:28:29 | gmann | #link https://github.com/openstack/devstack/blob/stable/wallaby/lib/tempest#L669-L685 | |
| 16:28:30 | gibi | but we have to fix stable grenade first to fix master to have GA :D | |
| 16:28:43 | bauzas | yeah, tangled. | |
| 16:28:54 | bauzas | and this is not a Disney. | |
| 16:29:06 | bauzas | anyway, I guess we can move on ? | |
| 16:29:07 | gibi | with this apache update just now Murphy hit us hard | |
| 16:29:56 | bauzas | with this last words from gibi full of hope, I guess we can move on | |
| 16:29:57 | bauzas | :D | |
| 16:30:07 | gmann | I will try to push extensions cap in xena too but anyways we have to get apache fix in first | |
| 16:30:20 | bauzas | Placement periodic job status #link https://zuul.openstack.org/builds?project=openstack%2Fplacement&pipeline=periodic-weekly | |
| 16:30:29 | bauzas | Please look at the gate failures, file a bug, and add an elastic-recheck signature in the opendev/elastic-recheck repo (example: #link https://review.opendev.org/#/c/759967) | |
| 16:30:34 | bauzas | #topic Release Planning | |
| 16:30:40 | bauzas | Release tracking etherpad #link https://etherpad.opendev.org/p/nova-xena-rc-potential | |
| 16:31:00 | bauzas | RC2 proposals are up for approval #link https://review.opendev.org/c/openstack/releases/+/811092 and https://review.opendev.org/c/openstack/releases/+/811094 | |
| 16:31:08 | bauzas | Remember to propose regression bugfixes for a new RC with nova-xena-rc-potential | |
| 16:31:13 | bauzas | Final RC to be proposed before end of Thursday Oct 1st (only if needed) | |
| 16:31:20 | bauzas | (gibi): Potential Xena regression #link https://bugs.launchpad.net/nova/+bug/1945310 | |
| 16:31:32 | gibi | yepp | |
| 16:31:34 | gibi | as I said about | |