| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-09-07 | |||
| 11:10:29 | gibi | bauzas: when you need some distraction there is two doc / reno patch up for review https://review.opendev.org/c/openstack/nova/+/807564 and https://review.opendev.org/c/openstack/nova/+/705667 | |
| 11:25:21 | gibi | stephenfin, sean-k-mooney: I added a topic about tox.ini basepython pinning to the PTG etherpad https://etherpad.opendev.org/p/nova-yoga-ptg L81 | |
| 11:42:28 | gibi | lyarwood: if you have time I could use your oppinion on https://bugs.launchpad.net/nova/+bug/1942766 | |
| 11:54:53 | lyarwood | gibi: yeah live and then persistent could be an option but ultimately a hard reboot would recover the situation so it's a `low` bug at best IMHO | |
| 11:55:37 | gibi | lyarwood: as the hard reboot will regenareate the xml from the db? | |
| 11:56:15 | lyarwood | gibi: correct it destroys the live domain and undefined the persistent domain before recreating everything based on what we have in the db | |
| 11:56:21 | lyarwood | undefines* | |
| 11:56:47 | gibi | cool, thanks | |
| 12:45:46 | opendevreview | Balazs Gibizer proposed openstack/nova master: Add more retries to TestMigrateFromDownHost tests https://review.opendev.org/c/openstack/nova/+/807714 | |
| 12:52:41 | gibi | lyarwood: a further tuning on these tests ^^ | |
| 12:52:59 | gibi | ohh I see you already checked | |
| 12:53:02 | gibi | thanks | |
| 12:53:08 | lyarwood | gibi: yup already reviewed, I did see a gate failure with this last week but didn't get time to look, thanks for sorting that again | |
| 12:53:35 | gibi | lyarwood: no problem, I like hunting down these :) | |
| 12:53:53 | gibi | and I think there is no way to avoid races sometime, nova is complex | |
| 12:53:54 | lyarwood | we all have our vices :D | |
| 12:54:03 | gibi | :D | |
| 13:35:55 | bauzas | man, I wish generated sphinx errors were simplier to debug with reno | |
| 13:40:49 | kashyap | bauzas: What's the error that's giving you grief? | |
| 13:41:10 | bauzas | /home/sbauza/git/openstack/nova/releasenotes/source/unreleased.rst:40: WARNING: Bullet list ends without a blank line; unexpected unindent. | |
| 13:41:45 | kashyap | Ah, I've seen this enough no. of times that it is now written into my brain's ROM | |
| 13:42:30 | bauzas | also, running the tox releasenotes target takes a while | |
| 13:42:38 | bauzas | it's repopulating all the releases | |
| 13:48:32 | opendevreview | Balazs Gibizer proposed openstack/nova master: Avoid unbound instance_uuid var during delete https://review.opendev.org/c/openstack/nova/+/805605 | |
| 14:28:38 | opendevreview | Merged openstack/nova master: fup: Print message logging uncaught nova-manage exceptions https://review.opendev.org/c/openstack/nova/+/807358 | |
| 14:29:10 | opendevreview | Merged openstack/nova master: console: Improve logging https://review.opendev.org/c/openstack/nova/+/778407 | |
| 14:31:10 | gibi | cores: do we support providing the adminPassword to the guest via the metadata service? | |
| 14:31:39 | gibi | I see that the metadata service trying to fetch the password from instance.system_metadata https://github.com/openstack/nova/blob/402fe188b4e7ff76109e8a5ea1f24a5e915eaa09/nova/api/metadata/password.py#L37 | |
| 14:31:52 | gibi | but I don't see we ever store the adminPassword there | |
| 14:32:31 | gibi | asking for due to https://bugs.launchpad.net/nova/+bug/1942709 | |
| 15:50:53 | gibi | FYI: nova meeting starts in 9 minutes here in the channel | |
| 15:59:01 | bauzas | gibi: I'll be a bit late, daughter's homework helping | |
| 15:59:08 | gibi | ack | |
| 16:00:10 | opendevmeet | The meeting name has been set to 'nova' | |
| 16:00:10 | opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | |
| 16:00:10 | opendevmeet | Meeting started Tue Sep 7 16:00:10 2021 UTC and is due to finish in 60 minutes. The chair is gibi. Information about MeetBot at http://wiki.debian.org/MeetBot. | |
| 16:00:10 | gibi | #startmeeting nova | |
| 16:00:53 | gibi | o/ | |
| 16:01:43 | dansmith | o/ | |
| 16:03:31 | gibi | #topic Bugs (stuck/critical) | |
| 16:03:46 | gibi | no critical | |
| 16:03:50 | gibi | #link 13 new untriaged bugs (-4 since the last meeting): #link https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New | |
| 16:03:57 | gibi | we have 1 bugs marked with xena-rc-potential tag #link https://bugs.launchpad.net/nova/+bugs?field.tag=xena-rc-potential | |
| 16:04:03 | gibi | https://bugs.launchpad.net/nova/+bug/1942345 fix is going through the gate | |
| 16:04:33 | gibi | and we have the placement transaction scope issue https://storyboard.openstack.org/#!/story/2009159 that is being worked on in https://review.opendev.org/c/openstack/placement/+/807014 | |
| 16:04:54 | gibi | I guess we should mark that as RC critical too | |
| 16:05:34 | gibi | I think melwitt's solution is OK but we cannot really make a reproduction test working in the functional env | |
| 16:05:40 | gibi | so I started running nova jobs against the fix | |
| 16:05:58 | gibi | in https://review.opendev.org/c/openstack/nova/+/807558 | |
| 16:06:16 | gibi | so far the runs there are not producing the error | |
| 16:06:48 | gibi | so probably we will land that fix without the reproduction test | |
| 16:07:24 | gibi | is there any other bug we should consider as RC critical? | |
| 16:07:37 | dansmith | you're saying that we can't repro the failure in functional, | |
| 16:07:51 | dansmith | but that's kinda expected and normal for these kinds of load-based heisenbugs right? | |
| 16:08:25 | gibi | dansmith: yes, it is a race that is hard to reproduce in a clean env (it needs mysql and it needs parallel transactions) | |
| 16:08:29 | bauzas | dansmith: the problem is about mysql | |
| 16:08:34 | dansmith | gibi: yeah | |
| 16:08:36 | bauzas | hah, jinxed | |
| 16:08:55 | bauzas | difficult to write a correct parallel test | |
| 16:09:11 | dansmith | yeah, just sounded like gibi was expecting we wouldn't land until we had a repro test | |
| 16:09:18 | dansmith | and I'm saying I'd have expected that to be impossible | |
| 16:09:26 | gibi | we tried the repro test but we faild | |
| 16:09:32 | gibi | so I'm OK to land this without a repro | |
| 16:10:13 | bauzas | "I guess we should mark that as RC critical too" > yes, please | |
| 16:10:42 | gibi | bauzas: OK, I will. It is already in the tracking etherpad https://etherpad.opendev.org/p/nova-xena-rc-potential | |
| 16:11:19 | gibi | so if there is no other bug for the RC then I have a question about https://bugs.launchpad.net/nova/+bug/1942709 | |
| 16:11:35 | gibi | do we support providing the adminPassword to the guest via the metadata service? | |
| 16:11:40 | gibi | I see that the metadata service trying to fetch the password from instance.system_metadata | |
| 16:11:43 | gibi | https://github.com/openstack/nova/blob/402fe188b4e7ff76109e8a5ea1f24a5e915eaa09/nova/api/metadata/password.py#L37 | |
| 16:12:07 | gibi | but as far as I see we dont store the password in instance.system_metadata on master | |
| 16:12:20 | gibi | and I was not able to track down changes around this in the git history | |
| 16:13:05 | dansmith | I don't remember if this works with libvirt | |
| 16:13:09 | dansmith | I want to say no | |
| 16:13:30 | bauzas | we need to look at the code honestly | |
| 16:13:52 | gibi | bauzas: please, I got stuck tracking done if it ever worked | |
| 16:14:04 | gibi | OK moving on then | |
| 16:14:15 | gibi | any other bug we need to discuss? | |
| 16:15:19 | gibi | #topic Gate status | |
| 16:15:24 | gibi | Nova gate bugs #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure | |
| 16:15:29 | gibi | The nova-next job should be passing now after the new osc-placement release on Friday | |
| 16:15:42 | gibi | Allocation deletion conflict still can happen, and it is being worked on in https://review.opendev.org/c/openstack/placement/+/807014 | |
| 16:15:58 | bauzas | gibi: wish me good luck for finding about the crap in sysmetadata | |
| 16:16:07 | gibi | bauzas: good luck! :) | |
| 16:16:33 | gibi | I'm not tracking other high frequency bugs in the gate I think we are able to merge code to master | |
| 16:16:43 | gibi | Placement periodic job status #link https://zuul.openstack.org/builds?project=openstack%2Fplacement&pipeline=periodic-weekly | |
| 16:16:49 | gibi | placement periodics are green | |
| 16:17:11 | gibi | any other gate issue we need to talk about? | |
| 16:18:20 | gibi | #topic Release Planning | |
| 16:18:24 | gibi | Release tracking etherpad #link https://etherpad.opendev.org/p/nova-xena-rc-potential | |
| 16:18:28 | gibi | We are in Feature Freeze. | |
| 16:18:41 | gibi | I'm not tracking any FFEs | |
| 16:18:57 | gibi | and not tracking any feature patches approved but not landed yet | |
| 16:19:06 | gibi | We need to produce RC1 latest on 17th of September which is in less than 2 weeks. | |
| 16:19:30 | gibi | yeah, bauzas writing the reno prelude as you see | |
| 16:19:32 | bauzas | I can't upload the prelude change because of a weird issue with my rst file | |
| 16:19:32 | gibi | :) | |
| 16:19:45 | bauzas | (actually, yaml one) | |
| 16:19:57 | gibi | bauzas: push it up and tomorrow I can look at it | |
| 16:19:58 | bauzas | hope to fix it sooner than later | |
| 16:20:15 | bauzas | gibi: yeah, if I can't find it, I'll throw it to the gate | |