| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-09-07 | |||
| 09:12:31 | sean-k-mooney | its in the governace repo | |
| 09:12:43 | bauzas | ok, then it's not needed | |
| 09:13:02 | sean-k-mooney | https://github.com/openstack/governance/blob/master/reference/runtimes/xena.rst | |
| 09:13:41 | sean-k-mooney | technically i guess these are minimume but 3.6-3.8 is what is tested | |
| 09:14:04 | sean-k-mooney | technially i think we can mostly run on 3.5 | |
| 09:14:57 | sean-k-mooney | bbezak: i have rechecked the train version ill take a look at them again later today | |
| 09:15:22 | sean-k-mooney | bbezak: are you going to porpos a release to the git repo or would you like me to do that | |
| 09:17:40 | bbezak | sean-k-mooney: thx, I will try to propose git release for victoria/ussuri | |
| 09:45:02 | opendevreview | Balazs Gibizer proposed openstack/nova master: DNM: check nova job results with placement transaction fix https://review.opendev.org/c/openstack/nova/+/807558 | |
| 10:07:12 | bbezak | ussuri, victoria os-vif release has been proposed, as per docs - https://releases.openstack.org/reference/using.html#using-new-release-command. PTL needs to approve those, please take a look gibi: | |
| 10:07:15 | bbezak | https://review.opendev.org/c/openstack/releases/+/807694 https://review.opendev.org/c/openstack/releases/+/807696 | |
| 10:17:36 | sean-k-mooney | gibi: i have reviewed both for those ^ and they look good to me. we dont have any other pending backports that i see that we should wait for | |
| 10:18:26 | sean-k-mooney | i have some patch for master that i plan to backport but we can do another release for those in a few weeks they are not urgent and release are pretty cheap so i have no issue with defering them for now | |
| 10:18:28 | bauzas | gibi: permission to rewite your cycle highligts for the prelude ? | |
| 10:39:49 | gibi | bauzas: grandted :) | |
| 10:40:06 | gibi | sean-k-mooney: I will check them soon | |
| 11:10:29 | gibi | bauzas: when you need some distraction there is two doc / reno patch up for review https://review.opendev.org/c/openstack/nova/+/807564 and https://review.opendev.org/c/openstack/nova/+/705667 | |
| 11:25:21 | gibi | stephenfin, sean-k-mooney: I added a topic about tox.ini basepython pinning to the PTG etherpad https://etherpad.opendev.org/p/nova-yoga-ptg L81 | |
| 11:42:28 | gibi | lyarwood: if you have time I could use your oppinion on https://bugs.launchpad.net/nova/+bug/1942766 | |
| 11:54:53 | lyarwood | gibi: yeah live and then persistent could be an option but ultimately a hard reboot would recover the situation so it's a `low` bug at best IMHO | |
| 11:55:37 | gibi | lyarwood: as the hard reboot will regenareate the xml from the db? | |
| 11:56:15 | lyarwood | gibi: correct it destroys the live domain and undefined the persistent domain before recreating everything based on what we have in the db | |
| 11:56:21 | lyarwood | undefines* | |
| 11:56:47 | gibi | cool, thanks | |
| 12:45:46 | opendevreview | Balazs Gibizer proposed openstack/nova master: Add more retries to TestMigrateFromDownHost tests https://review.opendev.org/c/openstack/nova/+/807714 | |
| 12:52:41 | gibi | lyarwood: a further tuning on these tests ^^ | |
| 12:52:59 | gibi | ohh I see you already checked | |
| 12:53:02 | gibi | thanks | |
| 12:53:08 | lyarwood | gibi: yup already reviewed, I did see a gate failure with this last week but didn't get time to look, thanks for sorting that again | |
| 12:53:35 | gibi | lyarwood: no problem, I like hunting down these :) | |
| 12:53:53 | gibi | and I think there is no way to avoid races sometime, nova is complex | |
| 12:53:54 | lyarwood | we all have our vices :D | |
| 12:54:03 | gibi | :D | |
| 13:35:55 | bauzas | man, I wish generated sphinx errors were simplier to debug with reno | |
| 13:40:49 | kashyap | bauzas: What's the error that's giving you grief? | |
| 13:41:10 | bauzas | /home/sbauza/git/openstack/nova/releasenotes/source/unreleased.rst:40: WARNING: Bullet list ends without a blank line; unexpected unindent. | |
| 13:41:45 | kashyap | Ah, I've seen this enough no. of times that it is now written into my brain's ROM | |
| 13:42:30 | bauzas | also, running the tox releasenotes target takes a while | |
| 13:42:38 | bauzas | it's repopulating all the releases | |
| 13:48:32 | opendevreview | Balazs Gibizer proposed openstack/nova master: Avoid unbound instance_uuid var during delete https://review.opendev.org/c/openstack/nova/+/805605 | |
| 14:28:38 | opendevreview | Merged openstack/nova master: fup: Print message logging uncaught nova-manage exceptions https://review.opendev.org/c/openstack/nova/+/807358 | |
| 14:29:10 | opendevreview | Merged openstack/nova master: console: Improve logging https://review.opendev.org/c/openstack/nova/+/778407 | |
| 14:31:10 | gibi | cores: do we support providing the adminPassword to the guest via the metadata service? | |
| 14:31:39 | gibi | I see that the metadata service trying to fetch the password from instance.system_metadata https://github.com/openstack/nova/blob/402fe188b4e7ff76109e8a5ea1f24a5e915eaa09/nova/api/metadata/password.py#L37 | |
| 14:31:52 | gibi | but I don't see we ever store the adminPassword there | |
| 14:32:31 | gibi | asking for due to https://bugs.launchpad.net/nova/+bug/1942709 | |
| 15:50:53 | gibi | FYI: nova meeting starts in 9 minutes here in the channel | |
| 15:59:01 | bauzas | gibi: I'll be a bit late, daughter's homework helping | |
| 15:59:08 | gibi | ack | |
| 16:00:10 | gibi | #startmeeting nova | |
| 16:00:10 | opendevmeet | Meeting started Tue Sep 7 16:00:10 2021 UTC and is due to finish in 60 minutes. The chair is gibi. Information about MeetBot at http://wiki.debian.org/MeetBot. | |
| 16:00:10 | opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | |
| 16:00:10 | opendevmeet | The meeting name has been set to 'nova' | |
| 16:00:53 | gibi | o/ | |
| 16:01:43 | dansmith | o/ | |
| 16:03:31 | gibi | #topic Bugs (stuck/critical) | |
| 16:03:46 | gibi | no critical | |
| 16:03:50 | gibi | #link 13 new untriaged bugs (-4 since the last meeting): #link https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New | |
| 16:03:57 | gibi | we have 1 bugs marked with xena-rc-potential tag #link https://bugs.launchpad.net/nova/+bugs?field.tag=xena-rc-potential | |
| 16:04:03 | gibi | https://bugs.launchpad.net/nova/+bug/1942345 fix is going through the gate | |
| 16:04:33 | gibi | and we have the placement transaction scope issue https://storyboard.openstack.org/#!/story/2009159 that is being worked on in https://review.opendev.org/c/openstack/placement/+/807014 | |
| 16:04:54 | gibi | I guess we should mark that as RC critical too | |
| 16:05:34 | gibi | I think melwitt's solution is OK but we cannot really make a reproduction test working in the functional env | |
| 16:05:40 | gibi | so I started running nova jobs against the fix | |
| 16:05:58 | gibi | in https://review.opendev.org/c/openstack/nova/+/807558 | |
| 16:06:16 | gibi | so far the runs there are not producing the error | |
| 16:06:48 | gibi | so probably we will land that fix without the reproduction test | |
| 16:07:24 | gibi | is there any other bug we should consider as RC critical? | |
| 16:07:37 | dansmith | you're saying that we can't repro the failure in functional, | |
| 16:07:51 | dansmith | but that's kinda expected and normal for these kinds of load-based heisenbugs right? | |
| 16:08:25 | gibi | dansmith: yes, it is a race that is hard to reproduce in a clean env (it needs mysql and it needs parallel transactions) | |
| 16:08:29 | bauzas | dansmith: the problem is about mysql | |
| 16:08:34 | dansmith | gibi: yeah | |
| 16:08:36 | bauzas | hah, jinxed | |
| 16:08:55 | bauzas | difficult to write a correct parallel test | |
| 16:09:11 | dansmith | yeah, just sounded like gibi was expecting we wouldn't land until we had a repro test | |
| 16:09:18 | dansmith | and I'm saying I'd have expected that to be impossible | |
| 16:09:26 | gibi | we tried the repro test but we faild | |
| 16:09:32 | gibi | so I'm OK to land this without a repro | |
| 16:10:13 | bauzas | "I guess we should mark that as RC critical too" > yes, please | |
| 16:10:42 | gibi | bauzas: OK, I will. It is already in the tracking etherpad https://etherpad.opendev.org/p/nova-xena-rc-potential | |
| 16:11:19 | gibi | so if there is no other bug for the RC then I have a question about https://bugs.launchpad.net/nova/+bug/1942709 | |
| 16:11:35 | gibi | do we support providing the adminPassword to the guest via the metadata service? | |
| 16:11:40 | gibi | I see that the metadata service trying to fetch the password from instance.system_metadata | |
| 16:11:43 | gibi | https://github.com/openstack/nova/blob/402fe188b4e7ff76109e8a5ea1f24a5e915eaa09/nova/api/metadata/password.py#L37 | |
| 16:12:07 | gibi | but as far as I see we dont store the password in instance.system_metadata on master | |
| 16:12:20 | gibi | and I was not able to track down changes around this in the git history | |
| 16:13:05 | dansmith | I don't remember if this works with libvirt | |
| 16:13:09 | dansmith | I want to say no | |
| 16:13:30 | bauzas | we need to look at the code honestly | |
| 16:13:52 | gibi | bauzas: please, I got stuck tracking done if it ever worked | |
| 16:14:04 | gibi | OK moving on then | |
| 16:14:15 | gibi | any other bug we need to discuss? | |
| 16:15:19 | gibi | #topic Gate status | |
| 16:15:24 | gibi | Nova gate bugs #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure | |
| 16:15:29 | gibi | The nova-next job should be passing now after the new osc-placement release on Friday | |
| 16:15:42 | gibi | Allocation deletion conflict still can happen, and it is being worked on in https://review.opendev.org/c/openstack/placement/+/807014 | |
| 16:15:58 | bauzas | gibi: wish me good luck for finding about the crap in sysmetadata | |
| 16:16:07 | gibi | bauzas: good luck! :) | |
| 16:16:33 | gibi | I'm not tracking other high frequency bugs in the gate I think we are able to merge code to master | |