| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2023-07-25 | |||
| 13:30:11 | auniyal | ack, thanks | |
| 13:33:25 | sean-k-mooney | the backport does not seam to be working properly | |
| 13:34:41 | sean-k-mooney | wait why are you proposing https://review.opendev.org/c/openstack/nova/+/889311 directly to yoga | |
| 13:34:55 | sean-k-mooney | oh your are not | |
| 13:35:03 | sean-k-mooney | this is incorrect | |
| 14:01:43 | auniyal | ack | |
| 14:10:58 | opendevreview | alecorps proposed openstack/nova master: Workaround for issues with ephemeral disk named disk.local during resize https://review.opendev.org/c/openstack/nova/+/888220 | |
| 14:14:56 | opendevreview | Amit Uniyal proposed openstack/nova master: Added context manager for instance lock https://review.opendev.org/c/openstack/nova/+/873648 | |
| 14:14:57 | opendevreview | Amit Uniyal proposed openstack/nova master: Disconnecting volume from the compute host https://review.opendev.org/c/openstack/nova/+/877446 | |
| 14:37:34 | bauzas | elodilles: gibi: I'll need to stop leading the nova meeting after 20-25 mins | |
| 14:37:53 | bauzas | Uggla and me are going to visit artom who's in the surroundings | |
| 14:39:47 | opendevreview | Maxim Monin proposed openstack/nova master: Server Rescue leads to Server ERROR state if original image is deleted https://review.opendev.org/c/openstack/nova/+/872385 | |
| 14:42:36 | elodilles | bauzas: hmmm... i might be late like 20-25 mins, actually :S | |
| 14:43:06 | elodilles | (though i hope not...) | |
| 14:47:01 | auniyal | hey melwitt, I heard PS[number] from you few times, but not sure what it is, like PS1 or PS10 | |
| 14:47:30 | bauzas | auniyal: PS = patchset | |
| 14:47:40 | bauzas | the revision number in gerrit | |
| 14:47:59 | auniyal | so in one change patchset 10 | |
| 14:48:04 | auniyal | ack, thanks | |
| 14:56:59 | gibi | bauzas: I probably need to skip today's meeting (or I will be on and off during it) | |
| 14:57:12 | bauzas | np | |
| 14:57:29 | bauzas | honestly, given this and that, I don't want to skip but I'll say that we'll just check a few things | |
| 14:59:02 | gibi | ack | |
| 15:52:07 | auniyal | gibi, bauzas, dansmith, sean-k-mooney, melwitt can you please review these stable branch patches - https://etherpad.opendev.org/p/release-liaison-PatchesToReview | |
| 15:52:40 | auniyal | most of them are clean cherry-pick and already have 1 +2 and good to merge | |
| 15:54:15 | sean-k-mooney | the gates on stabel shoudl be unblocked | |
| 15:54:28 | sean-k-mooney | the nova-lvm and ceph issues shoudl be fixed on all branches | |
| 15:55:58 | bauzas | auniyal: ack, my main prio before leaving for 3 weeks is about features reviews but I'll try | |
| 15:56:16 | elodilles | yepp, they are unblocked, thanks sean-k-mooney for the patches \o/ | |
| 16:00:23 | opendevmeet | The meeting name has been set to 'nova' | |
| 16:00:23 | opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | |
| 16:00:23 | opendevmeet | Meeting started Tue Jul 25 16:00:23 2023 UTC and is due to finish in 60 minutes. The chair is bauzas. Information about MeetBot at http://wiki.debian.org/MeetBot. | |
| 16:00:23 | bauzas | #startmeeting nova | |
| 16:00:39 | bauzas | hey, let's try to have a 10-min meeting if we can | |
| 16:00:43 | dansmith | o/ | |
| 16:00:51 | bauzas | #link https://wiki.openstack.org/wiki/Meetings/Nova#Agenda_for_next_meeting | |
| 16:00:52 | gmann | o/ | |
| 16:01:01 | auniyal | o/ | |
| 16:01:22 | elodilles | o/ | |
| 16:01:24 | bauzas | ok, starting | |
| 16:01:34 | bauzas | if someone wants to continue discussing, I can pass the chair | |
| 16:01:40 | bauzas | #topic Bugs (stuck/critical) | |
| 16:01:44 | bauzas | #info No Critical bug | |
| 16:01:48 | bauzas | #link https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New 40 new untriaged bugs (+0 since the last meeting) | |
| 16:01:58 | bauzas | Uggla made a good effort on triaging this week, thanks | |
| 16:02:11 | bauzas | he shared to me https://etherpad.opendev.org/p/nova-bug-triage-20230725 | |
| 16:02:27 | bauzas | #info Add yourself in the team bug roster if you want to help https://etherpad.opendev.org/p/nova-bug-triage-roster | |
| 16:02:39 | bauzas | elodilles: can you be the baton owner for this week ? | |
| 16:02:44 | elodilles | yepp | |
| 16:02:49 | bauzas | cool thanks ! | |
| 16:02:53 | bauzas | #info bug baton is being passed to elodilles | |
| 16:02:57 | bauzas | any bug to discuss ? | |
| 16:02:58 | elodilles | i'll be off on Friday, but otherwise fine! | |
| 16:03:09 | bauzas | elodilles: I'll be off next week so :) | |
| 16:03:18 | elodilles | touche ;) | |
| 16:03:18 | bauzas | #topic Gate status | |
| 16:03:22 | bauzas | #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure Nova gate bugs | |
| 16:03:27 | bauzas | #link https://zuul.openstack.org/builds?project=openstack%2Fnova&project=openstack%2Fplacement&pipeline=periodic-weekly Nova&Placement periodic jobs status | |
| 16:03:31 | bauzas | #info nova-emulation back to work | |
| 16:03:35 | bauzas | #link https://zuul.openstack.org/build/2eb47b5dcb944b7eb03224e6ee599a57 | |
| 16:03:41 | dansmith | gmann and I have been working on a bunch of patches to address job timeout issues | |
| 16:03:46 | bauzas | now we have a failure on tempest-integrated-placement | |
| 16:03:54 | dansmith | still lots in flight, but we're hopeful that it will improve those issues at least | |
| 16:03:56 | bauzas | but we'll see next week | |
| 16:04:01 | dansmith | but there are still lots of other spurious fails | |
| 16:04:10 | bauzas | dansmith: I was about to mention the other pipelines but the periodic-weekly | |
| 16:04:21 | bauzas | #info Please look at the gate failures and file a bug report with the gate-failure tag. | |
| 16:04:26 | dansmith | really need all hands on deck to improve this situation | |
| 16:04:32 | gmann | yeah, timeout now a days is due to multiple reasons and we are trying to improve a few of them | |
| 16:04:33 | bauzas | dansmith: so, yeah, there are a bunch of patches in flight | |
| 16:05:03 | bauzas | dansmith: gmann: I don't know if you have seen my pings today but yeah, there is another suspect | |
| 16:05:22 | bauzas | #link https://bugs.launchpad.net/tempest/+bug/2024859 | |
| 16:05:26 | dansmith | bauzas: the ping was about the mkfs issue? | |
| 16:05:33 | dansmith | that's known and unclear how to resolve, AFAICT | |
| 16:05:34 | bauzas | yup | |
| 16:05:35 | gmann | bauzas: I saw that, I did not look into that expect melwitt trying with some change | |
| 16:05:42 | gmann | yeah mkfs | |
| 16:05:50 | dansmith | but I'm highly concerned that we've got a group of workers that is suddenly very very IO constrained | |
| 16:06:03 | bauzas | sean-k-mooney has a WIP proposal | |
| 16:06:04 | dansmith | because we're seeing 100% slowdown on some nodes that seems IO-related, like that mkfs issue | |
| 16:06:18 | dansmith | melwitt had a proposal but it turned out not to help, last I checked | |
| 16:06:24 | gmann | yeah | |
| 16:06:27 | sean-k-mooney | the nova-lvm job passed with it btu i dont know if it was failing consitently before | |
| 16:06:28 | bauzas | about using disk cachinh | |
| 16:06:39 | bauzas | but I'm torn enabling it | |
| 16:06:49 | sean-k-mooney | https://review.opendev.org/c/openstack/nova/+/889383 | |
| 16:07:00 | bauzas | anyway, I don't disagree, we need to continue digging into it | |
| 16:07:01 | sean-k-mooney | well its partly enabled already | |
| 16:07:04 | gmann | sean-k-mooney: might not be so consistent but I see this 2-3 times in a week | |
| 16:07:30 | bauzas | dansmith: gmann: from the most remaining issues, is nova just a coal canary or is responsible for some of them ? | |
| 16:07:31 | sean-k-mooney | i was suggeting setting disk_cachemode: "file=none,block=unsafe,network=writeback" | |
| 16:07:43 | sean-k-mooney | block could also be writeback | |
| 16:08:22 | dansmith | bauzas: need more triage to know really | |
| 16:08:30 | dansmith | bauzas: I've been focusing on the timeout stuff for a week | |
| 16:08:47 | gmann | bauzas: timeout is more of test runner unbalancing on test worker and slow test etc etc | |
| 16:08:51 | bauzas | ok, I'll try to get more hands on it before I leave | |
| 16:09:08 | gmann | because timeout hold many of the gate fixes so that should be fixed first :) | |
| 16:09:18 | bauzas | ack | |
| 16:09:31 | bauzas | moving on | |
| 16:09:33 | bauzas | #topic Release Planning | |