| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2022-03-10 | |||
| 12:41:44 | sean-k-mooney | oh the regerssion | |
| 12:42:24 | gibi | the test case is unstable | |
| 12:42:27 | sean-k-mooney | i see is it still unsable with the followup | |
| 12:43:07 | gibi | we only have data about it being unstable without the fix for the origina bug | |
| 12:43:14 | gibi | that bugfix is on the gate | |
| 12:43:32 | gibi | I tried to reproduce it locally but failed so far | |
| 12:43:40 | sean-k-mooney | In the last 7 days from 8 failed functional test run 6 was due to this in nova. But this happened as far back as 14th of February. | |
| 12:43:53 | sean-k-mooney | so the test has only merged yesterday | |
| 12:44:05 | sean-k-mooney | so those other failures would have been on the path itself | |
| 12:44:29 | sean-k-mooney | as in https://review.opendev.org/c/openstack/nova/+/821840/5 merged yesterday | |
| 12:44:43 | gibi | the test case merged on the 5th | |
| 12:44:56 | gibi | oh no | |
| 12:44:58 | gibi | it is 9th | |
| 12:45:01 | gibi | you are correct | |
| 12:45:02 | gibi | sorry | |
| 12:45:30 | gibi | and you are correct before yesterday it is only failed on 821840/5 | |
| 12:45:38 | gibi | after the merge it is failed on 3 other pathes | |
| 12:45:42 | gibi | see https://paste.opendev.org/show/btHI7ErFfhKYFGdfoujl/ | |
| 12:46:16 | sean-k-mooney | then ya we shoudl either revert or disable i guess | |
| 12:46:35 | opendevreview | Merged openstack/nova master: Add functional tests to reproduce bug #1960412 https://review.opendev.org/c/openstack/nova/+/830010 | |
| 12:47:39 | gibi | yeah, no point yanking the bugfix from the gate as that does not break anyithing, the patch that added the test case was already merged | |
| 12:48:07 | gibi | I can push a patch skipping the test case | |
| 12:52:32 | opendevreview | Balazs Gibizer proposed openstack/nova master: Skip TestRollbackWithHWOffloadedOVS.test_rollback_pre_live_migration https://review.opendev.org/c/openstack/nova/+/833079 | |
| 12:52:38 | gibi | bauzas, sean-k-mooney: ^^ | |
| 13:01:00 | sean-k-mooney | gibi: sorry was making coffee did you determin why its unstable by the way? i did not fully read your bug report | |
| 13:01:55 | gibi | sean-k-mooney: no, I had not time to actually look deeply into it. I has not been able to reproduce it locally yet. | |
| 13:02:03 | gibi | *was not able | |
| 13:03:23 | sean-k-mooney | ok its odd the test is pretty simple | |
| 13:03:42 | sean-k-mooney | i mean for a live migration test | |
| 13:05:13 | sean-k-mooney | gibi: did you mean to put that patch on top of master rather then the fix | |
| 13:05:31 | sean-k-mooney | actully i guess that makes sense too | |
| 13:07:20 | sean-k-mooney | if noone else reviews the skip by the end of the day ill fast approve to make sure its included in rc1 | |
| 13:07:46 | gibi | sean-k-mooney: thanks | |
| 13:08:12 | sean-k-mooney | the followup failed grenade by the way | |
| 13:08:12 | gibi | I have some calls this afternoon, so I'm not sure I will have time to figure out today why it fails | |
| 13:11:54 | bauzas | gibi: sean-k-mooney: sorry was afk, a tl;dr ? | |
| 13:12:18 | bauzas | gibi: I see your comment on https://review.opendev.org/c/openstack/nova/+/815324/10 | |
| 13:12:22 | gibi | bauzas: the functional test added here https://review.opendev.org/c/openstack/nova/+/821840 is unsatble | |
| 13:12:32 | gibi | so I pushed https://review.opendev.org/c/openstack/nova/+/833079 | |
| 13:12:43 | gibi | the we can figure out the stability issue | |
| 13:12:45 | gibi | *then | |
| 13:12:55 | bauzas | gibi: maybe we should revert the functional test then | |
| 13:13:17 | bauzas | gibi: hah | |
| 13:13:18 | gibi | bauzas: we can do that as well, revert the func test and the revert the fix | |
| 13:13:29 | bauzas | gibi: yeah I think it's better | |
| 13:13:34 | bauzas | gibi: can you revert it ? | |
| 13:13:39 | bauzas | erlon is not around | |
| 13:13:42 | gibi | I can | |
| 13:13:49 | bauzas | thanks | |
| 13:14:35 | opendevreview | Balazs Gibizer proposed openstack/nova master: Revert "Adds regression test for bug LP#1944619" https://review.opendev.org/c/openstack/nova/+/832902 | |
| 13:14:48 | gibi | bauzas, sean-k-mooney: ^^ revert then | |
| 13:15:48 | sean-k-mooney | ok that works for me too | |
| 13:16:10 | sean-k-mooney | although it would still be nice to fix this this cycle but i guess we can backport | |
| 13:16:30 | sean-k-mooney | i assuem we dont want to pull this into an RC2 right | |
| 13:16:39 | sean-k-mooney | since tis not really a regression form this cycle | |
| 13:17:09 | sean-k-mooney | its just a bug in the orginal sriov live migration feature | |
| 13:17:33 | sean-k-mooney | so it can wait and be backported as normla | |
| 13:18:21 | bauzas | sean-k-mooney: given the issue is not a regression it can't be a RC2 one | |
| 13:18:36 | bauzas | sean-k-mooney: but I'm OK to backport it to 25.0.1 once we open it | |
| 13:18:56 | bauzas | this is just, we're close to RC1 deadline and erlon isn't around | |
| 13:19:23 | sean-k-mooney | yep that is what i was thinking too | |
| 13:20:02 | bauzas | gib: iI can't find the nova doc where we agree on having a quick and single +2/+W for reverts | |
| 13:20:32 | sean-k-mooney | i can get it but i +w it | |
| 13:21:56 | sean-k-mooney | so there is https://github.com/openstack/nova/blob/master/doc/source/contributor/policies.rst#reverts-for-retrospective-vetos | |
| 13:22:16 | sean-k-mooney | but i tought we had something else too | |
| 13:24:49 | sean-k-mooney | ya i dont see anything else relevent | |
| 13:25:19 | sean-k-mooney | in anycase i think we can agree that reverting a regression test that is unstable is ok given the followup fix has not merged yet | |
| 13:35:09 | gibi | I agree that fixing the gate is enough reason to quick approve a revert | |
| 13:35:15 | gibi | (or a test skip patch) | |
| 13:36:19 | bauzas | gibi: anyway, sean found the doc but also +Wd it | |
| 13:39:10 | sean-k-mooney | three cores walk into a bar, first core submits a patch to fix it, second core approves, third core say ouch how put this bar here | |
| 13:39:29 | gibi | :D | |
| 13:43:32 | gibi | yeah | |
| 13:50:25 | opendevreview | Merged openstack/nova master: Fix migration with remote-managed ports & add FT https://review.opendev.org/c/openstack/nova/+/829974 | |
| 13:59:28 | bauzas | sean-k-mooney: indeed, I missed bars, I'm so foo | |
| 13:59:49 | sean-k-mooney | lol :) | |
| 14:00:38 | opendevreview | ribaudr proposed openstack/nova master: [WIP] Attach Manila shares via virtiofs(db+object) https://review.opendev.org/c/openstack/nova/+/831193 | |
| 14:00:39 | opendevreview | ribaudr proposed openstack/nova master: [WIP] Attach Manila shares via virtiofs(manila abstraction) https://review.opendev.org/c/openstack/nova/+/831194 | |
| 14:00:39 | opendevreview | ribaudr proposed openstack/nova master: [WIP] Enable and use COMPUTE_STORAGE_VIRTIO_FS and COMPUTE_MEM_BACKING_FILE traits. https://review.opendev.org/c/openstack/nova/+/833090 | |
| 14:01:08 | sean-k-mooney | noonedeadpunk: ^ see virtio-fs work | |
| 14:01:42 | bauzas | sean-k-mooney: are you ok with me removing the yoga-rc-potential flag ? https://bugs.launchpad.net/nova/+bug/1960412 and https://bugs.launchpad.net/nova/+bug/1949808 ? | |
| 14:02:50 | sean-k-mooney | yes although the fix should hopefully merge shortly | |
| 14:03:14 | bauzas | oh wait indeed | |
| 14:03:20 | bauzas | haven't seen gibi voting | |
| 14:03:21 | noonedeadpunk | oh, wow | |
| 14:03:22 | bauzas | we can hold | |
| 14:03:23 | sean-k-mooney | it failed on the flaky func test | |
| 14:04:13 | gibi | yeah I found out about the flaky test by reviewing that other bugfix :) | |
| 14:04:50 | gibi | ohh it failed again :/ | |
| 14:05:02 | gibi | then we need the revert first | |
| 14:05:30 | sean-k-mooney | ath least this time its looking ok https://zuul.openstack.org/status#828570 | |
| 14:05:53 | sean-k-mooney | not that im watching it on my other monitor right now or anything | |
| 14:05:56 | sean-k-mooney | tottally not | |
| 14:06:36 | gibi | :) | |
| 14:16:11 | opendevreview | Merged openstack/nova master: Revert "Adds regression test for bug LP#1944619" https://review.opendev.org/c/openstack/nova/+/832902 | |
| 15:04:52 | bauzas | gibi: I guess we can +W https://review.opendev.org/c/openstack/nova/+/832292 | |
| 15:04:58 | bauzas | sean-k-mooney: ^ | |
| 15:05:04 | bauzas | we need it for the RC1 | |
| 15:05:08 | gibi | done | |
| 15:05:16 | bauzas | thanks | |