| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2022-02-22 | |||
| 15:44:44 | gibi | then maybe artom looked at a different run her https://bugs.launchpad.net/tripleo/+bug/1959014/comments/2 | |
| 15:45:09 | kashyap | Yeah, likely. This is a different run where the (QEMU) 'blockdev-del' failure is occuring | |
| 15:50:22 | sean-k-mooney | well standard snapshot in this context means a local snapshot of a file done by qemu | |
| 15:50:37 | kashyap | I've asked Peter Krempa from libvirt about the log traces; we'll see if we get something | |
| 15:50:42 | sean-k-mooney | vs direct which means we are delegating the snapshot to the ceph cluster | |
| 15:51:13 | kashyap | sean-k-mooney: Yeah, but "standard" and "direct" are too abstract terms. We should be explicit on what it means. | |
| 15:51:30 | kashyap | (But that's a patch for a different day.) | |
| 15:52:21 | sean-k-mooney | well perhaps but thse are really intended for us as nova develpers to read | |
| 15:52:59 | kashyap | Yeah, even for developers who work on different subsystems it will be far from obvious. | |
| 15:53:04 | sean-k-mooney | so there si some expecation of knowing what the code does | |
| 15:53:24 | gibi | kashyap: looking at the req-5a68f755-b20c-41a7-a005-3bcc8b800b28 you quoted above, I don't see anything in the logs about the failure, nova logged that the snapshot is done and the image is uploaded https://review.rdoproject.org/zuul/build/67d64d4a4d584eb8be9db0fbc6e18c9d/log/logs/overcloud-novacompute-0/var/log/containers/nova/nova-compute.log.1.gz#5705 | |
| 15:54:16 | kashyap | gibi: Hmmm, odd; so the guy says the above "reproduces" the problem, not sure what is going on here | |
| 15:54:56 | kashyap | But in the libvirtd debug log, I _do_ see | |
| 15:54:59 | kashyap | : | |
| 15:54:59 | kashyap | 2022-02-08 17:32:24.369+0000: 31580: error : qemuMonitorJSONCheckErrorFull:406 : internal error: unable to execute QEMU command 'blockdev-del': Failed to find node with node-name='libvirt-4- | |
| 15:55:03 | kashyap | storage' | |
| 15:55:36 | gibi | hm based on the timestamp that is 7 mintutes later | |
| 15:55:55 | kashyap | ("blockdev-del" deletes a block device that's added by "blockdev-add") | |
| 15:56:44 | kashyap | gibi: Hmm, I see. Then I'm scratching my head here about what's going on from a failure trigger | |
| 15:57:24 | sean-k-mooney | that is likely part of the test cleanup | |
| 15:58:18 | kashyap | sean-k-mooney: No, from the traceback in the bug description, it is happening at resource_setup() here: | |
| 15:58:18 | sean-k-mooney | if its 7 minute after the snapshot | |
| 15:58:21 | kashyap | https://github.com/openstack/tempest/blob/master/tempest/api/compute/images/test_list_image_filters.py#L110 | |
| 15:58:24 | opendevreview | Alexey Stupnikov proposed openstack/nova master: Run clean up calls when queued live migration is aborted https://review.opendev.org/c/openstack/nova/+/828570 | |
| 15:59:40 | sean-k-mooney | hum why woudl dat do a blockdev-del | |
| 15:59:48 | sean-k-mooney | unless the vm coudl not boot | |
| 15:59:53 | sean-k-mooney | and it was cleaning up | |
| 16:00:58 | kashyap | Yeah, it sounds like a clean-up act somewhere | |
| 16:01:52 | gibi | bauzas: ping :) | |
| 16:01:53 | opendevreview | Elod Illes proposed openstack/nova stable/queens: [stable-only] Fix sphinx doc job https://review.opendev.org/c/openstack/nova/+/830327 | |
| 16:02:09 | bauzas | oh shit | |
| 16:02:14 | bauzas | #startmeeting nova | |
| 16:02:14 | opendevmeet | Meeting started Tue Feb 22 16:02:13 2022 UTC and is due to finish in 60 minutes. The chair is bauzas. Information about MeetBot at http://wiki.debian.org/MeetBot. | |
| 16:02:14 | opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | |
| 16:02:14 | opendevmeet | The meeting name has been set to 'nova' | |
| 16:02:24 | bauzas | hey folks, sorry the delay | |
| 16:02:31 | gmann | o/ | |
| 16:02:35 | chateaulav | \o | |
| 16:02:42 | bauzas | that's its fault | |
| 16:03:00 | bauzas | #link https://wiki.openstack.org/wiki/Meetings/Nova#Agenda_for_next_meeting | |
| 16:03:10 | elodilles | o/ | |
| 16:03:20 | bauzas | let's a quick meeting since we're close to some deadline :) | |
| 16:03:24 | bauzas | let's do* | |
| 16:03:30 | bauzas | #topic Bugs (stuck/critical) | |
| 16:03:35 | bauzas | #info No Critical bug | |
| 16:03:39 | bauzas | #link https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New 27 new untriaged bugs (-15 since the last meeting) | |
| 16:03:48 | bauzas | thanks gibi and others for having looked at the bugs | |
| 16:03:52 | bauzas | #help Nova bug triage help is appreciated https://wiki.openstack.org/wiki/Nova/BugTriage | |
| 16:03:57 | bauzas | link https://storyboard.openstack.org/#!/project/openstack/placement 27 open stories (+0 since the last meeting) in Storyboard for Placement | |
| 16:04:01 | bauzas | #link https://storyboard.openstack.org/#!/project/openstack/placement 27 open stories (+0 since the last meeting) in Storyboard for Placement | |
| 16:04:06 | bauzas | voila | |
| 16:04:10 | bauzas | any bugs to discuss ? | |
| 16:04:48 | bauzas | looks not | |
| 16:04:57 | bauzas | again, thanks for the folks who looked at the bugs | |
| 16:05:10 | bauzas | #topic Gate status | |
| 16:05:14 | bauzas | #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure Nova gate bugs | |
| 16:05:17 | bauzas | #link https://zuul.openstack.org/builds?project=openstack%2Fplacement&pipeline=periodic-weekly Placement periodic job status | |
| 16:05:21 | bauzas | #info Please look at the gate failures and file a bug report with the gate-failure tag. | |
| 16:05:37 | bauzas | so we had a few new gate failures | |
| 16:05:55 | bauzas | I saw gibi looking at one | |
| 16:06:10 | bauzas | any of them needing to be discussed ? | |
| 16:06:22 | gibi | I just did some bug triage and duplicated thing together | |
| 16:06:30 | gibi | I did not see a new failure this week | |
| 16:06:37 | gibi | * new type of failure | |
| 16:07:15 | bauzas | kk | |
| 16:07:32 | bauzas | ok, then moving to the next topic | |
| 16:07:39 | bauzas | #topic Release Planning | |
| 16:07:43 | bauzas | #link https://releases.openstack.org/yoga/schedule.html#y-ff FeatureFreeze in 2 days | |
| 16:07:47 | bauzas | #link https://etherpad.opendev.org/p/nova-yoga-blueprint-status Etherpad for blueprints tracking | |
| 16:07:59 | bauzas | so the FeatureFreeze will be on Thursday EOB | |
| 16:08:35 | bauzas | tbh, that means that nova-cores won't merge any feature change on Friday | |
| 16:08:48 | bauzas | unless we got a gate issue | |
| 16:09:08 | bauzas | do people have any concerns ? | |
| 16:09:17 | gibi | bauzas: you mean no +A on Friday | |
| 16:09:25 | bauzas | gibi: sorry yes | |
| 16:09:25 | gibi | except if rebase is needed | |
| 16:09:29 | bauzas | correct | |
| 16:09:32 | gibi | ack | |
| 16:09:34 | gibi | works for me | |
| 16:10:15 | gmann | ack | |
| 16:10:26 | bauzas | do people want to discuss about any blueprint here ? | |
| 16:10:38 | gmann | need more reviews on RBAC series https://review.opendev.org/q/topic:bp%252Fpolicy-defaults-refresh-2 | |
| 16:10:40 | liorf95 | yes please | |
| 16:10:44 | gmann | thanks gibi for reviews | |
| 16:10:44 | bauzas | yes, I'll do | |
| 16:10:48 | gmann | thanks | |
| 16:10:51 | liorf95 | https://blueprints.launchpad.net/nova/+spec/nvmeof-multipath | |
| 16:10:57 | bauzas | liorf95: we'll discuss about your bp in the open discussion topic | |
| 16:10:58 | sean-k-mooney | liorf95: i think yours is in opendicuss at the end but we coudl bring it up now too | |
| 16:11:19 | liorf95 | as you want | |
| 16:11:35 | bauzas | liorf95: that's in the agenda :) | |
| 16:11:39 | bauzas | anyway | |
| 16:11:49 | bauzas | secure RBAC, yes I'll review | |
| 16:12:04 | bauzas | we merged a few features before | |
| 16:12:19 | bauzas | I'll modify Launchpad on Friday | |
| 16:12:35 | chateaulav | just reviews for emulation to ensure nothing bltent sticks out | |
| 16:13:09 | bauzas | ok | |
| 16:14:03 | bauzas | ok, moving on then | |
| 16:14:14 | bauzas | #topic Review priorities | |
| 16:14:17 | bauzas | #topic Review priorities | |