| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2023-03-23 | |||
| 14:21:55 | sean-k-mooney | it does not feel liek this shoudl be there | |
| 14:22:42 | sean-k-mooney | granted i have also said in the past that i woudl preer if the integrated-gate-compute template was in the nova repo but i knwo why the qa team want to keep those all in one repo | |
| 14:23:14 | dansmith | are you talking about the policies-irrelevant list? | |
| 14:24:36 | dansmith | I dunno why that's named that way, but AFAIK it's defined in this file, not in tempest | |
| 14:29:35 | opendevreview | Dmitry Tantsur proposed openstack/nova master: ironic: clean up references to memory_mb/cpus/local_gb https://review.opendev.org/c/openstack/nova/+/878418 | |
| 14:57:36 | opendevreview | Merged openstack/nova stable/yoga: Handle mdev devices in libvirt 7.7+ https://review.opendev.org/c/openstack/nova/+/866154 | |
| 14:59:53 | bauzas | whoami-rajat: it's quite late for your time, but it looks like we need a cinder-nova cross-project session, IIRC my emails :) | |
| 15:00:03 | bauzas | for the vPTG | |
| 15:00:54 | whoami-rajat | bauzas, yeah i was just reading through it, I haven't finalized timing for cinder topics yet, do you have any time in mind? | |
| 15:01:02 | whoami-rajat | we're going to have a cross project with glance on thursday | |
| 15:02:39 | bauzas | yup, I discussed that this morning with pdeore | |
| 15:04:41 | bauzas | whoami-rajat: Sofia was requesting the last Thursday slot or the first Wed slot | |
| 15:05:10 | bauzas | whoami-rajat: I can somehow set it for Wed 1300UTC, would that work for you ? | |
| 15:05:56 | whoami-rajat | bauzas, hmm, the problem with first slots is we don't have full gathering, would thursday last slot work for you? 1600-1700 UTC | |
| 15:06:07 | bauzas | whoami-rajat: sure | |
| 15:06:11 | bauzas | let's take it | |
| 15:06:17 | whoami-rajat | great! | |
| 15:06:19 | whoami-rajat | thanks | |
| 15:06:54 | bauzas | whoami-rajat: would it work if that would be in our room ? | |
| 15:07:25 | whoami-rajat | bauzas, sure, we can move there, is it on Zoom or any other platform? | |
| 15:07:55 | bauzas | whoami-rajat: we use the diablo room (zoom) | |
| 15:08:06 | whoami-rajat | cool, we will be there | |
| 15:08:26 | bauzas | I just added it in our etherpad https://etherpad.opendev.org/p/nova-bobcat-ptg#L91 | |
| 15:08:43 | bauzas | whoami-rajat: and if you see other topics to discuss, please add them there | |
| 15:09:30 | whoami-rajat | bauzas, sure, sounds good! | |
| 15:10:15 | bauzas | ++ | |
| 15:10:18 | bauzas | g'night | |
| 15:44:34 | dtantsur | Hey folks! Seeing this in the ironic grenade job: https://zuul.opendev.org/t/openstack/build/d90374e9b6554704a2f84b7fe8a9d411/log/controller/logs/screen-n-api.txt#4182 | |
| 15:44:39 | dtantsur | rings any bells? | |
| 15:45:26 | dtantsur | It's quite possible that the ironic virt driver does not indeed support 'openstack console log show', but why is it called? | |
| 15:47:21 | dtantsur | hmm, maybe a red herring. judging by https://opendev.org/openstack/grenade/commit/adcb563b185416451da419186a8d7773ffb6b913 it happens if ping fails. | |
| 15:47:33 | dtantsur | (would be cool to check the virt driver before doing it) | |
| 15:48:23 | clarkb | dtantsur: I think one of the responses to a failed tempest test is to dump the instance console log. This is often useful if there are networking issues because with a VM the console is accessed via libvirt and not the network and the logs often show you if dhcp failed etc | |
| 15:48:49 | dtantsur | Right. Probably needs to exclude VIRT_DRIVER=ironic | |
| 17:08:03 | gmann | dansmith: hi | |
| 17:08:42 | gmann | dansmith: I mean to add irrelevnet-files in gate pipeline in same way you did in check pipeline to avoid running grenade on doc only changes etc | |
| 17:50:17 | sean-k-mooney | gmann: that in the curernt patch but i dont knwo if you left your comment on a previous version | |
| 17:50:56 | sean-k-mooney | gmann: https://review.opendev.org/c/openstack/nova/+/875773/6/.zuul.yaml#798 | |
| 17:52:15 | sean-k-mooney | ah i see so in v5 it was being added to the gate pipeline via the template | |
| 17:52:21 | sean-k-mooney | not explictly | |
| 17:52:40 | sean-k-mooney | so ya v6 adressed your comment | |
| 17:53:05 | sean-k-mooney | however it failed in v6 for somereason when it ran | |
| 17:53:46 | sean-k-mooney | test_security_group_rules_create | |
| 17:53:57 | sean-k-mooney | weired that looks unrealted | |
| 17:54:01 | sean-k-mooney | i wonder wy that failed | |
| 17:55:09 | gmann | sean-k-mooney: yes, already +2 on that | |
| 17:55:44 | sean-k-mooney | im jsut quickly checking the logs before rechecking and +2ing | |
| 17:56:30 | gmann | ohk | |
| 17:56:44 | gmann | I checked it from test failing log but did not go into deep | |
| 17:56:58 | sean-k-mooney | nova.api.openstack.wsgi.Fault: Instance 08070e41-68b0-4dd3-9eb6-1926c3082060 could not be found. | |
| 17:57:13 | sean-k-mooney | there are a bunch of faults like that in the nova api | |
| 17:57:53 | sean-k-mooney | although im not sure its the same test | |
| 17:59:14 | gmann | api log might be confusing on NotFound due to negative tests | |
| 17:59:26 | sean-k-mooney | ya i was assumign that too | |
| 17:59:38 | sean-k-mooney | but i was just checkign to see if there are any erference to that est | |
| 18:00:18 | sean-k-mooney | ah found the request id req-90bd91de-9909-4b0a-a16f-1de245c67834 | |
| 18:00:56 | sean-k-mooney | req-90bd91de-9909-4b0a-a16f-1de245c67834 tempest-SecurityGroupRulesTestJSON-617656270 tempest-SecurityGroupRulesTestJSON-617656270-project-member] 10.209.0.48 "POST /compute/v2.1/os-security-groups" status: 200 | |
| 18:01:06 | sean-k-mooney | so nova was happy with it | |
| 18:03:55 | sean-k-mooney | im not seeing isseu on the neutorn side so im pretty happy this is a one off failure | |
| 18:04:15 | sean-k-mooney | i just have not seen that test fail before at least not that stuck out in my memory | |
| 18:04:40 | sean-k-mooney | so i wanted to check it a little more deeply in case it was a real failure | |
| 21:06:45 | opendevreview | Merged openstack/nova master: Add grenade-skip-level-always to nova https://review.opendev.org/c/openstack/nova/+/875773 | |
| #openstack-nova - 2023-03-24 | |||
| 09:43:05 | Uggla | bauzas, short msg to tell you that I have added a point about virtiofs next features. It would be great to have a short session to discuss that especially with Adri2000 who could be a potential user. | |
| 09:44:56 | Uggla | bauzas, I know it is maybe a bit early, but I guess it could help me to figure out what will be the next topics to address. | |
| 09:51:52 | bauzas | Uggla: yeah, np, for sure | |
| 09:52:13 | Uggla | bauzas, \o/ | |
| 09:52:29 | bauzas | Uggla: as you can see, I eventually didn't really created an agenda, we'll lookup the topics one after the other | |
| 09:52:48 | bauzas | each one after the other one* | |
| 09:53:20 | Uggla | bauzas, maybe for this one it could be good to have a slot. I guess it will be easier to Adri2000 to join. | |
| 09:54:09 | Uggla | bauzas, maybe that could stand right after the manila one ? | |
| 09:55:33 | bauzas | Uggla: in general I ping the courtesy ping list before a topic, to ask them when they have time to discuss | |
| 10:01:01 | Uggla | bauzas, I'm saying that because Adri2000 told me, he will join the manila session. Just to let you know, if it could help you. | |
| 10:01:16 | bauzas | I can discuss with Adrien, np | |
| 10:04:49 | Uggla | bauzas, good so now I jump back to the virtiofs stuff to rework the interfaces because you dislike them. ;) | |
| 14:21:42 | zigo | bauzas: When live-mig fails, I have this in my syslog: https://paste.opendev.org/show/b2sqj6SSBsGOdN2D4phz/ | |
| 14:21:42 | zigo | (sorry, didn't noticed it yesterday) | |
| 14:21:42 | zigo | Does this help a little ? | |
| 14:24:47 | kashyap | zigo: Randomly noticing it here. That's a strange error I've never seen | |
| 14:24:49 | kashyap | internal error: qemu unexpectedly closed the monitor: 2023-03-24T14:19:28.554056Z qemu-system-x86_64: VQ 2 size 0x80 < last_avail_idx 0x83d9 - used_idx 0x0 | |
| 14:26:52 | zigo | kashyap: Yeah, this feels like a libvirt / qemu bug, rather than an issue in Nova... | |
| 14:27:01 | kashyap | The error is definitely coming from QEMU | |
| 14:27:23 | kashyap | zigo: Are you hitting it consistently? What QEMU/libvirt versions? | |
| 14:27:30 | kashyap | Can you post the full guest QEMU invocatoin? | |
| 14:27:38 | kashyap | All of 'em preferably in a bug (if it's reproducible) :-) | |
| 14:28:26 | zigo | qemu: 1:5.2+dfsg-11+deb11u2 | |
| 14:28:26 | zigo | libvirt: 7.0.0 | |
| 14:28:26 | zigo | (this is a plain Debian Bullseye...) | |
| 14:28:59 | zigo | kashyap: When the VM can't live-migrate, it goes back to state MIGRATING to ACTIVE, and I can make it happen again, yes. | |
| 14:29:18 | zigo | kashyap: When the VM can't live-migrate, it goes back from state MIGRATING to ACTIVE, and I can make it happen again, yes. | |
| 14:29:21 | kashyap | Same versions on source and destination hosts? | |
| 14:29:26 | zigo | Yeah. | |
| 14:29:56 | zigo | What's weird is that, on each compute, we run maybe 100+ VMs, and each time, 2 or 3 are stuck, refusing to migrate this way. | |
| 14:31:02 | kashyap | Hm, these bugs need a more systematic debugging. Please file a bug. But it might very well be fixed upstream (I know) | |
| 14:31:13 | kashyap | See this, for example: https://www.mail-archive.com/qemu-devel@nongnu.org/msg441182.html | |
| 14:31:23 | kashyap | A similar error) | |
| 14:33:20 | zigo | Yeah. | |
| 14:33:44 | zigo | Is there a qemu IRC channel? | |
| 14:35:04 | kashyap | Yes | |
| 14:35:08 | kashyap | #qemu, OFTC | |
| 14:35:16 | zigo | Will try. | |