| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2023-08-28 | |||
| 17:22:32 | sean-k-mooney | so preior to actully supproting it properly there was a poorly documented feature where rebuild to the same iamge "only for bfv guests" woudl not destory data and just update the metadata | |
| 17:22:50 | sean-k-mooney | but honestly htat should never have been a thing | |
| 17:23:11 | sean-k-mooney | we effectivly forgot it existed until we added real rebuild support | |
| 17:23:45 | noonedeadpunk | I can recall writing smth to the ML regarding that | |
| 17:25:24 | noonedeadpunk | but already forgot about this feature :D | |
| 17:27:35 | sean-k-mooney | having a behviaor for a normally distructive api not be only if its BFV is too easy to forget | |
| #openstack-nova - 2023-08-29 | |||
| 06:44:50 | dvo-plv | sean-k-mooney, Hello | |
| 06:45:55 | dvo-plv | regarding our yesterday discussion. I see two options. we can get back to the separate mech driver, like was suggested year ago | |
| 06:46:37 | dvo-plv | or we can pass socket name + pci endpoint in some way | |
| 07:25:02 | Uggla | Hello Nova. | |
| 07:34:45 | gibi | Uggla: o/ | |
| 08:24:42 | opendevreview | melanie witt proposed openstack/nova master: nova-manage: Add 'limits migrate_to_unified_limits' https://review.opendev.org/c/openstack/nova/+/891646 | |
| 12:56:44 | opendevreview | Maksim Malchuk proposed openstack/nova stable/xena: Fix to implement 'pack' or 'spread' VM's NUMA cells https://review.opendev.org/c/openstack/nova/+/829804 | |
| 14:47:28 | opendevreview | Dan Smith proposed openstack/nova master: WIP: Detach disks using alias when possible https://review.opendev.org/c/openstack/nova/+/893068 | |
| 14:49:02 | dansmith | kashyap: was just going to point you at this, first PoC of using the stable alias to detach disks: https://review.opendev.org/c/openstack/nova/+/893068 | |
| 14:49:19 | dansmith | seems to work, without having to muck with all the actual detach plumbing like I was originally thinking | |
| 14:49:33 | dansmith | I think something similar should work for interfaces too | |
| 14:49:59 | dansmith | there's a lot more looking-up-of-devices elsewhere that would need to change, but I'm hoping those places will be able to use that helper too | |
| 14:50:55 | opendevreview | Elod Illes proposed openstack/nova stable/yoga: Don't provide MTU value in metadata service if DHCP is enabled https://review.opendev.org/c/openstack/nova/+/879701 | |
| 14:50:56 | kashyap | dansmith: Nice that you preserve the fallback to using 'disk_dev' | |
| 14:52:04 | kashyap | dansmith: I guess you're (me for sure) pleasnatly surprised that it turned out to be much less of code-footprint than anticipated | |
| 14:52:12 | kashyap | (Unless there are no nasty surprises lurking somewhere) | |
| 14:52:43 | dansmith | yeah I originally had rewritten all the detach stuff to use that per-alias method, but realized it was really not necessary and that I could just change how we looked it up instead | |
| 14:53:00 | dansmith | which is much smaller *and* should apply to the other places where we just need to look it up and not detach | |
| 14:53:39 | kashyap | Smart. (On changing how we looked it up. I would've racked my brains longer) | |
| 14:53:54 | opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Replace -- as 3-4 char in hostname with - https://review.opendev.org/c/openstack/nova/+/893072 | |
| 14:54:59 | dansmith | so I'm hoping that helper on guest that looks up all devices and then finds by alias will work for interfaces in a similar workflow | |
| 14:55:52 | kashyap | You already ran nova.tests.unit.virt.libvirt.* unit tests locallY? | |
| 14:57:02 | dansmith | no, no tests, it just works in a devstack | |
| 14:57:04 | opendevreview | Elod Illes proposed openstack/nova stable/xena: Don't provide MTU value in metadata service if DHCP is enabled https://review.opendev.org/c/openstack/nova/+/879703 | |
| 14:57:12 | opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Replace -- as 3-4 char in hostname with - https://review.opendev.org/c/openstack/nova/+/893072 | |
| 14:57:43 | dansmith | kashyap: i.e.: Aug 29 14:40:22 jammy nova-compute[306476]: DEBUG nova.virt.libvirt.driver [None req-323b5960-d0c5-4729-b269-5743cd4fdf90 demo demo] Found disk vdb by alias ua-ada5af06-300e-4d07-931d-3cc2bff8a8a9 {{(pid=306476) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2722}} | |
| 14:58:28 | kashyap | Ah, nice. | |
| 15:01:57 | opendevreview | Elod Illes proposed openstack/nova stable/wallaby: Don't provide MTU value in metadata service if DHCP is enabled https://review.opendev.org/c/openstack/nova/+/879704 | |
| 15:02:11 | kashyap | dansmith: I'm just quietly wondering if there are scenarios where we have to care about transient disk configs at all | |
| 15:02:16 | bauzas | auniyal: left a comment on https://review.opendev.org/c/openstack/nova/+/889947 but also on the dependent patch, please review it as soon as you can | |
| 15:03:20 | opendevreview | Elod Illes proposed openstack/nova stable/victoria: Don't provide MTU value in metadata service if DHCP is enabled https://review.opendev.org/c/openstack/nova/+/879705 | |
| 15:04:14 | dansmith | kashyap: meaning all the detaching from live+persistent you mean? | |
| 15:04:35 | dansmith | AFAIK we pretty much always keep them in sync, so I'm not sure why we're going to all that trouble, yeah | |
| 15:05:01 | kashyap | (Yeah, detach from both live and persistent) | |
| 15:05:31 | kashyap | I didn't realize we're keeping them in sync. Then one less trouble. | |
| 15:06:06 | opendevreview | Elod Illes proposed openstack/nova stable/ussuri: Don't provide MTU value in metadata service if DHCP is enabled https://review.opendev.org/c/openstack/nova/+/879702 | |
| 15:06:36 | bauzas | reminder : nova meeting in 55 mins (heya, back) | |
| 15:32:47 | opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Replace -- as 3-4 char in hostname with - https://review.opendev.org/c/openstack/nova/+/893072 | |
| 15:48:19 | bauzas | auniyal: also gave -1 for a few nits on https://review.opendev.org/c/openstack/nova/+/882284 | |
| 16:00:00 | auniyal | ack bauzas, thanks for reviews | |
| 16:00:07 | opendevmeet | The meeting name has been set to 'nova' | |
| 16:00:07 | opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | |
| 16:00:07 | opendevmeet | Meeting started Tue Aug 29 16:00:07 2023 UTC and is due to finish in 60 minutes. The chair is bauzas. Information about MeetBot at http://wiki.debian.org/MeetBot. | |
| 16:00:07 | bauzas | #startmeeting nova | |
| 16:00:18 | bauzas | hey folks, welcome | |
| 16:00:25 | auniyal | o/ | |
| 16:00:26 | bauzas | I'm eventually released from Canada | |
| 16:00:37 | bauzas | #link https://wiki.openstack.org/wiki/Meetings/Nova#Agenda_for_next_meeting | |
| 16:00:44 | bauzas | who's around ? | |
| 16:01:00 | Uggla | o/ | |
| 16:01:20 | gmann | o/ | |
| 16:01:23 | elodilles | o/ | |
| 16:01:36 | bauzas | we can softly start | |
| 16:01:49 | bauzas | #topic Bugs (stuck/critical) | |
| 16:01:53 | bauzas | #info No Critical bug | |
| 16:01:57 | bauzas | #link https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New 49 new untriaged bugs (+9 since the last meeting) | |
| 16:01:58 | dansmith | o/ | |
| 16:02:02 | bauzas | #info Add yourself in the team bug roster if you want to help https://etherpad.opendev.org/p/nova-bug-triage-roster | |
| 16:02:18 | bauzas | so, we would like to do some bug triage | |
| 16:02:50 | bauzas | auniyal: you're the next in the roster list, fancy with this ? | |
| 16:02:58 | auniyal | ack bauzas | |
| 16:03:01 | auniyal | yes | |
| 16:03:05 | bauzas | very much appreciated | |
| 16:03:18 | bauzas | #info bug baton is auniyal | |
| 16:03:23 | bauzas | thanks | |
| 16:03:36 | bauzas | moving on, I don't see any critical bug to discuss | |
| 16:03:40 | bauzas | #topic Gate status | |
| 16:03:59 | bauzas | #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure Nova gate bugs | |
| 16:04:05 | bauzas | #link https://etherpad.opendev.org/p/nova-ci-failures | |
| 16:04:16 | bauzas | #link https://zuul.openstack.org/builds?project=openstack%2Fnova&project=openstack%2Fplacement&pipeline=periodic-weekly Nova&Placement periodic jobs status | |
| 16:04:26 | bauzas | #info nova-emulation seems flakey | |
| 16:04:34 | bauzas | #info https://zuul.openstack.org/build/209dc9676c4149b281420d9ae18f889c | |
| 16:05:05 | dansmith | things are better lately, thanks to a lot of hard work by a number of people, most recently probably melwitt with an LVM fix that might help with some stability, and a functional fix from gibi | |
| 16:05:22 | bauzas | dansmith: ++, I was about to ask for news :) | |
| 16:05:49 | dansmith | still need to work on some random timeouts we get which I think is related to stress on the api workers (at least in part) and melwitt has a green/native threads refactor up which I hope will eventually help with that | |
| 16:06:00 | bauzas | I have to admit the issues I've seen are out of my knowledge area :( | |
| 16:06:25 | dansmith | also still occasional OOMs which are hard to address when we're legitimately running out of memory if we get unlucky with what gets started when | |
| 16:06:29 | bauzas | dansmith: ack, any change in particular for greenthreading ? | |
| 16:06:54 | dansmith | bauzas: we need to move to native threads in nova-api when under wsgi so that we can handle more than two things at once | |
| 16:07:11 | dansmith | *and* so we can enable it in devstack so that other services which can already do so can leverage that :) | |
| 16:07:28 | bauzas | I see | |
| 16:08:13 | dansmith | anyway, that's pretty much the status.. I encourage everyone to look critically at any failure they see and try to resolve it or nail it down while waiting for your recheck :) | |
| 16:08:53 | bauzas | well, I'd say, I'm a bad doctor, I'm only able to tell what's wrong without any cure | |
| 16:09:14 | bauzas | and my diagnostics are always biased | |
| 16:09:25 | bauzas | but yeah, teamwork, agreed :) | |
| 16:09:28 | dansmith | well, doctors require continuing education to get better ;) | |
| 16:09:53 | bauzas | not only doctors :) | |
| 16:09:59 | bauzas | anyway, thanks for the update | |
| 16:10:41 | bauzas | I'm still wondering if the GPT errors I'm seeing in the console are somehow related to the timeouts | |
| 16:11:16 | dansmith | I don't think so, | |
| 16:11:26 | dansmith | we get those every time we attach a blank disk to an instance | |
| 16:11:38 | bauzas | ack, ok | |
| 16:11:44 | dansmith | the correlation is lots of timeouts come from volume tests, | |
| 16:11:52 | dansmith | which always dump console logs, and you see those things that look error-like | |