| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2023-10-24 | |||
| 09:45:51 | noonedeadpunk | Ok, I can submit a bug report if you think it's a bug, and I have a way around the issue as well :) | |
| 09:45:58 | bauzas | but basically, rebuild is broken on a rolling-upgrade from Zed to Antelope | |
| 09:46:10 | bauzas | noonedeadpunk: sure, file it please | |
| 09:46:48 | bauzas | and I think rebuild is also broken from Yoga to Zed btw. :) | |
| 09:47:26 | noonedeadpunk | Yes, another region we were upgrading from Yoga was also broken... | |
| 09:47:40 | noonedeadpunk | But it's unofficially supported upgrade, so I took better example :p | |
| 09:47:40 | bauzas | on rebuild ? | |
| 09:47:48 | noonedeadpunk | Yeah, same error | |
| 09:47:57 | bauzas | but not the same argument I guess | |
| 09:48:01 | noonedeadpunk | The only that has rebuild working is the one that has no computes down | |
| 09:48:23 | bauzas | from yoga to zed, it should yell at reimage_boot_volume missing | |
| 09:48:30 | noonedeadpunk | I actually wasn't digging there yet to be frank, as reported by users issues were the same from their side | |
| 09:49:09 | bauzas | I have to doublecheck but I think we're missing to test rebuild with grenade | |
| 09:50:32 | bauzas | anyway, I need to disappear, I have a few toxins to sweat before we start the PTG | |
| 09:53:48 | noonedeadpunk | sure, thanks a lot for the help, report is on it's way | |
| 09:58:06 | noonedeadpunk | eventually, since I found out about `hw_machine_type` what you would suggest adding? `q35` for all images basically? | |
| 10:15:42 | noonedeadpunk | bug: https://bugs.launchpad.net/nova/+bug/2040264 | |
| 11:39:00 | opendevreview | Alexey Stupnikov proposed openstack/nova stable/2023.1: Translate VF network capabilities to port binding https://review.opendev.org/c/openstack/nova/+/898945 | |
| 12:09:20 | sean-k-mooney | noonedeadpunk: i have not read back fully but one of the main issues with detachign a boot drive is it leave the instance in a fundementally broken state | |
| 12:10:22 | sean-k-mooney | if we were every to supprot that i htink we woudl need to have a new state for the vm to model that. and or allow away to say use a seperate disk as the boot device. | |
| 12:10:48 | noonedeadpunk | Well, shelved_offloaded should work kinda? | |
| 12:10:55 | sean-k-mooney | it also kind of messes with the resouce allcoatins if you dont follwo our guidance and use flavor with 0 disk_gb for bfv guests | |
| 12:11:11 | noonedeadpunk | But I guess challange there was also to record what the drive is detached to re-attach it as root lately | |
| 12:11:31 | sean-k-mooney | noonedeadpunk: shelve_offloaded does not work because we cant unshelve if you have detached the volume and attached it to somethign else | |
| 12:11:54 | noonedeadpunk | but it would be a valid failure that VM can't be offloaded | |
| 12:12:22 | sean-k-mooney | ya so it really comes down to the usecase | |
| 12:12:23 | noonedeadpunk | sean-k-mooney: sorry, I didn't get part about "use flavor with 0 disk_gb for bfv guests" - can you elaborate a bit on this part? | |
| 12:12:44 | noonedeadpunk | As I thought that for bfv you're kinda good at having 0 disk_gb? | |
| 12:12:56 | sean-k-mooney | yes that is the recomendation | |
| 12:13:09 | sean-k-mooney | but some peopel dont do that and use a normal flavor | |
| 12:13:13 | bauzas | sean-k-mooney: the fact is, we need a new design discussin | |
| 12:13:22 | bauzas | but if someone wants to work on it, sure I can hel | |
| 12:13:24 | noonedeadpunk | ah, ok, as I read it as "you don't follow recommendation AND use 0 disk_gb" | |
| 12:13:25 | bauzas | help | |
| 12:13:29 | bauzas | that was my point | |
| 12:13:39 | bauzas | noonedeadpunk: ++ I'll also discuss it on the PTG | |
| 12:14:14 | sean-k-mooney | bauzas: well right now i think its a hard cell to add to nova unless we put some restricitons in place | |
| 12:14:23 | sean-k-mooney | ... sell | |
| 12:14:42 | bauzas | sure, see my above comments :) | |
| 12:14:49 | bauzas | anyway | |
| 12:15:03 | bauzas | noonedeadpunk: I'll provide a bugfix hopefully next week | |
| 12:15:13 | sean-k-mooney | noonedeadpunk: i would have less issue with saying "you can only detach the root voluem flavor with 0 disk_gb" | |
| 12:15:15 | bauzas | or tomorrow morning if I have time | |
| 12:15:27 | sean-k-mooney | and then putting the vm in to an "unbootable state" | |
| 12:15:40 | sean-k-mooney | or only supporting this for shleve_offloaded instances | |
| 12:16:22 | sean-k-mooney | noonedeadpunk: the real concern was not with the detach but with reattaching potentially a diffent root volume with image properties that were invlaid for the current host | |
| 12:16:53 | sean-k-mooney | but if its shelve_offloaded after the reattachment then that not a problem as when we unshleve it will go throughthe schduler | |
| 12:17:28 | noonedeadpunk | Yeah, that's why I thought that shelved should be quite appropriate state where you potentially can do that | |
| 12:17:46 | noonedeadpunk | And I would say that having 0 disk_gb for flavor would be also fair requirements | |
| 12:18:03 | noonedeadpunk | for the feature to work | |
| 12:18:27 | sean-k-mooney | the 0 disk_gb thing is partly a personal prefence. we do not allow non bfv guest to use 0 disk flavors | |
| 12:18:39 | sean-k-mooney | but we dont require them too either and i really would prefer to require that | |
| 12:19:37 | sean-k-mooney | we dont actully need to use the flavor size to knwo if its bfv in the api | |
| 12:19:47 | sean-k-mooney | so we could make it work without that restirction | |
| 12:20:06 | sean-k-mooney | noonedeadpunk: what i really want to aovid is needing to hit the schduler on every volume attach | |
| 12:20:16 | noonedeadpunk | well. requiring that might complicate some things actually... | |
| 12:20:34 | sean-k-mooney | just in case its happens to be a root volume | |
| 12:20:47 | noonedeadpunk | I mean prohibit to do bfv with non-0 flavor | |
| 12:21:01 | sean-k-mooney | we didnt do that in the past due to upgrade concerns | |
| 12:21:19 | sean-k-mooney | what we did instead id if its BFV we nolonger include the disk_gb in the allcoation request | |
| 12:21:24 | noonedeadpunk | nah, I think that it indeed should be some offloaded state imo... Or indeed introduce new one, so that resources won't be wasted on offload per sat | |
| 12:21:30 | sean-k-mooney | as of some releivly recent openstack version | |
| 12:21:59 | noonedeadpunk | but which will still go throguh scheduler on boot | |
| 12:22:18 | noonedeadpunk | but yeah, eventually it's still offloaded... | |
| 12:22:55 | sean-k-mooney | noonedeadpunk: we will talk about this later in the ptg but im also wondering about the orginal usecase that is of most interest to people | |
| 12:23:17 | sean-k-mooney | i.e. what fraction of those that want this are using a version of nova that does not supprot rescue or rebuild for bfv guests | |
| 12:23:24 | sean-k-mooney | we added both in the lat 2 years | |
| 12:23:30 | noonedeadpunk | I think most usecase is in fact some rescue.... | |
| 12:23:46 | noonedeadpunk | and yes, that kinda covers my usecase fully | |
| 12:24:25 | noonedeadpunk | sean-k-mooney: is it possible to reset delete on termination flag for the root drive? | |
| 12:24:27 | sean-k-mooney | noonedeadpunk: part of the reason we didnt do this was we decied lets just make the instance action that dont work with bfv work first | |
| 12:24:50 | sean-k-mooney | noonedeadpunk: that im not sure i think you might eb able to do it via cinder | |
| 12:25:07 | sean-k-mooney | but that woudl also be reasonable to support IMO if we dont supprot that already | |
| 12:25:33 | sean-k-mooney | you shoudl always be able to say "hay dont delete this" after the fact i think | |
| 12:25:39 | noonedeadpunk | yeah | |
| 12:26:00 | noonedeadpunk | as this what strikes my mind when I think why I would need to detach the root volume... | |
| 12:26:10 | noonedeadpunk | Just to save it from being deleted | |
| 12:26:18 | noonedeadpunk | (with the VM) | |
| 12:26:36 | noonedeadpunk | and then rescue works nicely indeed | |
| 12:26:44 | sean-k-mooney | ya and you should be able to do the same for ports. the port case is defenitly on our todo list | |
| 12:28:44 | noonedeadpunk | but then indeed I don't know why would you need to detach it | |
| 12:29:17 | noonedeadpunk | Just out of convenience... Like first thing someone would try to do rather using rescue... | |
| 12:29:46 | noonedeadpunk | so I think you;re right here and it's smth that ppl were just historically missing due to not working rescue | |
| 12:30:26 | noonedeadpunk | and that is kinda inertion of thinking | |
| 12:32:27 | sean-k-mooney | ya so thats why im wondering about the usecase | |
| 12:32:43 | sean-k-mooney | if there is a usecase we cant supprot then im happy to hear that and see what we can do to supprot it | |
| 12:33:11 | sean-k-mooney | but if its already covered by rescue or updating the delete on terminate flag | |
| 12:33:24 | sean-k-mooney | then i woudl perfer to use that approch then add root detach | |
| 12:33:38 | sean-k-mooney | so we will see later i guess | |
| 13:00:35 | bauzas | we gonna use Zoom eventually https://www.openstack.org/ptg/rooms/diablo | |
| 13:05:19 | bauzas | sean-k-mooney: are you arriving to the PTg ? | |
| 14:28:53 | opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Deprecate use_cow_images and 'default' images_type https://review.opendev.org/c/openstack/nova/+/898229 | |
| 14:28:53 | opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Fix image conversion check in finish_migration https://review.opendev.org/c/openstack/nova/+/897842 | |
| 15:19:31 | opendevreview | Kashyap Chamarthy proposed openstack/nova master: libvirt: Avoid getCapabilities() to calculate host CPU definition https://review.opendev.org/c/openstack/nova/+/899185 | |
| 15:25:46 | opendevreview | Kashyap Chamarthy proposed openstack/nova master: libvirt: Avoid getCapabilities() to calculate host CPU definition https://review.opendev.org/c/openstack/nova/+/899185 | |
| 16:18:20 | simondodsley | sean-k-mooney: sorry - i can't stay any longer on the PTG today - i have other commitments i have to deal with. I would love some update on the spec I put in the etherpad though | |
| 16:21:30 | opendevreview | Merged openstack/nova stable/2023.2: Install lxml before we need it in post-run https://review.opendev.org/c/openstack/nova/+/899142 | |
| 16:43:14 | opendevreview | Pavlo Shchelokovskyy proposed openstack/placement master: Use new db session when retrying https://review.opendev.org/c/openstack/placement/+/898807 | |
| 16:45:37 | opendevreview | Pavlo Shchelokovskyy proposed openstack/placement master: Use new db session when retrying https://review.opendev.org/c/openstack/placement/+/898807 | |
| 18:13:19 | bauzas | not fun: we had the exact same issue with rolling upgrade in Victoria>Wallaby on rebuild https://review.opendev.org/c/openstack/nova/+/761458/ | |