| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2022-09-01 | |||
| 15:34:13 | bauzas | the fact that we leave other virt drivers in the weeds is another concern | |
| 15:34:21 | bauzas | both weren't discussed at the PTG | |
| 15:34:46 | dansmith | so on that, | |
| 15:34:53 | bauzas | and when I reviewed the spec, I was letting enough comments explaining how I was thinking the reboot solution was fragile | |
| 15:34:59 | dansmith | are we really expecting anyone to update vmware or hyperv to do this? | |
| 15:35:05 | bauzas | reasonably not | |
| 15:35:10 | dansmith | ironic perhaps, but for the above patch, | |
| 15:35:19 | dansmith | I was looking at those other drivers and wondering when they were last touched | |
| 15:35:35 | bauzas | surely, but we haven't even asked them to look | |
| 15:35:53 | dansmith | okay I guess we've had changes in 2022 for vmware | |
| 15:35:58 | dansmith | so maybe doable | |
| 15:36:31 | dansmith | not much for hyperv though | |
| 15:37:18 | dansmith | so I don't see any configdrive stuff in hyperv at first glance | |
| 15:37:48 | bauzas | fair enough, but then question | |
| 15:37:54 | bauzas | I'm an user | |
| 15:38:09 | bauzas | I wanna update my pet's userdata | |
| 15:38:13 | bauzas | I do it | |
| 15:38:33 | bauzas | and then I don't understand, my f*** script doesn't run as expected when I restart the guest | |
| 15:38:44 | bauzas | shall I open a ticket ? | |
| 15:39:08 | dansmith | oh it's in hyperv, just in vmops.py | |
| 15:39:24 | bauzas | oh, simple, your cloud was running some driver on that host that was having trouble with updating the configdrive | |
| 15:39:35 | bauzas | either because it was a legacy driver | |
| 15:39:44 | bauzas | or because something (like a perm error) expected | |
| 15:40:10 | bauzas | honestly, this spec was just about touching an internal Nova DB record | |
| 15:40:21 | bauzas | now, we're pulling way more than that | |
| 15:40:47 | dansmith | yeah, it's becoming more about configdrive than anything else | |
| 15:41:27 | sean-k-mooney | bauzas: in two converstaion but form my persepcitve i dont think we really have discoverd anythign bar the rpc change. i reveiw the spec with the understandin it was scoped to libvirt | |
| 15:42:44 | bauzas | yet again, can't we just assume to update instance's metadata only if not configdrive-driven, and leave people who care about configdrives deal with the complexity one day or another? | |
| 15:42:45 | dansmith | I dunno, I can see the argument for this being scoped to just one driver, but for something this fundamental it seems pretty unfortunate to say it's only for libvirt | |
| 15:43:10 | bauzas | I'm pretty sure we wouldn't have this back-to-back | |
| 15:44:31 | dansmith | so we reject the api call if configdrive=True always? | |
| 15:44:57 | bauzas | that's my question | |
| 15:45:10 | dansmith | doesn't that get closer to your concern on the spec that people think they have updated their instance but didn't reboot it and don't realize that cloud-init doesn't update their stuff? | |
| 15:45:29 | dansmith | I mean, that's just a misunderstanding of cloud-init, but I thought that was your concern | |
| 15:45:36 | dansmith | anyway, I dunno | |
| 15:45:37 | bauzas | if the update failed, they know the instance userdata wasn't updated | |
| 15:46:53 | bauzas | they would know this was because configdriver if they asked by boot params | |
| 15:47:15 | bauzas | but they wouldn't know if the clould defaulted to force configdrives or if the image was asking for it | |
| 15:47:22 | dansmith | right, it's not always their choice | |
| 15:47:45 | bauzas | anyway, I'm just offering a trade-off because I'm not really happy with the current state of the series | |
| 15:48:22 | bauzas | also, is the owner of the patch around ? | |
| 15:48:29 | bauzas | or are we offering our help for free ? | |
| 15:48:47 | dansmith | who is asking for this btw? | |
| 15:48:59 | dansmith | aside from the author | |
| 15:49:02 | bauzas | a private clould company | |
| 15:49:06 | bauzas | Inovex | |
| 15:49:07 | jhartkopf | I'm here | |
| 15:49:17 | bauzas | cool, glad to hear you jhartkopf | |
| 15:49:24 | bauzas | jhartkopf: lemme summarize | |
| 15:49:25 | dansmith | jhartkopf: do you care about the configdrive case? | |
| 15:49:37 | bauzas | we're having a problem with https://review.opendev.org/c/openstack/nova/+/816157/16 | |
| 15:49:45 | bauzas | and we don't know how to move forward | |
| 15:50:02 | jhartkopf | yep I quickly read your discussion | |
| 15:50:03 | bauzas | there is a proposed solution, but this is premature work and we're very late in the cycle | |
| 15:50:46 | bauzas | we're also creating a dependency to the virt drivers and unfortunately, Hyper-V, VMWare and Ironic could be impacted if we merge | |
| 15:51:43 | bauzas | lastly, I have concnerns about ensuring that the userdata API query is tied to the successfulness of the configdrive regen op | |
| 15:51:58 | bauzas | which would require the API call to be synchronous on a configdrive regen | |
| 15:52:21 | bauzas | so, my question is | |
| 15:52:31 | bauzas | do you really care of configdrives? | |
| 15:53:08 | dansmith | bauzas: we can't make the api call synchronous for config drive regen | |
| 15:53:23 | dansmith | that could take a long time, be dependent on the IO load on the compute, etc | |
| 15:53:25 | sean-k-mooney | i dont think that was an option | |
| 15:53:27 | bauzas | sean-k-mooney: I think it would be fair to say that this feature wouldn't be available to the other drivers while apparently they already support configdrive regen | |
| 15:53:40 | bauzas | eek, not regen, but creation | |
| 15:53:46 | sean-k-mooney | bauzas: yes that is correct | |
| 15:53:58 | bauzas | dansmith: right, I was pointing out loudly the problem | |
| 15:54:15 | dansmith | ah okay | |
| 15:54:16 | bauzas | this is a design problem | |
| 15:54:27 | bauzas | configdrives take time to regenerate | |
| 15:54:38 | bauzas | on the other hand, users have an API for updating userdata | |
| 15:55:02 | bauzas | they just assume they just have to restart their guests in order to have the latest update | |
| 15:55:21 | jhartkopf | bauzas: Initially we did not even want to touch config drives at all. We'd only like to update user data in the metadata service really. | |
| 15:55:32 | sean-k-mooney | right but the api prevents you updating the user data if the instance has a conf driver outside of hard_reboot | |
| 15:55:32 | bauzas | I know | |
| 15:55:34 | stephenfin | gibi: Sorry for the delay. I'd run through most of those PCI patches yesterday but didn't leave reviews until I got to the end of the series. Done now (y) | |
| 15:55:52 | gibi | stephenfin: much appreciated. I will look | |
| 15:55:56 | stephenfin | I went as far as sean-k-mooney did. Could go further but I see -1's from you | |
| 15:56:32 | gibi | stephenfin: yes, I left them -1 there as there is a bug in the scheduling part | |
| 15:56:45 | gibi | stephenfin: I think it is totally OK to merge it up until https://review.opendev.org/c/openstack/nova/+/850468/20 | |
| 15:57:11 | jhartkopf | What's up with the plan you guys proposed yesterday to split the patch and only allow updating instances without config drive for now? | |
| 15:57:25 | gibi | stephenfin: the rest slips to AA | |
| 15:57:38 | stephenfin | sounds reasonable to me | |
| 15:58:03 | sean-k-mooney | jhartkopf: i would prefer not to do that if we can avoid it but its an option | |
| 15:58:34 | sean-k-mooney | i think making this feature depend on if config drive is used or not is worse then only supproting it for some virt dirvrs | |
| 15:58:37 | gibi | stephenfin: there is two FUPs at the top. I will move them to be on the mergeable part of the series | |
| 15:58:46 | sean-k-mooney | sicne the config drive can change based on what host you land on | |
| 15:59:00 | sean-k-mooney | there is no way to knwo if it will work or not | |
| 15:59:33 | dansmith | sean-k-mooney: hmm, the mandatory config drive thing is a compute-node config right? | |
| 15:59:42 | sean-k-mooney | dansmith: yes | |
| 15:59:45 | dansmith | yeah, that sucks | |
| 15:59:58 | dansmith | so instances at the edge which use configdrive become un-updatable | |
| 16:00:10 | sean-k-mooney | yep | |
| 16:00:11 | gibi | user could use the capability trait to land on a host that supports regen | |
| 16:00:12 | dansmith | so another thing, | |
| 16:00:18 | sean-k-mooney | or ones in isolated networks | |
| 16:00:26 | dansmith | we really should support reboot with user_data for any instance, | |
| 16:00:36 | dansmith | because that's the consistent way to get it updated, regardless of what type it is | |
| 16:00:45 | dansmith | that way you get updated, you get rebooted, etc | |
| 16:01:04 | dansmith | gibi: the user doesn't know this is a problem until it's too late is the point | |
| 16:01:12 | sean-k-mooney | dansmith: that more or less what we were tryign to do and why i was insitieng on config drive support | |