| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2025-07-22 | |||
| 16:22:36 | gibi | so I guess we need a solution where a compute starting up can fix the situation | |
| 16:22:46 | gibi | dansmith: yeah | |
| 16:22:54 | sp-bmilanov | yes, as gibi said, it's about when it crashes | |
| 16:23:08 | dansmith | and the review mentioned above would only be the non-crash situation | |
| 16:23:24 | gibi | yepp | |
| 16:23:45 | gibi | I feel that nova-compute during statup can be smarter about this to remove the VM duplication | |
| 16:24:03 | sp-bmilanov | the VM was seen in an error state after the nova-compute got back up because of a mismatch in what libvirt was reporting and the contents of the nova DB | |
| 16:25:51 | sp-bmilanov | a teammate suggested it would be better to have this as an separate error state which has more obstacles to get around until you are able to start the VM again | |
| 16:26:43 | sp-bmilanov | else nova-compute recreates the libvirt domain on VM start on the source hypervisor | |
| 16:26:53 | gibi | whichever compute puts the VM to error could be smarter and try to abort the live migration I guess | |
| 16:26:55 | dansmith | any solution for this is going to be something we need to document as a spec I think, because there are a lot of factors in play.. it's hard to know what to do when a live migration fails and in the past, we've basically said "lean on the operator to clean it up" | |
| 16:27:14 | gibi | dansmith: make sense | |
| 16:27:18 | gibi | it is complicated | |
| 16:27:46 | dansmith | preventing nova from re-starting on startup if it's not sure is good, but barriers to prevent the user from doing something bad are part of the complexityt | |
| 16:28:21 | gibi | I agree | |
| 16:28:45 | gibi | Also having a spec would force us to load context around this codepath (I don't have it loaded) | |
| 16:29:25 | gibi | sp-bmilanov: could you draft a spec even if it is just the problem statement with more details about what exactly happening and why | |
| 16:29:46 | dansmith | +1 | |
| 16:29:55 | gibi | I think that would help us brainstorming on a list of potential solutions | |
| 16:30:11 | sp-bmilanov | sure can | |
| 16:30:19 | gibi | cool. thanks. | |
| 16:31:06 | sp-bmilanov | thanks gibi dansmith! | |
| 16:31:08 | gibi | Is there anything else to discuss? | |
| 16:32:32 | gibi | then thanks for joining today. Next week we will have Uggla back. | |
| 16:32:35 | gibi | #endmeeting | |
| 16:32:35 | opendevmeet | Meeting ended Tue Jul 22 16:32:35 2025 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | |
| 16:32:35 | opendevmeet | Minutes: https://meetings.opendev.org/meetings/nova/2025/nova.2025-07-22-16.00.html | |
| 16:32:35 | opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/nova/2025/nova.2025-07-22-16.00.txt | |
| 16:32:35 | opendevmeet | Log: https://meetings.opendev.org/meetings/nova/2025/nova.2025-07-22-16.00.log.html | |
| 16:32:40 | elodilles | thanks o/ | |
| 16:33:46 | gmaan | o/ | |
| 16:36:16 | fwiesel | o/ | |
| 16:47:59 | opendevreview | Merged openstack/nova master: Rename DEFAULT_GREEN_POOL to DEFAULT_EXECUTOR https://review.opendev.org/c/openstack/nova/+/948086 | |
| 16:48:13 | opendevreview | Merged openstack/nova master: Make the default executor configurable https://review.opendev.org/c/openstack/nova/+/948087 | |
| 18:13:14 | opendevreview | Merged openstack/nova master: api: Add response body schemas for server group APIs https://review.opendev.org/c/openstack/nova/+/952281 | |
| 19:25:50 | mikal | Heya. https://review.opendev.org/q/topic:%22libvirt-vdi%22 has been sitting with a single set of +2s for a couple of weeks. Does anyone have a minute to take a look at them please? | |
| 21:14:37 | opendevreview | Merged openstack/nova master: api: Address issues with server group APIs https://review.opendev.org/c/openstack/nova/+/953281 | |
| 21:49:32 | opendevreview | Ghanshyam proposed openstack/nova master: Add project manager role in Nova API policy rule https://review.opendev.org/c/openstack/nova/+/953063 | |
| #openstack-nova - 2025-07-23 | |||
| 06:17:53 | opendevreview | Jonas Schäfer proposed openstack/nova master: Preserve vTPM state between power off and power on https://review.opendev.org/c/openstack/nova/+/955657 | |
| 06:19:48 | opendevreview | Jonas Schäfer proposed openstack/nova master: Preserve vTPM state between power off and power on https://review.opendev.org/c/openstack/nova/+/955657 | |
| 06:20:11 | jssfr | dansmith, there you go ^ :) | |
| 10:51:31 | opendevreview | Ian Watson proposed openstack/nova master: Implementing get_num_instances for ironic virt driver https://review.opendev.org/c/openstack/nova/+/955685 | |
| 11:05:22 | opendevreview | Ian Watson proposed openstack/nova master: Closes-Bug: #2117697 Removing provider_tree removal upon 409 in set_aggregates_for_provider for race condition https://review.opendev.org/c/openstack/nova/+/955686 | |
| 11:07:19 | opendevreview | Ian Watson proposed openstack/nova master: Closes-Bug: 2117700 Implementing get_num_instances for ironic virt driver https://review.opendev.org/c/openstack/nova/+/955685 | |
| 11:13:29 | opendevreview | Ian Watson proposed openstack/nova master: Implementing get_num_instances for ironic virt driver https://review.opendev.org/c/openstack/nova/+/955685 | |
| 11:14:53 | opendevreview | Ian Watson proposed openstack/nova master: Removing provider_tree removal upon 409 in set_aggregates_for_provider for race condition https://review.opendev.org/c/openstack/nova/+/955686 | |
| 11:36:32 | manumoh | team, I facing a strange behaviour after migrating octavia to wallaby - my loadbalancer creations are failing if the used network (both lb-mgmt-network and the provider-network used as vrrp-net) contains more than one subnet. the amphora vm port has ips from both subnet and is causing the vms become not accessible. while checking the ports associated with the vm is see the following | |
| 11:36:58 | manumoh | https://www.irccloud.com/pastebin/aw4PlXn9/ | |
| 11:38:38 | manumoh | I can see octavia makes a POST call to nova to create the vm with network uuid , does this create port with multiple ips? | |
| 11:39:20 | manumoh | any help would be great | |
| 11:54:07 | opendevreview | Ian Watson proposed openstack/nova master: Changing how placement updates are trigger by seeing if a full reshape has occured and whether any changes to the provider tree has taken place. Closes-Bug: #2117701 https://review.opendev.org/c/openstack/nova/+/955687 | |
| 12:09:13 | opendevreview | Ian Watson proposed openstack/nova master: Adding a new method migrations_supported and using method to determine whether or not to issue get migrations api calls as part of resource tracker. Closes-Bug: #2117708 https://review.opendev.org/c/openstack/nova/+/955690 | |
| 13:02:34 | noonedeadpunk | qemu | |
| 13:03:05 | noonedeadpunk | that ^ supposed to be search in the channel history :D | |
| 13:15:11 | opendevreview | Kamil Sambor proposed openstack/nova master: Replace eventlet.event.Event with threading.Event https://review.opendev.org/c/openstack/nova/+/949754 | |
| 14:11:57 | opendevreview | sean mooney proposed openstack/nova master: Revert "Always delete NVRAM files when deleting instances" https://review.opendev.org/c/openstack/nova/+/922354 | |
| 14:12:02 | opendevreview | sean mooney proposed openstack/nova master: Revert "Always delete NVRAM files when deleting instances" https://review.opendev.org/c/openstack/nova/+/922354 | |
| 14:29:00 | gibi | eventlet sync starts in 1 minute https://meet.google.com/bcy-uqoz-hje | |
| 14:45:45 | sean-k-mooney | just saw this now i see folks have droped | |
| 14:52:26 | opendevreview | Kamil Sambor proposed openstack/nova master: Replace eventlet.event.Event with threading.Event https://review.opendev.org/c/openstack/nova/+/949754 | |
| 15:53:16 | gmaan | stephenfin: fixed the doc comments, please check https://review.opendev.org/c/openstack/nova/+/953063 | |
| 15:54:32 | gibi | sean-k-mooney: yeah we finished in 13 minutes the agenda doc has the details what we discussed | |
| 16:15:28 | sean-k-mooney | gibi: no worries, i didnt have time to look at the work since last week anyway | |
| 16:15:40 | sean-k-mooney | gibi: so i dint have anythign to dicuss | |
| 16:16:32 | gmaan | sean-k-mooney: I merged the manager role and new policy changes into single change, please check https://review.opendev.org/c/openstack/nova/+/953063 | |
| 16:17:08 | gmaan | that gives complete view of how changes looks like, thanks for that comment. | |
| 16:18:11 | sean-k-mooney | gmaan: sure. im having a hard time tryign to decice what to work on today so im happy to take a look | |
| 16:19:26 | gmaan | sean-k-mooney: thanks, I think good timing from me :) | |
| 16:21:13 | sean-k-mooney | normally i have no issue with a lack fo prioirty in my life because im pretty good at setting my own but right now im like, there are too many things i could be working on so its nice to be handed a review and say can you look at this | |
| 16:21:47 | gmaan | ++ | |
| 16:23:20 | gibi | sean-k-mooney: OK cool | |
| 17:14:28 | opendevreview | Merged openstack/nova master: libvirt: Add objects and notifications for sound model. https://review.opendev.org/c/openstack/nova/+/926126 | |
| 17:30:01 | sean-k-mooney | gmaan: so i need ot look at the testign of the poicy change tomorrow but lookign at the code change i think that is pretty good. i left one of two nit comments but nothign that need to be changed | |
| 17:30:39 | sean-k-mooney | gmaan: you already have tempest coverage for this too correct. ill try and look at that too tomorow to get a full picture of the testing | |
| 17:30:39 | gmaan | sean-k-mooney: ack, I have linked tempest change in same topic | |
| 17:30:48 | gmaan | sure, thanks | |
| 17:54:45 | opendevreview | sean mooney proposed openstack/nova master: [DNM] testing using debian for ceph jobs https://review.opendev.org/c/openstack/nova/+/955716 | |
| #openstack-nova - 2025-07-24 | |||
| 00:45:04 | mikal | stephenfin: I can't find an example in the nova codebase of a unit test which tests parsing for a non-string flavor extra spec. I'll do one up, but I think its a thing we've not deeply tested in the past unless every other extra spec is always a string or something. | |
| 05:57:30 | jssfr | sean-k-mooney, regarding NVRAM, we're currently working on reviving https://review.opendev.org/c/openstack/nova/+/621646, too | |
| 05:57:52 | jssfr | (this is somewhat re discussion in https://review.opendev.org/c/openstack/nova/+/955657, but also because I saw your other change) | |
| 06:11:07 | opendevreview | Merged openstack/nova master: api: Add response body schemas for removed APIs https://review.opendev.org/c/openstack/nova/+/952282 | |
| 08:32:27 | opendevreview | Ian Watson proposed openstack/nova master: Add migrations_supported methed for resource tracker https://review.opendev.org/c/openstack/nova/+/955690 | |
| 08:59:10 | opendevreview | Ian Watson proposed openstack/nova master: Implementing get_num_instances for ironic virt driver https://review.opendev.org/c/openstack/nova/+/955685 | |
| 09:03:01 | opendevreview | Ian Watson proposed openstack/nova master: Implementing get_num_instances for ironic virt driver https://review.opendev.org/c/openstack/nova/+/955685 | |
| 09:16:23 | opendevreview | Ian Watson proposed openstack/nova master: Don't remove instance from cache if 409 hit https://review.opendev.org/c/openstack/nova/+/955686 | |
| 09:23:38 | opendevreview | Ian Watson proposed openstack/nova master: Changing how placement updates are triggered in RT https://review.opendev.org/c/openstack/nova/+/955687 | |
| 09:28:20 | opendevreview | Ian Watson proposed openstack/nova master: Add migrations_supported methed for resource tracker https://review.opendev.org/c/openstack/nova/+/955690 | |
| 10:22:27 | rpittau | hello everyone! :) | |
| 10:22:27 | rpittau | we've started to see an error in the ironic grenade job a couple of days ago, you can see an example report here https://e33cfc4e5ae5ade32027-ad9677b8f3b079990c4951ac9cbbd797.ssl.cf2.rackcdn.com/openstack/2f8dfc2059784e6691e13e08876ef108/controller/logs/grenade.sh_log.txt | |
| 10:22:27 | rpittau | it looks like the issue is somehow related to nova, at least from the errors we can see there, like 2025-07-23 21:16:59.494 | ERROR nova.objects.instance [[01;36mNone req-c824579b-82f9-499c-8b59-382bdf74f47b [00;36mNone None] [01;35m[instance: 00000000-0000-0000-0000-000000000000] Unable to migrate instance because host None with node None not found[00m: nova.exception.ComputeHostNotFound: Compute host None could not be found. | |
| 10:22:27 | rpittau | sorry for the wall of text, hoping to find someone who can help have a look here, thanks! | |
| 11:18:16 | gibi | rpittau: was the instance being migrated here is booted successfully on a node before? Does the test tries to migrate with a target host? If so what is the target host the test sends in the API request? | |
| 11:18:27 | gibi | does ironic supports migration at all? | |
| 11:18:28 | gibi | :) | |
| 11:42:29 | opendevreview | Lajos Katona proposed openstack/nova master: blueprint: iothreads-for-instances https://review.opendev.org/c/openstack/nova/+/939254 | |
| 12:50:12 | opendevreview | Dmitriy Rabotyagov proposed openstack/nova-specs master: Propose enabling parallel live migrations for libvirt https://review.opendev.org/c/openstack/nova-specs/+/955783 | |
| 12:57:47 | opendevreview | Dmitriy Rabotyagov proposed openstack/nova master: [WIP] Allow to perform parallel live migrations https://review.opendev.org/c/openstack/nova/+/955784 | |
| 12:58:14 | noonedeadpunk | sean-k-mooney: this is basically parallel migration thing we've talked last week ^ | |
| 12:58:25 | noonedeadpunk | just need to poke at unit tests a little bit | |
| 12:59:26 | noonedeadpunk | really interesting thing, is that tunneled migrations does have better performance then native migrations with tls | |