| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2023-02-21 | |||
| 19:12:30 | sean-k-mooney | what might break is a hard reboot after that | |
| 19:12:38 | mnaser | yes exactly, or resize, etc | |
| 19:13:00 | sean-k-mooney | right but thats a complete differnt issue | |
| 19:13:13 | sean-k-mooney | we do not supprot move operations across diffent stroagge backends at all | |
| 19:13:30 | sean-k-mooney | and preventing that is left to the operator today and it has alyas been that way in nova | |
| 19:13:52 | mnaser | so as someone whos trying to get people to use openstack, giving them a big gun to shoot themselves in the foot | |
| 19:14:12 | mnaser | and then when they do that because it doesnt seem very trivial and obvious that what they did is wrong | |
| 19:14:18 | sean-k-mooney | mnaser: the simpelr approch si to use cells | |
| 19:14:20 | mnaser | when they went ahead, created az, aggregates, etc | |
| 19:14:36 | sean-k-mooney | we do not allwo cross cell live migration | |
| 19:14:37 | mnaser | that's a really good point | |
| 19:14:57 | mnaser | so ensure same storage backend inside a cell | |
| 19:15:03 | mnaser | seems like pretty sane advice | |
| 19:15:04 | sean-k-mooney | yes | |
| 19:15:16 | sean-k-mooney | with all that said we coudl work on a feature to adress this | |
| 19:15:45 | sean-k-mooney | but it would be a new feature and it would have to still allow usecase wehre cross az move operations make sense | |
| 19:16:14 | sean-k-mooney | mnaser: for example we recently added a similar feature for neutron routed networks | |
| 19:16:47 | sean-k-mooney | https://specs.openstack.org/openstack/nova-specs/specs/wallaby/implemented/routed-networks-scheduling.html | |
| 19:16:51 | mnaser | sometimes i really feel letting users create az's was a massive mistake lol | |
| 19:17:02 | sean-k-mooney | well users cant | |
| 19:17:04 | mnaser | it was always so loose and there's so many people who get shot in the foot with it | |
| 19:17:08 | mnaser | nah i mean from an operator perspective | |
| 19:17:11 | sean-k-mooney | its admin only unless you change the policy | |
| 19:17:26 | mnaser | people build out something and then it almost never gives them what they want | |
| 19:17:29 | sean-k-mooney | oh well the issue is peopel consufe nova az with aws | |
| 19:17:35 | sean-k-mooney | and they are nothign like each other | |
| 19:17:55 | mnaser | yeah | |
| 19:18:04 | sean-k-mooney | so before wallaybe tehre was no schduler supprot for route l3 networks | |
| 19:18:07 | mnaser | aws has a strong presence so its natural to think of it that way | |
| 19:18:22 | sean-k-mooney | i.e. there was nothign preventing you form cold/live migrating to a host where that ip coudl not be routed | |
| 19:18:36 | sean-k-mooney | https://specs.openstack.org/openstack/nova-specs/specs/wallaby/implemented/routed-networks-scheduling.html added support for this | |
| 19:19:11 | sean-k-mooney | it woudl not be unreasonable to have a similer feature for nova stoage | |
| 19:19:40 | sean-k-mooney | for example if we use the ceph fsid to create a placement aggrate containing all host that were configured to use that ceph cluster | |
| 19:19:58 | sean-k-mooney | and then recoded that in the isntance_system_metadata and schduled based on that if set | |
| 19:20:44 | sean-k-mooney | we would jsut need to do member_of=<fsid> in the pacement query | |
| 19:20:59 | mnaser | yeah, that seems like a handy simple way to track that for ceph | |
| 19:21:11 | sean-k-mooney | if rbd_fsid was in instance_system_metadata | |
| 19:21:34 | mnaser | i guess we would technically toss that into block device mapping data | |
| 19:21:44 | mnaser | i cant remember if nova uses that for its own storage | |
| 19:21:56 | sean-k-mooney | ish | |
| 19:22:02 | sean-k-mooney | we do in weird ways | |
| 19:22:10 | mnaser | maybe we should add a warning to the doc https://docs.openstack.org/nova/latest/admin/availability-zones.html about looking into using cells if you want to have full isolation and not allow migrations from one az to another | |
| 19:22:27 | sean-k-mooney | but this would be for the root disk really althoguh you could map cinder voluems to placment aggreats in a simialr way | |
| 19:23:32 | sean-k-mooney | bauzas: when you ahve time reading back over ^ would be good | |
| 19:23:48 | mnaser | ill push a PR to add some details about migrations and bring up cells | |
| 19:24:00 | sean-k-mooney | mnaser: cells are still not full isolation but ya. | |
| 19:24:11 | mnaser | i have to be honest in my ability of providing help, spec + new feature discussion + all that is a bit too far of a reach for this | |
| 19:24:12 | sean-k-mooney | mnaser: the other approch woudl be to have a weigher | |
| 19:24:19 | sean-k-mooney | so an az affinity weigher | |
| 19:24:29 | mnaser | hmm | |
| 19:24:33 | mnaser | i could do that out of tree i guess | |
| 19:24:42 | mnaser | as i dont think nova particlarly would wnat to carry that | |
| 19:25:06 | sean-k-mooney | we would need to pass the instance current cell to the sheduler and then the weigher could prefer to say in the same az | |
| 19:25:21 | sean-k-mooney | am i would not be against having it | |
| 19:25:57 | sean-k-mooney | we woudl need to modify the destination object and add a prefered az filed or something | |
| 19:26:55 | mnaser | i guess it can be a filter too but it would be very ugly | |
| 19:27:18 | mnaser | cause it would have to check if this is a reschedule (aka instance exists and we can find it) or first time (ignore) | |
| 19:27:27 | sean-k-mooney | well it should not be a filter because corss az move operations are valid | |
| 19:28:07 | mnaser | ah yes also addressing that | |
| 19:28:13 | sean-k-mooney | mnaser: basically we coudl add a "current_az" field here https://github.com/openstack/nova/blob/master/nova/objects/request_spec.py#L1092-L1122 | |
| 19:29:19 | mnaser | this starts to enter the domain of requiring more resources/time than i have so trying to see how i can be them most useful with the little resource i can spend on this 😅 | |
| 19:29:19 | mnaser | this starts to enter the domain of requiring more resources/time than i have so trying to see how i can be them most useful with the little resource i can spend on this 😅 | |
| 19:29:21 | sean-k-mooney | thats used in a few places but we baskcialy woudl just need to get the instnace.az and pass it on | |
| 19:29:52 | sean-k-mooney | well simple solution is docs patch + ptg topic | |
| 19:30:15 | sean-k-mooney | and i can raise it as a "operator pain point" internally and see if there is interst in adressing it | |
| 19:30:34 | sean-k-mooney | although i think we likely wont have time in the next cycle to work on this | |
| 19:31:42 | sean-k-mooney | there are potically 2 feature here an az affinity weigher, and reporting ceph clusters reachablity to placment | |
| 19:32:07 | sean-k-mooney | both help usablity in differnt ways | |
| 21:36:13 | simondodsley | In Train when I try to volume migrate a boot volume of a shutdown instance I get the message `Cannot 'swap_volume' instance xyx while it is in vm_state stopped` | |
| 21:36:22 | simondodsley | Is there any way to do this? | |
| 21:36:29 | simondodsley | Or was this something added after Train | |
| #openstack-nova - 2023-02-22 | |||
| 02:10:15 | opendevreview | Merged openstack/nova stable/train: [stable-only] Add binary test dependency "python3-devel" for py3 based RPM distros. https://review.opendev.org/c/openstack/nova/+/874547 | |
| 03:12:36 | opendevreview | Rajesh Tailor proposed openstack/nova master: Handle InstanceExists exception for duplicate instance https://review.opendev.org/c/openstack/nova/+/860938 | |
| 08:32:22 | bauzas | good morning Nova | |
| 08:43:22 | gibi | good morning bauzas | |
| 08:43:42 | gibi | I added my thoughts to the PTG etherpad | |
| 08:51:31 | bauzas | all cool | |
| 08:59:19 | bauzas | gibi: valid thoughts, I'm quite agreeing with most of them | |
| 08:59:50 | bauzas | gibi: I didn't really added more notes, I was just wanting to make sure those topics would be discussed | |
| 08:59:55 | bauzas | but I'll add more notes | |
| 09:03:39 | gibi | cool | |
| 09:03:45 | gibi | I dumped my brain as I will forget | |
| 09:32:11 | opendevreview | Maksim Malchuk proposed openstack/nova stable/zed: libvirt: Add configuration options to set SPICE compression settings https://review.opendev.org/c/openstack/nova/+/874739 | |
| 09:32:56 | opendevreview | Maksim Malchuk proposed openstack/nova stable/yoga: libvirt: Add configuration options to set SPICE compression settings https://review.opendev.org/c/openstack/nova/+/874740 | |
| 09:33:19 | opendevreview | Maksim Malchuk proposed openstack/nova stable/xena: libvirt: Add configuration options to set SPICE compression settings https://review.opendev.org/c/openstack/nova/+/874741 | |
| 10:07:48 | bauzas | gibi: sean-k-mooney: updated the cycle highlights https://review.opendev.org/c/openstack/releases/+/874483 | |
| 10:08:40 | bauzas | sean-k-mooney: about https://review.opendev.org/c/openstack/nova/+/874514/comments/1c6f98c9_72d6fed8 well, I was indeed trying to find the best doc to suit | |
| 10:09:05 | bauzas | and I think that given we use pinned cpus, the closest doc we could use was this one | |
| 10:09:45 | bauzas | and I agree, we could move this section to a larger 'power-management' doc once we implement for example virtiofs-scaphandre | |
| 10:26:04 | opendevreview | Pierre-Samuel Le Stang proposed openstack/nova master: Correctly reset instance task state in rebooting hard https://review.opendev.org/c/openstack/nova/+/867832 | |
| 10:45:38 | gibi | bauzas: the release highlight looks good to me | |
| 10:45:47 | bauzas | ack | |
| 10:45:49 | bauzas | thanks | |
| 10:46:10 | bauzas | I'll +1 based on your vote | |
| 10:46:18 | bauzas | (we need a PTL-approved label) | |
| 10:49:24 | sean-k-mooney | i have 2 issues inline | |
| 10:49:33 | sean-k-mooney | overall looks ok | |
| 10:57:02 | bauzas | sean-k-mooney: okay, lemme quickly look | |
| 11:00:07 | opendevreview | Amit Uniyal proposed openstack/nova master: Allow swap resize from non-zero to zero https://review.opendev.org/c/openstack/nova/+/857339 | |
| 11:05:29 | bauzas | gibi: sean-k-mooney: updated https://review.opendev.org/c/openstack/releases/+/874483 | |