| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2022-06-27 | |||
| 12:44:22 | gibi | Uggla: fyi I'm in the middle of reviewing your patches so you will get feedback from me soon too | |
| 12:45:05 | Uggla | gibi, a lot of new ones ? | |
| 12:46:15 | gibi | Uggla: couple of nits in the code and a list of suggestions in the functional tests | |
| 12:46:45 | Uggla | gibi, ok I'm gonna wait for your comments. | |
| 13:00:28 | gibi | Uggla: posted my comments | |
| 13:00:39 | Uggla | gibi, ok thx | |
| 14:01:23 | opendevreview | Jan Hartkopf proposed openstack/nova master: add support for updating server's user_data https://review.opendev.org/c/openstack/nova/+/816157 | |
| 14:03:03 | opendevreview | Jan Hartkopf proposed openstack/python-novaclient master: add support for microversion 2.91 https://review.opendev.org/c/openstack/python-novaclient/+/816158 | |
| 16:29:41 | opendevreview | Jan Hartkopf proposed openstack/nova master: add support for updating server's user_data https://review.opendev.org/c/openstack/nova/+/816157 | |
| 19:55:11 | colby__ | gibi: bauzas: sean-k-mooney: Thanks for the info. If the mdevs are not removed to be reused why would nova see them as being used then? Is that the bug mentioned? We have dynamic mdevs made from the sriov-manage on the pgpus that all work on initial spin up of instances, but once you delete the instances you can no longer use the vgpu device. Its still seen as busy. | |
| #openstack-nova - 2022-06-28 | |||
| 04:58:08 | manuvakery1 | Hi .. if i take an instance snapshot after resizing to a higher flavor the min_disk property it set to the older flavor disk size. Is this a known issue in train? | |
| 05:31:44 | sean-k-mooney | ade_lee: so first bit of feedback is the jobs is not captureing logs form comptue-0 only compute-1 | |
| 05:31:59 | sean-k-mooney | ade_lee: second bit of feedback is this is a know issue | |
| 05:32:10 | sean-k-mooney | 2022-06-27 10:32:42.103 2 ERROR nova.virt.libvirt.driver [-] [instance: 1fb29abc-c443-4404-81df-312b233d05ca] Live Migration failure: End of file while reading data: | |
| 05:32:12 | sean-k-mooney | We trust you have received the usual lecture from the local System | |
| 05:32:14 | sean-k-mooney | Administrator. It usually boils down to these three things: | |
| 05:32:16 | sean-k-mooney | #1) Respect the privacy of others. | |
| 05:32:18 | sean-k-mooney | #2) Think before you type. | |
| 05:32:20 | sean-k-mooney | #3) With great power comes great responsibility. | |
| 05:32:22 | sean-k-mooney | sudo: a terminal is required to read the password; either use the -S option to read from standard input or configure an askpass helper | |
| 05:33:00 | sean-k-mooney | https://bugzilla.redhat.com/show_bug.cgi?id=2089520 | |
| 05:33:53 | sean-k-mooney | and its the same root cause | |
| 05:33:55 | sean-k-mooney | live_migration_uri=qemu+ssh://nova_migration@%s:2022/system?keyfile=/etc/nova/migration/identity&proxy=netcat | |
| 05:34:02 | sean-k-mooney | you are definign ^ | |
| 05:34:32 | sean-k-mooney | the live_migration_uri is depercated and we should not be using it downstream | |
| 05:35:02 | sean-k-mooney | but the actual issus is that that netcat at the ned if forceing netcat to be used in the live migration wrapper | |
| 05:35:52 | sean-k-mooney | so we are taking this if branch instead of the previous one https://github.com/rdo-packages/nova-distgit/blob/rpm-master/nova-migration-wrapper#L73-L75= | |
| 05:36:26 | sean-k-mooney | there are two issues with that first nc is not install and second the sudoers file only allow it to be used if you use the fully qualifed path | |
| 05:37:10 | sean-k-mooney | https://github.com/rdo-packages/nova-distgit/blob/rpm-master/nova_migration-sudoers#L3= | |
| 05:37:44 | sean-k-mooney | if nc was actully installed it might work as the command not found helper might eb trigering the sudo prompt so the patch might not be the problem | |
| 05:37:59 | sean-k-mooney | but the issue is its takign the netcat path | |
| 05:43:40 | sean-k-mooney | https://gitlab.com/libvirt/libvirt/-/blob/65312001bd972df8b7d4f11ea4662aff4889bee5/src/rpc/virnetclient.c#L446-448 | |
| 05:43:45 | sean-k-mooney | this is the relevent libvit code | |
| 05:49:35 | sean-k-mooney | change the migration uri to proxy=native | |
| 05:49:35 | sean-k-mooney | proxy=netcat will not work on 17 we shoudl etierh use auto or force the virt-ssh-helper via the native proxy | |
| 05:56:01 | sean-k-mooney | ade_lee: based on jame's comments and looking at the code this is a puppet-nova bug https://bugzilla.redhat.com/show_bug.cgi?id=2089520#c3 they obviouly never got the memo that using the uri directly has been deprecated since like osp 13 and that netcat was going away in 17 and they needed to stop forcing netcat and use either auto or native or stop generating the uri to let | |
| 05:56:03 | sean-k-mooney | libvirt use the virt-ssh-helper. | |
| 06:00:41 | sean-k-mooney | actully looking at puppet-nova this look liek its a ooo issue | |
| 06:01:43 | kashyap | sean-k-mooney: At least there seems to be upstream bug that says "fix released", but no patch there: https://bugs.launchpad.net/tripleo/+bug/1918250 | |
| 06:02:30 | sean-k-mooney | nice find | |
| 06:02:31 | kashyap | Yep, here it is (it's in Mar 2021): https://review.opendev.org/c/openstack/puppet-tripleo/+/779784/ | |
| 06:02:43 | kashyap | sean-k-mooney: Unrelated: You seem to be quite early up today | |
| 06:02:44 | sean-k-mooney | well | |
| 06:02:59 | sean-k-mooney | that might have been regressed | |
| 06:03:15 | sean-k-mooney | ya i woke up at 5:30 and didnt feel like going back to sleep | |
| 06:03:17 | sean-k-mooney | so i got up | |
| 06:03:18 | kashyap | Is there a new issue? | |
| 06:03:22 | kashyap | (I see) | |
| 06:03:30 | sean-k-mooney | live migration does not work on 17 period | |
| 06:03:42 | sean-k-mooney | well at least not with tls-e config | |
| 06:03:45 | kashyap | Is there a bz link? | |
| 06:03:46 | sean-k-mooney | not sure about with it disabled | |
| 06:04:07 | sean-k-mooney | kashyap: yes ill get it in a sec but the issue is that proxy=netcat is gettign generated in the migration uri | |
| 06:04:23 | frickler | are you sure you are in the right channel? this sounds like rdo talk | |
| 06:04:25 | sean-k-mooney | and netcat is not installed in the container since we should be using the virt-ssh-helper in 17 | |
| 06:04:57 | kashyap | frickler: Heh, I briefly wondered: if it's an upstream or a downstream-specific discussion | |
| 06:05:01 | sean-k-mooney | frickler: actully this was ment to be downstream but meh its a ooo bug | |
| 06:05:25 | sean-k-mooney | it was ment to be rhos-dev but i clicked the wrong tab | |
| 06:05:51 | sean-k-mooney | i have upstream on the top pane and downstream on the bottom | |
| 07:00:32 | gibi | o/ | |
| 07:17:52 | sean-k-mooney | gibi: o/ | |
| 07:21:38 | sean-k-mooney | frickler: so kashyap found https://review.opendev.org/c/openstack/puppet-tripleo/+/779313/ and i have filed the revert https://review.opendev.org/c/openstack/puppet-tripleo/+/847818 just to close the loop on the downstream topic i rasied upstream :) in case you were wondering | |
| 07:22:19 | sean-k-mooney | tl;dr is we forced netcat to workaround the lack of support in the rdo package for virt ssh-helper and since then netcat has been removed form teh ooo contianer | |
| 07:22:33 | sean-k-mooney | so we should just go back to auto now that we have support in the package | |
| 07:23:21 | whoami-rajat | hi #openstack-nova , would like to request reviews on my volume backend instance rebuild feature (3 patches in chain). the spec has merged and it was targeted for yoga cycle (but couldn't make it to the Feature freeze) so would like to get some early feedback | |
| 07:23:22 | whoami-rajat | https://review.opendev.org/c/openstack/nova/+/820368 | |
| 07:33:53 | sean-k-mooney | whoami-rajat: specs are approved per release so the imporant thing is that it was reappoved for zed | |
| 07:35:52 | whoami-rajat | sean-k-mooney, yep it was re-approved | |
| 07:36:22 | whoami-rajat | https://review.opendev.org/c/openstack/nova-specs/+/840155 | |
| 07:36:34 | sean-k-mooney | whoami-rajat: yep i remember | |
| 07:37:10 | sean-k-mooney | i have your review open. i need to do some downstream jira work quickly but ill review them when im done | |
| 07:37:24 | whoami-rajat | great, what i meant was it was approved last cycle as well but just wanted early reviews on it so i can make the deadline this time :) | |
| 07:37:29 | whoami-rajat | sean-k-mooney, thanks! | |
| 08:11:07 | frickler | sean-k-mooney: thx for the update. I really didn't want to drive you away, it just looked a bit out of context | |
| 09:03:38 | jkulik | Is there something in Nova that lets me express anti-affinity towards a group of hosts in the same rack? Use-case: we structure our HVs into racks and there might be customers not wanting their VM to run on the same HV (current anti-affinity I know about) and customers who don't want to run in the same rack as another VM, while staying in the same AZ. | |
| 09:06:09 | gibi | jkulik: I think there is no automatic way to express rack level (or host aggregate level) anti-affinity. What you can do is to create separate falvors for separate racks by referring the specific rack in the flavor | |
| 09:06:40 | gibi | but that does not scale well for many racks | |
| 09:06:44 | gibi | and many flavors | |
| 09:07:02 | gibi | I do remember discussing this on the last summit in berlin | |
| 09:07:24 | gibi | was it in the blazar session? | |
| 09:08:14 | gibi | https://etherpad.opendev.org/p/blazar-preemptible-and-gpus L64 | |
| 09:08:23 | gibi | or more like L57 | |
| 09:11:28 | sean-k-mooney | jkulik: we only supprot this at the az level | |
| 09:11:33 | sean-k-mooney | well no | |
| 09:11:36 | sean-k-mooney | at the host level | |
| 09:11:42 | sean-k-mooney | you can use AZs per rack | |
| 09:11:57 | sean-k-mooney | but we have no aggreate or az anti affintiy concept in nova | |
| 09:12:06 | sean-k-mooney | and its not simple to add | |
| 09:12:28 | gibi | sean-k-mooney: I had a suggestion in the above etherpad how to add it to nova | |
| 09:12:31 | sean-k-mooney | jkulik: if you want to isolate custoemr we have tenat isolation filters | |
| 09:13:00 | sean-k-mooney | gibi: we coudl do it via placment aggreate if we wanted too | |
| 09:13:13 | gibi | sean-k-mooney: nope | |
| 09:13:18 | sean-k-mooney | but i was just sayign we dont currently support it | |
| 09:13:25 | gibi | yes, we not currently support it | |
| 09:13:40 | gibi | the placement way would be harder than a nova way as placmenet aggregates has no metadata | |
| 09:13:49 | sean-k-mooney | we have also rejected it in the past as we did not want to add more orchestration to nova | |
| 09:13:50 | gibi | while nova aggregates has metadata | |
| 09:14:18 | sean-k-mooney | well nova aggreate are mapped to palcemnt aggreates | |
| 09:14:27 | gibi | without the metadata piece | |
| 09:14:27 | sean-k-mooney | but sure for the rack affinty that is doable | |