Earlier  
Posted Nick Remark
#openstack-nova - 2021-03-17
08:26:42 gibi just ping me if you get stuck
08:27:02 gibi we do the backport one stable branch at a time going backward in time so first we merge it to stable/victoria
08:27:29 gibi as far as I see the fix is applicable back until stable/stein
08:27:38 Luzi okay, i know we have to go back to at least train
08:28:12 Luzi yeah i will have a look into the code, when the change for the config option took place
08:35:54 gibi gmann: hi do I understand correctly that https://bugs.launchpad.net/nova/+bug/1918945 is not a regression so we don't need to mark it wallaby-rc-potential ?
08:35:56 openstack Launchpad bug 1918945 in OpenStack Compute (nova) "Nova API fails with 500s when called with non-project-scoped keystone tokens" [Undecided,New]
09:09:26 kashyap Luzi: Mornin; looking
09:09:41 kashyap Nit: The commit message's formatting is completely off
09:14:08 openstackgerrit Brin Zhang proposed openstack/nova master: Add missed accel_uuids for _poll_shelved_instances https://review.opendev.org/c/openstack/nova/+/778440
09:20:57 kashyap And yes, as Gibi says, backports are worth it.
09:36:17 brinzhang_ gibi: thanks
09:42:09 lyarwood bauzas: https://review.opendev.org/c/openstack/nova/+/757098 - another easy stable review if you have time this morning, trying to get the series moving back to stable/queens
09:42:37 bauzas lyarwood: on PTO today actually :(
09:45:58 lyarwood bauzas: ah sorry I did see that fly past yesterday, enjoy!
09:46:02 lyarwood ./kick bauzas
09:46:08 lyarwood :)
09:46:10 bauzas ;)
09:46:27 bauzas Sophie is turning 40 like me, so I need to help her to not crying :p
09:46:48 lyarwood ^_^
09:47:15 gibi :)
09:48:17 kashyap bauzas: It's like fine wine :)
09:50:57 lyarwood gibi: https://review.opendev.org/c/openstack/nova/+/780333/ - I'm going to hold off on this until stephenfin has sobered up and is back online. I missed that sean had wanted to keep 403 tbh so I think stephenfin just needs to confirm why he changed to 409.
09:54:05 gibi lyarwood: ack, I also would like to consult stephenfin and maybe even with gmann about that return code
09:54:35 gibi lyarwood: we really should approve that patch latest Friday
09:58:10 lyarwood ack
10:51:09 elod lyarwood: I've backported (clean cherry pick o:)) your patch to pike as well: https://review.opendev.org/c/openstack/nova/+/780852
10:51:48 elod could you please have a look? o:)
10:52:16 elod (this is to unblock stable/pike)
10:54:20 Luzi kashyap, i addressed your points https://review.opendev.org/c/openstack/nova/+/781030
11:09:13 mgoddard lyarwood: https://review.opendev.org/c/openstack/nova/+/781079
11:09:48 mgoddard lyarwood: I noticed you assigned https://bugs.launchpad.net/nova/+bug/1917498 to yourself, thought I'd propose my patch before you start working on it
11:09:50 openstack Launchpad bug 1917498 in OpenStack Compute (nova) "Cold migration/resize failure with encrypted volumes can leave instance in error and volumes attaching" [Medium,Triaged] - Assigned to Lee Yarwood (lyarwood)
11:27:59 kashyap Luzi: Looks good; thanks!
12:03:28 lyarwood mgoddard: ah awesome thanks! I'll look in a min
12:09:37 lyarwood mgoddard: so the check LGTM *but* this on the compute itself after we cast (and return 202) from the API
12:09:56 lyarwood mgoddard: AFAICT we should be able to check this before we cast over in the compute API using the bdms
12:10:37 lyarwood mgoddard: its just better UX IMHO, instead of getting a 202 back the caller gets an instant failure
12:11:04 mgoddard lyarwood: agreed, that would be better. Is there precedent for accessing barbican from the API?
12:13:45 lyarwood mgoddard: https://github.com/openstack/nova/blob/2dc26edfc52c791e760f8a7320fdc8be3061d1fe/nova/compute/api.py#L1877-L1889 - yeah looks like it's used with the current ephemeral encryption implementation to create a secret during instance creation
12:14:45 lyarwood that isn't widely used but I think it's still valid for the API to have access to the key manager if configured
12:14:59 lyarwood I *think* c-api also does this ahead of c-vol creating an encrypted volume FWIW
12:18:44 mgoddard lyarwood: right, I think c-api creates the secret
13:32:38 fungi Luzi: gibi: kashyap: when i looked yesterday, it appeared that option was first added in ocata (nova 15.0.0), obviously not a lot of point in backporting to branches that old but you can pretty well backport as far as you want to go
13:33:18 fungi the change to implement it merged in january 2017
13:33:41 kashyap fungi: Yep; indeed it was done during Ocata. Perhaps we can settle on backporting it to the oldest supported stable
13:35:21 fungi that would be consistent with our usual approach to security support for openstack, yeah
13:36:50 gibi fungi: ack
14:54:57 openstackgerrit Nicolas Parquet proposed openstack/nova master: Allow @ and dot (.) characters in keypair name https://review.opendev.org/c/openstack/nova/+/781076
15:09:32 melwitt thanks for the review lyarwood :) elod, in case you missed my ping from yesterday: https://review.opendev.org/c/openstack/nova/+/780991
15:17:31 lyarwood anytime
15:18:43 lyarwood melwitt: https://review.opendev.org/c/openstack/nova/+/757098 & https://review.opendev.org/c/openstack/nova/+/758733 could use stable core reviews if you have time in return :)
15:19:06 melwitt lyarwood: sure thing
15:19:59 lyarwood thanks
15:30:05 gmann gibi: on https://bugs.launchpad.net/nova/+bug/1918945
15:30:06 openstack Launchpad bug 1918945 in OpenStack Compute (nova) "Nova API fails with 500s when called with non-project-scoped keystone tokens" [Undecided,New]
15:31:24 gmann gibi: yes this is not regression, it is as per keystone current design for system scope. we will discuss about that more before and then in PTG. i have added this in etherpad L220 https://etherpad.opendev.org/p/nova-xena-ptg
15:32:27 gmann gibi: may be we should add this as cross project topic with keystone. lbragstad dansmith ?
15:32:57 gmann gibi: lyarwood ack 780333, I will check after my breakfast
15:33:08 dansmith it's fodder for the conversation about system scope for sure
15:33:23 dansmith figured that one that lbragstad has the etherpad for is probably cross-project already
15:33:28 elod melwitt: sorry, i did miss it somehow :S ...but now it's +2+W'd
15:33:45 lbragstad i haven't created any etherpads, yet
15:34:02 lbragstad just the one for summarizing the issue
15:34:16 lbragstad but i didn't target it to be a topic for the PTG officially or anything
15:35:11 melwitt elod: thanks! question for you, how did you figure out that stable/pike was failing for lack of https://review.opendev.org/c/openstack/nova/+/780852 ? just curious bc I can't figure it out. the error I see in nova-live-migration there is "Error EINVAL: bad entity name" and I was curious how you knew what was happening
15:35:20 dansmith lbragstad: https://etherpad.opendev.org/p/nova-xena-ptg L220, I thought that was you but I guess it was sean
15:35:54 lbragstad oh - cool
15:36:34 lbragstad fwiw - i tried summarizing everything in a ml post and i sent it to the operator list
15:36:54 lbragstad i'd like to know if they have any opinions on how this should work
15:36:55 lbragstad http://lists.openstack.org/pipermail/openstack-discuss/2021-March/021131.html
15:38:03 dansmith yeah, I have that marked, but haven't seen any replies yet
15:38:12 elod melwitt: well, I just saw, that it is ceph related, and since we just pinned ceph in newer stable branches I gave it a try
15:38:33 melwitt elod: ahh :) ok cool
15:44:58 gmann dansmith: lbragstad I added it in nova L220 but we can move to cross project section
15:45:10 dansmith ack
15:49:16 gmann dansmith: gibi lbragstad done, moved to L47 - https://etherpad.opendev.org/p/nova-xena-ptg
15:49:17 elod melwitt: and this failure (without the pin) also suggests that we are using ceph octopus in stable/pike (which is now pinned to nautilus in queens and newer): https://zuul.opendev.org/t/openstack/build/ea688ac7f8044e70b1503a517fc36db3/log/job-output.txt#4278
15:50:04 melwitt elod: ohh good spot, thank you
15:55:36 elod melwitt: thank you too for the +2 :)
15:57:42 melwitt elod: np, thank you for fixing it!
15:57:52 gibi gmann, dansmith, lbragstad: ack, thanks. I will check with the keystone team about a timeslot for that cross project discussion
15:59:01 melwitt elod: btw, I opened the result on the pinned ceph version patch for nova-grenade-live-migration and see it's failing with "ERROR: This script does not work on Python 2.7 The minimum supported Python version is 3.6. Please use https://bootstrap.pypa.io/pip/2.7/get-pip.py instead." https://zuul.opendev.org/t/openstack/build/6583ef90f2954a57934781e31d17c68d/log/logs/grenade.sh.txt#2656 do you recall a fix for that going around in the
15:59:01 melwitt past? I can't find
15:59:50 gibi gmann: thanks for confirming that it is not a regression
16:01:04 ignaziocassano Hello All, please anyone can help me with live migrations on queens? Only for some vm live migration does not work. When the vm tries to start on destination host, in instance log I read: 2021-03-15T14:16:12.593707Z qemu-kvm: Failed to load virtio/extra_state:extra_state
16:02:44 ignaziocassano If I hard reset the vm it starts and then I do not got any live migration errors anymore
16:03:57 elod melwitt: hmmm, that failure is related to this: https://review.opendev.org/q/topic:%22get-pip-py27%22
16:04:07 elod melwitt: i'll try to fix it
16:04:59 melwitt elod: oh, derp, how did I miss that in my gerrit search 😆 yeah, I thought it sounded familiar like something that got fixed recently. I'll lookout for your upcoming patch :)
16:05:45 ignaziocassano I wrote an email to openstack-discuss two days ago but I have not received any suggestion yet. Not found any bug related to to this issue
16:06:18 elod melwitt: correction: I won't be able to :/ as that is because it's ocata, and ocata cannot be fixed if I remember correctly... some catch 22...
16:07:28 lyarwood time to nuke the grenade job on pike then I guess?
16:07:53 melwitt elod: you mean pike? it's on pike but it's non-voting, perhaps for similar reasons
16:08:11 elod melwitt: stestr and other contradicting requirements :S (this was my trial: https://review.opendev.org/777614 )
16:08:29 elod melwitt: no, ocata, as grenade on pike starts with ocata install
16:09:34 melwitt elod: oh sorry 😓 I didn't know that. ok, good to know
16:09:42 elod lyarwood: yes, actually, I was thinking on that, too (I hoped I could fix it somehow, but 1. seems not really possible; 2. had another priority all the time... o:))
16:10:30 melwitt yeah, agreed if it can't be fixed then we can save CI resources
16:11:40 elod melwitt: sure. actually not so many patches arrive to pike, but still, it would save some resource :)

Earlier   Later