Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2021-04-09
15:08:22 openstackgerrit Merged openstack/nova master: [OVN] Adapt the live-migration job scripts to work with OVN https://review.opendev.org/c/openstack/nova/+/776419
15:13:15 lyarwood gibi: https://bugs.launchpad.net/nova/+bug/1923206 - FYI this has come up downstream and upstream in TripleO
15:13:18 openstack Launchpad bug 1923206 in OpenStack Compute (nova) "libvirt.libvirtError: internal error: unable to execute QEMU command 'device_del': Device $device is already in the process of unplug" [Undecided,New] - Assigned to Lee Yarwood (lyarwood)
15:13:31 lyarwood gibi: I'm looking at fixing it now ahead of your rework series landing in Xena
15:13:50 lyarwood gibi: it's just awkward given the blind retry logic that we had previously
15:14:48 gibi lyarwood: ack, sorry that I had no time to go back to the bugfix
15:16:36 lyarwood gibi: np I'm going to work on this and then I can try to push that along again early in Xena
15:16:44 lyarwood gibi: as once again it would likely avoid this situation
15:18:58 sean-k-mooney lyarwood: did you make the parmater tuneable?
15:19:14 sean-k-mooney lyarwood: could they just increase the retry interval
15:19:27 sean-k-mooney to say 30 seconds
15:20:37 lyarwood sean-k-mooney: with this it's the initial interval so no I don't think we can, it's hardcoded in the decorator iirc
15:21:19 sean-k-mooney ok i tought you added workaround config options for this when we increased them
15:21:29 sean-k-mooney but looks like we did not
15:24:19 lyarwood we tuned the existing ones up but that only covers the time after the initial wait
15:40:43 openstackgerrit Balazs Gibizer proposed openstack/nova-specs master: QoS minimum guaranteed packet rate https://review.opendev.org/c/openstack/nova-specs/+/785014
15:48:56 openstackgerrit Nicolas Parquet proposed openstack/nova-specs master: Adds spec for supporting @ and . in keypair name https://review.opendev.org/c/openstack/nova-specs/+/785674
16:06:32 openstackgerrit Ghanshyam proposed openstack/nova master: Switch to new rolevar for run-tempest role https://review.opendev.org/c/openstack/nova/+/775040
16:47:51 gmann melwitt: stephenfin ^^ fixed the cmt msg.
17:14:06 openstackgerrit Lee Yarwood proposed openstack/nova master: libvirt: Ignore device already in the process of unplug errors https://review.opendev.org/c/openstack/nova/+/785682
17:18:06 openstackgerrit Lee Yarwood proposed openstack/nova master: libvirt: Ignore device already in the process of unplug errors https://review.opendev.org/c/openstack/nova/+/785682
17:22:18 openstackgerrit Lee Yarwood proposed openstack/nova master: libvirt: Ignore device already in the process of unplug errors https://review.opendev.org/c/openstack/nova/+/785682
17:22:21 lyarwood gah tgif++
17:22:58 lyarwood melwitt: ^ if you have any review bandwidth today but it can also wait until next week. More detach device fun with the old retry logic. I'll try to move gibi's rework forward next week ahead of ptg.
17:23:29 melwitt lyarwood: oooh my favorite
17:24:51 lyarwood melwitt: that's exactly what I said :|
17:26:27 melwitt (by that I mean that I will review :) )
17:27:48 lyarwood awesome thanks, I've just respun the TripleO change where I first saw it to include this nova change here https://review.opendev.org/c/openstack/tripleo-heat-templates/+/785027
17:28:48 lyarwood and with that I think I'm done for the week, have a great weekend all \o
17:30:17 lyarwood melwitt: https://review.opendev.org/c/openstack/nova/+/784130 - oh sorry before I go, if you have time this is also ready :)
17:31:06 melwitt lyarwood: will do, thanks for the extra info on the detach patch. have a good weekend o/
17:31:18 melwitt *and thanks
18:23:01 openstackgerrit Merged openstack/python-novaclient master: When creating a client, pass the default logger https://review.opendev.org/c/openstack/python-novaclient/+/783010
20:20:24 openstackgerrit Rodrigo Barbieri proposed openstack/nova master: Error anti-affinity violation on live migrations https://review.opendev.org/c/openstack/nova/+/784166
20:44:00 openstackgerrit Elod Illes proposed openstack/nova stable/train: DNM: nova-grenade-multinode test https://review.opendev.org/c/openstack/nova/+/785731
#openstack-nova - 2021-04-10
03:11:59 openstackgerrit melanie witt proposed openstack/python-novaclient master: Add unit tests for client logger https://review.opendev.org/c/openstack/python-novaclient/+/785741
03:31:55 openstackgerrit Merged openstack/python-novaclient stable/wallaby: Use well named anchor into the microversion history https://review.opendev.org/c/openstack/python-novaclient/+/781947
06:57:49 openstackgerrit Wenping Song proposed openstack/nova-specs master: Repropose vGPU support spec https://review.opendev.org/c/openstack/nova-specs/+/780452
07:01:40 openstackgerrit Merged openstack/nova stable/pike: Add resource_class to fields in ironic node cache https://review.opendev.org/c/openstack/nova/+/755653
07:02:07 openstackgerrit wangzhh proposed openstack/nova master: image_info: make RLIMIT configurable https://review.opendev.org/c/openstack/nova/+/785082
07:02:16 openstackgerrit Merged openstack/nova stable/pike: Include only required fields in ironic node cache https://review.opendev.org/c/openstack/nova/+/754444
07:02:42 openstackgerrit Merged openstack/nova stable/pike: Lowercase ironic driver hash ring and ignore case in cache https://review.opendev.org/c/openstack/nova/+/723055
07:05:12 openstackgerrit wangzhh proposed openstack/nova master: image_info: make RLIMIT configurable https://review.opendev.org/c/openstack/nova/+/785082
#openstack-nova - 2021-04-11
07:49:12 openstackgerrit Takashi Natsume proposed openstack/nova master: Update contributor guide for Xena https://review.opendev.org/c/openstack/nova/+/783534
10:23:22 openstackgerrit Merged openstack/nova master: nova-next: Drop NOVA_USE_SERVICE_TOKEN as it is now True by default https://review.opendev.org/c/openstack/nova/+/775575
15:35:32 openstackgerrit Merged openstack/nova stable/ussuri: Raise InstanceMappingNotFound if StaleDataError is encountered https://review.opendev.org/c/openstack/nova/+/777253
#openstack-nova - 2021-04-12
02:41:19 openstackgerrit Qiu Fossen proposed openstack/nova-specs master: Repropose copying pmem devices data spec https://review.opendev.org/c/openstack/nova-specs/+/785563
07:47:18 bauzas good morning Nova
08:29:55 gibi bauzas: good morning
08:31:19 bauzas eventually freed from PTOs and kids
08:33:44 yonglihe good morning
08:34:53 yonglihe bauzas, free from kids, really, tell me how
08:35:14 bauzas yonglihe: by passing them to the grandparents during the vacations ;)
08:35:23 yonglihe -:)
08:35:34 bauzas (during the *school* vacations tbc=
08:37:28 openstackgerrit Lucas Alvares Gomes proposed openstack/nova master: [OVN] Explicitly set nova-next job to ML2/OVS https://review.opendev.org/c/openstack/nova/+/776944
08:40:47 xinranwang gibi: Hi gibi, I have reproposed the smartnic spec, please review it when you got time. thanks! https://review.opendev.org/c/openstack/nova-specs/+/783632
08:40:56 openstackgerrit Lucas Alvares Gomes proposed openstack/nova master: [OVN] Explicitly set nova-next job to ML2/OVS https://review.opendev.org/c/openstack/nova/+/776944
08:40:56 openstackgerrit Lucas Alvares Gomes proposed openstack/nova master: [OVN] Explicitly set grenade job to ML2/OVS https://review.opendev.org/c/openstack/nova/+/776934
08:46:15 rpittau good morning everyone! Not sure if it's a known issue, when running grenaed jobs in stable/victoria in ironic, we're seeing this error in nova-api loga: http://paste.openstack.org/show/804380/
08:47:16 rpittau this is an example of failing job: https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17
08:51:29 bauzas rpittau: looking
08:51:37 rpittau thanks!
08:53:04 bauzas looks like an oslo messaging version issue
08:53:16 bauzas eg. https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17/log/controller/logs/screen-n-api.txt#2034
08:54:52 bauzas but that's on the old ussuri API
08:54:57 rpittau interesting, we started noticing the failure just last friday
08:55:03 openstackgerrit Qiu Fossen proposed openstack/nova-specs master: Allow migrating PMEM's data https://review.opendev.org/c/openstack/nova-specs/+/785563
08:56:26 openstackgerrit Elod Illes proposed openstack/nova stable/train: DNM: nova-grenade-multinode test https://review.opendev.org/c/openstack/nova/+/785731
08:57:10 bauzas rpittau: list of installed packages https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17/log/job-output.txt#51286
08:57:30 openstackgerrit Qiu Fossen proposed openstack/nova-specs master: Allow migrating PMEM's data https://review.opendev.org/c/openstack/nova-specs/+/785563
08:58:30 bauzas I'm not a grenade specialist, but it looks like it happens with the original install, before upgrading, while testing the original deployment
08:58:34 openstackgerrit Elod Illes proposed openstack/nova stable/train: DNM: nova-grenade-multinode test https://review.opendev.org/c/openstack/nova/+/785731
08:58:55 rpittau bauzas: yeah, I can confirm as the job fails immediately
08:59:08 bauzas elod: have you seen any issues with grenade on stable/victoria jobs ?
08:59:15 rpittau so nova doesn't like the version of oslo messaging installed in ussuri
08:59:30 bauzas rpittau: that's what I'm trying to see
08:59:36 rpittau ok, thanks
09:13:06 elod bauzas: no, not in victoria. stable/train is broken though (nova-grenade-multinode), but hopefully fixed by this patch when it merges: https://review.opendev.org/c/openstack/grenade/+/785831
09:13:50 sean-k-mooney https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17/log/controller/logs/pip3-freeze.txt#101
09:13:53 bauzas elod: looks like it could be related with rpittau
09:13:56 sean-k-mooney oslo.messaging==12.5.2
09:14:08 bauzas they don't correctly pin the versions IMHO
09:14:16 bauzas sean-k-mooney: yup
09:14:58 sean-k-mooney the version would be pinned in UC
09:15:02 sean-k-mooney right?
09:15:38 sean-k-mooney https://github.com/openstack/requirements/blob/stable/ussuri/upper-constraints.txt#L274-L277
09:15:55 sean-k-mooney so that is above the UC constrait for ussuri
09:16:27 sean-k-mooney it is the correct one for victoria
09:16:38 sean-k-mooney but grenade has not run yes
09:16:42 sean-k-mooney *yet
09:17:49 sean-k-mooney maybe it has. th ejob logs look weird
09:17:58 sean-k-mooney i dont see the devstack or grenade log
09:18:19 sean-k-mooney well the devstack log is in old
09:18:25 bauzas I'm looking at https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17/log/job-output.txt
09:18:35 bauzas and I can see the upgrade
09:18:36 elod bauzas rpittau : at a first glance the failure looks different. anyway, there was a change in grenade on last Thursday, maybe related: https://review.opendev.org/q/topic:"standardize-tempest-tox-constraints"+status:merged
09:18:58 sean-k-mooney actully the devstack log has the grenade output in it?
09:19:05 sean-k-mooney https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17/log/controller/logs/old/devstacklog.txt
09:21:18 sean-k-mooney if this is the new zuul v3 grenade job it looks like its overriding the devstack log with the greneade log

Earlier   Later