| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-04-09 | |||
| 17:22:58 | lyarwood | melwitt: ^ if you have any review bandwidth today but it can also wait until next week. More detach device fun with the old retry logic. I'll try to move gibi's rework forward next week ahead of ptg. | |
| 17:23:29 | melwitt | lyarwood: oooh my favorite | |
| 17:24:51 | lyarwood | melwitt: that's exactly what I said :| | |
| 17:26:27 | melwitt | (by that I mean that I will review :) ) | |
| 17:27:48 | lyarwood | awesome thanks, I've just respun the TripleO change where I first saw it to include this nova change here https://review.opendev.org/c/openstack/tripleo-heat-templates/+/785027 | |
| 17:28:48 | lyarwood | and with that I think I'm done for the week, have a great weekend all \o | |
| 17:30:17 | lyarwood | melwitt: https://review.opendev.org/c/openstack/nova/+/784130 - oh sorry before I go, if you have time this is also ready :) | |
| 17:31:06 | melwitt | lyarwood: will do, thanks for the extra info on the detach patch. have a good weekend o/ | |
| 17:31:18 | melwitt | *and thanks | |
| 18:23:01 | openstackgerrit | Merged openstack/python-novaclient master: When creating a client, pass the default logger https://review.opendev.org/c/openstack/python-novaclient/+/783010 | |
| 20:20:24 | openstackgerrit | Rodrigo Barbieri proposed openstack/nova master: Error anti-affinity violation on live migrations https://review.opendev.org/c/openstack/nova/+/784166 | |
| 20:44:00 | openstackgerrit | Elod Illes proposed openstack/nova stable/train: DNM: nova-grenade-multinode test https://review.opendev.org/c/openstack/nova/+/785731 | |
| #openstack-nova - 2021-04-10 | |||
| 03:11:59 | openstackgerrit | melanie witt proposed openstack/python-novaclient master: Add unit tests for client logger https://review.opendev.org/c/openstack/python-novaclient/+/785741 | |
| 03:31:55 | openstackgerrit | Merged openstack/python-novaclient stable/wallaby: Use well named anchor into the microversion history https://review.opendev.org/c/openstack/python-novaclient/+/781947 | |
| 06:57:49 | openstackgerrit | Wenping Song proposed openstack/nova-specs master: Repropose vGPU support spec https://review.opendev.org/c/openstack/nova-specs/+/780452 | |
| 07:01:40 | openstackgerrit | Merged openstack/nova stable/pike: Add resource_class to fields in ironic node cache https://review.opendev.org/c/openstack/nova/+/755653 | |
| 07:02:07 | openstackgerrit | wangzhh proposed openstack/nova master: image_info: make RLIMIT configurable https://review.opendev.org/c/openstack/nova/+/785082 | |
| 07:02:16 | openstackgerrit | Merged openstack/nova stable/pike: Include only required fields in ironic node cache https://review.opendev.org/c/openstack/nova/+/754444 | |
| 07:02:42 | openstackgerrit | Merged openstack/nova stable/pike: Lowercase ironic driver hash ring and ignore case in cache https://review.opendev.org/c/openstack/nova/+/723055 | |
| 07:05:12 | openstackgerrit | wangzhh proposed openstack/nova master: image_info: make RLIMIT configurable https://review.opendev.org/c/openstack/nova/+/785082 | |
| #openstack-nova - 2021-04-11 | |||
| 07:49:12 | openstackgerrit | Takashi Natsume proposed openstack/nova master: Update contributor guide for Xena https://review.opendev.org/c/openstack/nova/+/783534 | |
| 10:23:22 | openstackgerrit | Merged openstack/nova master: nova-next: Drop NOVA_USE_SERVICE_TOKEN as it is now True by default https://review.opendev.org/c/openstack/nova/+/775575 | |
| 15:35:32 | openstackgerrit | Merged openstack/nova stable/ussuri: Raise InstanceMappingNotFound if StaleDataError is encountered https://review.opendev.org/c/openstack/nova/+/777253 | |
| #openstack-nova - 2021-04-12 | |||
| 02:41:19 | openstackgerrit | Qiu Fossen proposed openstack/nova-specs master: Repropose copying pmem devices data spec https://review.opendev.org/c/openstack/nova-specs/+/785563 | |
| 07:47:18 | bauzas | good morning Nova | |
| 08:29:55 | gibi | bauzas: good morning | |
| 08:31:19 | bauzas | eventually freed from PTOs and kids | |
| 08:33:44 | yonglihe | good morning | |
| 08:34:53 | yonglihe | bauzas, free from kids, really, tell me how | |
| 08:35:14 | bauzas | yonglihe: by passing them to the grandparents during the vacations ;) | |
| 08:35:23 | yonglihe | -:) | |
| 08:35:34 | bauzas | (during the *school* vacations tbc= | |
| 08:37:28 | openstackgerrit | Lucas Alvares Gomes proposed openstack/nova master: [OVN] Explicitly set nova-next job to ML2/OVS https://review.opendev.org/c/openstack/nova/+/776944 | |
| 08:40:47 | xinranwang | gibi: Hi gibi, I have reproposed the smartnic spec, please review it when you got time. thanks! https://review.opendev.org/c/openstack/nova-specs/+/783632 | |
| 08:40:56 | openstackgerrit | Lucas Alvares Gomes proposed openstack/nova master: [OVN] Explicitly set nova-next job to ML2/OVS https://review.opendev.org/c/openstack/nova/+/776944 | |
| 08:40:56 | openstackgerrit | Lucas Alvares Gomes proposed openstack/nova master: [OVN] Explicitly set grenade job to ML2/OVS https://review.opendev.org/c/openstack/nova/+/776934 | |
| 08:46:15 | rpittau | good morning everyone! Not sure if it's a known issue, when running grenaed jobs in stable/victoria in ironic, we're seeing this error in nova-api loga: http://paste.openstack.org/show/804380/ | |
| 08:47:16 | rpittau | this is an example of failing job: https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17 | |
| 08:51:29 | bauzas | rpittau: looking | |
| 08:51:37 | rpittau | thanks! | |
| 08:53:04 | bauzas | looks like an oslo messaging version issue | |
| 08:53:16 | bauzas | eg. https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17/log/controller/logs/screen-n-api.txt#2034 | |
| 08:54:52 | bauzas | but that's on the old ussuri API | |
| 08:54:57 | rpittau | interesting, we started noticing the failure just last friday | |
| 08:55:03 | openstackgerrit | Qiu Fossen proposed openstack/nova-specs master: Allow migrating PMEM's data https://review.opendev.org/c/openstack/nova-specs/+/785563 | |
| 08:56:26 | openstackgerrit | Elod Illes proposed openstack/nova stable/train: DNM: nova-grenade-multinode test https://review.opendev.org/c/openstack/nova/+/785731 | |
| 08:57:10 | bauzas | rpittau: list of installed packages https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17/log/job-output.txt#51286 | |
| 08:57:30 | openstackgerrit | Qiu Fossen proposed openstack/nova-specs master: Allow migrating PMEM's data https://review.opendev.org/c/openstack/nova-specs/+/785563 | |
| 08:58:30 | bauzas | I'm not a grenade specialist, but it looks like it happens with the original install, before upgrading, while testing the original deployment | |
| 08:58:34 | openstackgerrit | Elod Illes proposed openstack/nova stable/train: DNM: nova-grenade-multinode test https://review.opendev.org/c/openstack/nova/+/785731 | |
| 08:58:55 | rpittau | bauzas: yeah, I can confirm as the job fails immediately | |
| 08:59:08 | bauzas | elod: have you seen any issues with grenade on stable/victoria jobs ? | |
| 08:59:15 | rpittau | so nova doesn't like the version of oslo messaging installed in ussuri | |
| 08:59:30 | bauzas | rpittau: that's what I'm trying to see | |
| 08:59:36 | rpittau | ok, thanks | |
| 09:13:06 | elod | bauzas: no, not in victoria. stable/train is broken though (nova-grenade-multinode), but hopefully fixed by this patch when it merges: https://review.opendev.org/c/openstack/grenade/+/785831 | |
| 09:13:50 | sean-k-mooney | https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17/log/controller/logs/pip3-freeze.txt#101 | |
| 09:13:53 | bauzas | elod: looks like it could be related with rpittau | |
| 09:13:56 | sean-k-mooney | oslo.messaging==12.5.2 | |
| 09:14:08 | bauzas | they don't correctly pin the versions IMHO | |
| 09:14:16 | bauzas | sean-k-mooney: yup | |
| 09:14:58 | sean-k-mooney | the version would be pinned in UC | |
| 09:15:02 | sean-k-mooney | right? | |
| 09:15:38 | sean-k-mooney | https://github.com/openstack/requirements/blob/stable/ussuri/upper-constraints.txt#L274-L277 | |
| 09:15:55 | sean-k-mooney | so that is above the UC constrait for ussuri | |
| 09:16:27 | sean-k-mooney | it is the correct one for victoria | |
| 09:16:38 | sean-k-mooney | but grenade has not run yes | |
| 09:16:42 | sean-k-mooney | *yet | |
| 09:17:49 | sean-k-mooney | maybe it has. th ejob logs look weird | |
| 09:17:58 | sean-k-mooney | i dont see the devstack or grenade log | |
| 09:18:19 | sean-k-mooney | well the devstack log is in old | |
| 09:18:25 | bauzas | I'm looking at https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17/log/job-output.txt | |
| 09:18:35 | bauzas | and I can see the upgrade | |
| 09:18:36 | elod | bauzas rpittau : at a first glance the failure looks different. anyway, there was a change in grenade on last Thursday, maybe related: https://review.opendev.org/q/topic:"standardize-tempest-tox-constraints"+status:merged | |
| 09:18:58 | sean-k-mooney | actully the devstack log has the grenade output in it? | |
| 09:19:05 | sean-k-mooney | https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17/log/controller/logs/old/devstacklog.txt | |
| 09:21:18 | sean-k-mooney | if this is the new zuul v3 grenade job it looks like its overriding the devstack log with the greneade log | |
| 09:25:38 | sean-k-mooney | it looks like LOGFILE="/opt/stack/old/logs/devstacklog.txt" is not working properly | |
| 09:25:57 | sean-k-mooney | the devstack logs are just in the main output file | |
| 09:33:50 | bauzas | honestly, I'm damn puzzled | |
| 09:34:41 | elod | this looks also interesting: https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17/log/job-output.txt#48860-48864 | |
| 09:35:32 | elod | that shows some error, but wierdly the end it succeeds | |
| 09:35:57 | sean-k-mooney | this is the old resolver | |
| 09:36:12 | sean-k-mooney | and its waring about the new one right | |
| 09:37:36 | sean-k-mooney | https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17/log/job-output.txt#48455 | |
| 09:37:36 | rpittau | elod: thans for pointing to that change, maybe asking gmann could be worth it | |
| 09:37:53 | sean-k-mooney | interesting so it install the correct verion and here it upgrade beyond the correct version | |
| 09:38:27 | sean-k-mooney | well its the victoria version | |
| 09:40:41 | sean-k-mooney | hum i guess that is after devstack completed initally | |
| 09:41:13 | sean-k-mooney | elod: bauzas is grenade ment to be enabled in the first run? | |
| 09:41:43 | sean-k-mooney | it look like devstack finsihedn and then it imediatly started runnign grenade without any tempest test in between | |
| 09:45:09 | sean-k-mooney | elod: bauzas what happening is its doing a normal devstack install and then its upgrading ironic only and then running tempest | |
| 09:45:10 | elod | there should be a smoke test. at least in nova's grenade jobs there is | |
| 09:45:29 | sean-k-mooney | right that is what i expect | |
| 09:45:57 | sean-k-mooney | but for some reason this is going strait to the upgrade of ironic and does not upgrade other services and then runs tempest | |
| 09:46:28 | sean-k-mooney | so upgrading ironic pulls in the victoria verion of oslo.messaging which is incompatible with ussui of everything else | |
| 09:47:30 | sean-k-mooney | actully its upgrading ironic then tempest nou tnot the rest | |
| 09:55:21 | sean-k-mooney | elod: the smoke tests are disabled https://zuul.opendev.org/t/openstack/build/90de727c38d54f4b80f6998ff3b19c17/log/controller/logs/grenade_localrc.txt#16 | |
| 09:55:43 | sean-k-mooney | for both the pre and post upgrade | |
| 09:56:19 | sean-k-mooney | it does not look like UPGRADE_PROJECTS is correct https://github.com/openstack/grenade/blob/stable/ussuri/grenade.sh#L361-L365 | |