| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-08-04 | |||
| 08:09:47 | openstackgerrit | Xinran WANG proposed openstack/os-resource-classes master: Add new resource class for QAT card. https://review.opendev.org/726314 | |
| 09:38:28 | lyarwood | gibi: https://review.opendev.org/#/c/744506/ - morning, when you have time this should fix the lower-constraints job on master at least for now | |
| 09:39:37 | lyarwood | https://zuul.opendev.org/t/openstack/builds?job_name=openstack-tox-lower-constraints&project=openstack%2Fnova for context | |
| 10:03:14 | elod | lyarwood: it seems every job have some *constraint related issue now (but some are not visible as does not cause failure), see discussion from infra channel yesterday: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2020-08-03.log.html#t2020-08-03T16:22:05 | |
| 10:03:54 | elod | lyarwood: the interesting thing is that I cannot reproduce that locally :/ | |
| 10:13:11 | lyarwood | elod: ack thanks | |
| 10:13:29 | lyarwood | elod: I was eventually able to reproduce the master issue yesterday on a 18.04 vm but yeah it wasn't easy at all | |
| 10:15:04 | elod | elod: oh, sounds good! \o/ | |
| 10:15:12 | elod | lyarwood: ^^^ :] | |
| 10:16:12 | elod | lyarwood: also there's a new release of pip, there's an interesting change: "Correctly find already-installed distributions with dot (.) in the name and uninstall them when needed. " ( https://pip.pypa.io/en/stable/news/#id1 ) | |
| 10:16:41 | elod | especially as the failure came when already installed packages were reinstalled (without constraints) | |
| 10:26:10 | lyarwood | elod: ah that is interesting | |
| 10:35:34 | elod | lyarwood: well, it seems something changed, but I still see the issue in zuul jobs :S | |
| 10:36:45 | elod | lyarwood: do you have somewhere the steps, how the failure can be reproduced locally? | |
| 10:40:20 | lyarwood | elod: I didn't write them down sorry, I just built an env using virt-builder and installed tox directly from pypy instead of packages | |
| 10:40:38 | lyarwood | elod: iirc I had to bump MarkupSafe to workaround another issue | |
| 10:49:07 | elod | lyarwood: ok, no problem. actually I did the same, installed latest pip and tox from pypi. worth to mention that once it worked for me as in zuul, but then I couldn't reproduce it again with the steps I thought it should be reproducable :S | |
| 11:03:43 | gibi | devfaz: thanks | |
| 11:05:55 | sean-k-mooney | gibi: stephenfin alex_xu could ye take a lok at https://review.opendev.org/#/c/739131/ im trying to move on to numa in placment work so if i can close that out it would make me happy | |
| 11:06:06 | gibi | lyarwood: thanks. I've approved https://review.opendev.org/#/c/744506/ | |
| 11:07:01 | sean-k-mooney | that said gibi i just booted my sriov servers so ill be deploying your sriov detach patches while i rebase some os-vif patches. ill let you know what i find in my testing | |
| 11:08:26 | gibi | sean-k-mooney: thanks a lot for those tests | |
| 11:08:34 | gibi | sean-k-mooney: I'm looking at https://review.opendev.org/#/c/739131/ now | |
| 11:32:32 | openstackgerrit | Harshavardhan Metla proposed openstack/nova stable/rocky: [stable-only] Moved the quoted section https://review.opendev.org/744681 | |
| 11:50:52 | gibi | sean-k-mooney: I have left comments in https://review.opendev.org/#/c/744506/ | |
| 11:53:33 | sean-k-mooney | gibi: did you? that is the lower constrits fix :) | |
| 11:54:02 | sean-k-mooney | you mean https://review.opendev.org/#/c/739131 | |
| 12:02:36 | gibi | I've mixed up the links | |
| 12:02:52 | gibi | I did left some review on lookup nic patch https://review.opendev.org/#/c/739131/ | |
| 12:03:11 | sean-k-mooney | yep reading them now | |
| 12:13:34 | openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP zuul: Migrate to zuulv3 and break up the nova-live-migration job https://review.opendev.org/711604 | |
| 12:30:50 | sean-k-mooney | gibi: thanks i have responded to the comments ill quickly adress the comparison change since i just forgot to fully revert that and ill re layout the types traits | |
| 12:31:47 | sean-k-mooney | gibi: over all i did not see any functional changes requested so i think the patch is still fucntionally correct as is and the change are jsut style related for the most part right? | |
| 12:48:07 | openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP zuul: Migrate to zuulv3 and break up the nova-live-migration job https://review.opendev.org/711604 | |
| 12:55:03 | openstackgerrit | Merged openstack/nova stable/stein: objects: Update keypairs when saving an instance https://review.opendev.org/743264 | |
| 12:56:28 | gibi | sean-k-mooney: I'm on a call I will get back to you in an hour | |
| 12:56:39 | sean-k-mooney | gibi: no rush | |
| 12:56:53 | sean-k-mooney | i should have your comments adress by then :) | |
| 12:58:03 | openstackgerrit | sean mooney proposed openstack/nova stable/train: Silence amqp heartbeat warning https://review.opendev.org/728057 | |
| 13:04:18 | lyarwood | does anyone know if there's a way of reproducing zuul jobs locally? | |
| 13:04:23 | lyarwood | ./me is pretty sure there isn't | |
| 13:08:08 | lyarwood | sean-k-mooney: ^ any ideas? | |
| 13:09:21 | artom | lyarwood, IIRC I asked in #infra a while ago - "no" was the answer | |
| 13:11:15 | lyarwood | artom: yup thanks, I'll keep spamming small changes then | |
| 13:11:38 | sean-k-mooney | lyarwood: not really you can technically just run the playbooks locally | |
| 13:11:59 | lyarwood | sean-k-mooney: yeah it's more the job definitions that I need to test at this point | |
| 13:12:03 | sean-k-mooney | lyarwood: but the issue is creating the inventory file and runing them is non trivial | |
| 13:12:15 | lyarwood | sean-k-mooney: just feels wrong spamming zuul | |
| 13:12:33 | artom | lyarwood, why small changes? | |
| 13:12:45 | sean-k-mooney | lyarwood: for what its worth its not that hard to deploy a zuul instance using docker-compose | |
| 13:12:57 | sean-k-mooney | but mimicing the upstream enve is still a little more inovled | |
| 13:13:35 | sean-k-mooney | lyarwood: i assume you are doint what i do and disablig all the other jobs when your deveolping one | |
| 13:13:44 | lyarwood | sean-k-mooney: yup | |
| 13:13:54 | sean-k-mooney | lyarwood: also if you want to make it go faster you can cheat and use the experimental pipeline | |
| 13:14:10 | sean-k-mooney | in which case you also need to disbale the experimental josb other then your own | |
| 13:14:55 | sean-k-mooney | lyarwood: zuul will also do basic syntax checking too so if youy have a typo in the yaml file it will somethime cacht that before runnign your job | |
| 13:17:17 | openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP zuul: Migrate to zuulv3 and break up the nova-live-migration job https://review.opendev.org/711604 | |
| 13:17:17 | lyarwood | sean-k-mooney: yup cool | |
| 13:17:48 | lyarwood | artom: well incremental changes then as I'm slowly working out how to covert the jobs | |
| 13:18:08 | lyarwood | something I'd normally do locally but have to do in the open thanks to zuul now :| | |
| 13:18:51 | artom | lyarwood, tbh, I don't think anyone will look, unless they understand it's a WIP and want to check in/help | |
| 13:18:55 | artom | Aka no shame | |
| 13:19:33 | sean-k-mooney | artom: i think lyarwood just did not want to waste gate resouces | |
| 13:20:02 | artom | sean-k-mooney, ah, yeah. Well, what are you gonna do | |
| 13:20:59 | sean-k-mooney | disable all jobs you are not updatinging and ask stephenfin to run unit test locally :P | |
| 13:21:36 | sean-k-mooney | you can replicate the gate as i said but its a lot of setup if you dont do this regularly | |
| 13:22:22 | sean-k-mooney | that is true | |
| 13:22:56 | openstackgerrit | Stephen Finucane proposed openstack/nova master: doc: Update references to image properties https://review.opendev.org/744198 | |
| 13:22:57 | openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: Drop support for Xen https://review.opendev.org/743231 | |
| 13:22:57 | openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: Drop support for UML https://review.opendev.org/743230 | |
| 13:22:58 | openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: Remove 'hypervisor_version' from 'libvirt_info' https://review.opendev.org/744199 | |
| 13:23:53 | sean-k-mooney | stephenfin: https://www.sciencealert.com/images/How-Much-Are-We-Worth-V2-large.jpg | |
| 13:24:22 | sean-k-mooney | thats even before you take into account your value as a software engineer or a good person | |
| 13:24:31 | sean-k-mooney | machines are cheap in comparison :P | |
| 13:24:38 | kashyap | sean-k-mooney: Heh; I never realized the 0.2mg of gold even | |
| 13:29:47 | artom | "It would take 40,000 people to get enough gold for one uk sovereign coin" | |
| 13:29:55 | artom | Challenge accepted! | |
| 13:49:23 | stephenfin | artom the terrible | |
| 13:49:41 | artom | Great Uncle Ivan would be proud | |
| 14:29:46 | ralonsoh | hello folks | |
| 14:29:55 | ralonsoh | we are hitting in the Neutron CI | |
| 14:30:02 | ralonsoh | a problem with grenade jobs | |
| 14:30:07 | ralonsoh | https://026716e2072b41f3360b-f5b932bfaec6245f8b3ddc87df48d7a4.ssl.cf2.rackcdn.com/640258/23/check/neutron-grenade-multinode/bcc8e1e/controller/logs/grenade.sh_log.txt | |
| 14:30:14 | ralonsoh | just an example | |
| 14:31:02 | ralonsoh | when retrieving the RP for VCPU | |
| 14:31:03 | ralonsoh | openstack resource provider list -f value | head -n1 | cut -d ' ' -f 1 | |
| 14:31:08 | ralonsoh | that returns nothing | |
| 14:37:22 | ralonsoh | stephenfin, hi ^^ | |
| 14:38:33 | gibi | ralonsoh: placement log stars at 13:43 and the failed query starts at 2020-08-04 13:42:39.140 | |
| 14:39:13 | gibi | sorry, never mind | |
| 14:39:32 | gibi | the placement log ends at https://www.sciencealert.com/images/How-Much-Are-We-Worth-V2-large.jpg | |
| 14:39:40 | gibi | bah | |
| 14:39:58 | gibi | so the placement log ends 13:43 so it should have some clue in it | |
| 14:40:14 | ralonsoh | https://026716e2072b41f3360b-f5b932bfaec6245f8b3ddc87df48d7a4.ssl.cf2.rackcdn.com/640258/23/check/neutron-grenade-multinode/bcc8e1e/controller/logs/screen-placement-api.txt | |
| 14:40:14 | ralonsoh | gibi, ok I took a look at the placement logs | |
| 14:40:33 | ralonsoh | I don't know why is failing | |
| 14:40:51 | ralonsoh | keystoneauth1.exceptions.catalog.EndpointNotFound: internal endpoint for identity service not found | |
| 14:44:24 | gibi | the config looks similar before and after the placement restart based on the log | |
| 14:52:54 | gibi | keystone log seems normal around that time | |
| 14:53:11 | ralonsoh | yes, I don't see any error there | |