| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-10-12 | |||
| 08:01:41 | bauzas | which will recreate the tox venv | |
| 08:01:56 | pslestang | ok trying | |
| 08:02:18 | bauzas | and you should also specify a target :) | |
| 08:02:28 | bauzas | -e py38 per say :) | |
| 08:03:15 | bauzas | also, running the whole testsuite is nice but... needs a lot of coffee to get answers :) | |
| 08:03:39 | bauzas | you should rather point tox to check only a few tests you know | |
| 08:03:40 | pslestang | running 'tox -r' it does not change anything | |
| 08:04:02 | bauzas | pslestang: paste the outputs please | |
| 08:04:17 | bauzas | so I can try to reproduce the exact command | |
| 08:06:27 | bauzas | mmm, maybe we have a regression in our CI, checking zuul | |
| 08:07:22 | bauzas | actually, no, all looks good https://zuul.openstack.org/builds?project=openstack/nova | |
| 08:09:41 | pslestang | which paste tool are you using, paste.openstack.org tells me that I send spam | |
| 08:13:27 | pslestang | bauzas: https://privatebin.net/?18300286850a2784#BxNwm4jkzNKC4gYbPiTS11uXJvLUuq6UVHxRAv7yYXyK | |
| 08:14:07 | bauzas | pslestang: you can force paste.o.o to accept your paste AFAICR | |
| 08:14:48 | bauzas | hah | |
| 08:14:49 | bauzas | error in suds-jurko setup command: use_2to3 is invalid. | |
| 08:15:12 | bauzas | that rings a bell to me :) | |
| 08:18:05 | bauzas | testing locally | |
| 08:18:40 | pslestang | ok thank you | |
| 08:19:15 | bauzas | pslestang: one quick thought could be that your nova local repo is a bit old and not getting the latest releases | |
| 08:19:58 | bauzas | pslestang: yeah, confirmed, I can run tox locally on py38 target without any problem | |
| 08:20:05 | pslestang | The repo is fresh from this morining | |
| 08:20:18 | bauzas | ? | |
| 08:20:31 | bauzas | I just did a git pull before I recreated the venv :) | |
| 08:21:03 | bauzas | pslestang: last commit on your nova git repo ? | |
| 08:21:21 | bauzas | mine is : | |
| 08:21:21 | pslestang | fdfdba265833d237e22676f9a223ab8ca0fe1e03 | |
| 08:21:22 | bauzas | commit fdfdba265833d237e22676f9a223ab8ca0fe1e03 (HEAD -> master, origin/master, origin/HEAD) | |
| 08:21:22 | bauzas | Merge: a8d3ab2513 ad227d7085 | |
| 08:21:22 | bauzas | Author: Zuul <zuul@review.opendev.org> | |
| 08:21:22 | bauzas | Date: Fri Oct 8 02:36:41 2021 +0000 | |
| 08:21:23 | bauzas | Merge "Update min supported service version for Yoga" | |
| 08:21:35 | pslestang | same here | |
| 08:22:07 | bauzas | pslestang: can you try to run tox on a local repo which is *not* devstack ? | |
| 08:22:20 | bauzas | git clone nova and shoot the tox runs | |
| 08:22:24 | pslestang | let me give a try | |
| 08:22:50 | bauzas | I'd suspect some pip cache | |
| 08:25:40 | pslestang | same result, I'm gonna try by cleaning pip cache it sounds like a good point | |
| 08:44:01 | frickler | pslestang: bauzas: https://bugs.launchpad.net/devstack/+bug/1946340 . we should mark that as FAQ somewhere | |
| 08:44:48 | frickler | the issue isn't seen in our CI because we use pre-built wheels | |
| 08:45:18 | frickler | if you do a local build without old pip cache, it will fail the same way | |
| 08:46:08 | pslestang | frickler: you're completely right | |
| 08:47:50 | bauzas | pslestang: yeah, eventually spotted the depency issue with devstack by reinstalling my testbed | |
| 08:47:50 | bauzas | dependency* even | |
| 08:51:17 | pslestang | I will try by pining the setuptools to 58.0.0 as proposed https://bugs.launchpad.net/devstack/+bug/1946340/comments/5 | |
| 08:57:19 | bauzas | ergh, network glitch here | |
| 09:06:42 | bauzas | frickler: fwiw, cinder installation on devstack failed due to this | |
| 09:07:00 | bauzas | I can't see any proper workaround | |
| 09:07:33 | sean-k-mooney[m] | for now you just remove oslo.vmware from cinders requirements file | |
| 09:07:47 | bauzas | frickler: pslestang: about documenting it, we already discussed about the 2_to_3 issues we got and the pinned setuptools and we said "well, this isn't a nova issue, so why should we create some relnotes for this ?" | |
| 09:07:59 | sean-k-mooney[m] | ill try and submit a fix to oslo.vmware to use suds-community shortly | |
| 09:08:15 | bauzas | sean-k-mooney: locally, you mean ? ok | |
| 09:08:19 | sean-k-mooney[m] | this is not a devstack bug | |
| 09:08:23 | sean-k-mooney[m] | yes locally | |
| 09:08:29 | sean-k-mooney[m] | i just commented it out | |
| 09:09:01 | sean-k-mooney[m] | but the issue is in oslo.vmware it depens on suds-jaroko or something like that | |
| 09:09:11 | sean-k-mooney[m] | suds-community is python 3 compatible | |
| 09:09:31 | sean-k-mooney[m] | so once we fix there requirements file you can skip the local workaround | |
| 09:09:42 | bauzas | yes | |
| 09:15:29 | frickler | bauzas: yes, local workaround is to remove oslo.vmware from cinder requirements | |
| 09:15:37 | bauzas | kk | |
| 09:16:18 | frickler | sean-k-mooney[m]: there is already one, it needs to be added to reqs first, though: https://review.opendev.org/c/openstack/oslo.vmware/+/813377 | |
| 09:17:14 | frickler | sean-k-mooney[m]: also, the most recent version of suds-community still hasn't fixed the 2to3 issue. but they provide wheels on pypi, which masks that issue | |
| 09:17:25 | sean-k-mooney[m] | ah ok good | |
| 09:17:48 | frickler | they need a new tag with this one https://github.com/suds-community/suds/pull/58 | |
| 09:21:10 | frickler | ah, that'll be a major version bump, so the test release is suds-community-1.0.0b1 | |
| 09:21:50 | frickler | which I can install locally from source just fine, so that looks like progress | |
| 09:27:02 | mdbooth | dansmith: Liking DEVSTACK_PARALLEL: Speedup: 1.2226 :) | |
| 09:27:34 | sean-k-mooney[m] | it works pretty well | |
| 09:28:28 | mdbooth | It had a smaller benefit in a GCE vm, but this one on PSI seems to like it | |
| 09:28:53 | sean-k-mooney[m] | are you using the ci flavors or normal ones | |
| 09:29:01 | mdbooth | normal | |
| 09:29:08 | sean-k-mooney[m] | the normal ones are all backed by ceph and have lower iops | |
| 09:29:20 | sean-k-mooney[m] | so ya it helps more there | |
| 09:29:33 | sean-k-mooney[m] | the ci ones have local nvme storage and it benifits less | |
| 09:30:34 | sean-k-mooney[m] | the more io overhead there is the more parrallel helps | |
| 10:15:52 | opendevreview | Balazs Gibizer proposed openstack/nova master: Add a WA flag waiting for vif-plugged event during reboot https://review.opendev.org/c/openstack/nova/+/813419 | |
| 10:29:48 | sean-k-mooney | hum now that is interesting. | |
| 10:30:05 | sean-k-mooney | did people know that if you hit b in gerrit it loads git blam on the side | |
| 10:30:10 | sean-k-mooney | *blame | |
| 10:32:40 | gibi | that sounds usefull | |
| 13:29:07 | dansmith | mdbooth: sweet, I have a bunch of other parallel points to add, but I need to circle back and finish them | |
| 13:39:01 | opendevreview | norman shen proposed openstack/nova master: Recreate mdev devices according to placement https://review.opendev.org/c/openstack/nova/+/810220 | |
| 14:21:38 | bauzas | but I'll back around 1515UTC (45 mins before the meeting) | |
| 14:23:56 | gibi | kashyap: I read the driver part of https://review.opendev.org/c/openstack/nova/+/762330 and left comments. (I still not read the test parts). I don't feel this commit is ready. If feel this is patched together in a rush. | |
| 14:25:17 | opendevreview | Alexey Stupnikov proposed openstack/nova master: Rollback problematic port bindings on source host only https://review.opendev.org/c/openstack/nova/+/813659 | |
| 14:25:33 | pslestang | sean-k-mooney: FYI it seems like there is already someone patching oslo.vmware to use suds-community instead of suds-jurko https://review.opendev.org/c/openstack/oslo.vmware/+/813377 | |
| 14:25:45 | sean-k-mooney | yes | |
| 14:26:18 | sean-k-mooney | pslestang: frickler mentioned that above | |
| 14:27:11 | pslestang | sean-k-mooney: ouup's I missed it | |
| 14:31:59 | kashyap | gibi: Hi, I'll look and investigate. The submitter told me they even tested it in a real deployment (I took their word) | |
| 14:32:39 | gibi | kashyap: I can accept that it works but for me it is really hard to follow. maybe other in the core team has more knowledge to figure out what happens. | |
| 14:32:40 | kashyap | gibi: Thanks for the review time! We definitely don't want this rushed in. And needs careful integration testing. As it impacts live migration | |
| 14:33:03 | kashyap | gibi: No, if it's hard to follow for you, that's a reason enough to clean it up. And also it needs code comments too | |
| 14:33:04 | gibi | so I'm more concerned about understandabilty now than correctness | |
| 14:33:15 | gibi | ahh, ok | |
| 14:33:30 | kashyap | Yeah; I agree this needs more explnaations | |
| 14:40:27 | gibi | lyarwood: I looked into https://bugs.launchpad.net/nova/+bug/1946339 in short I don't see what happens and I cannot reproduce it locally while it is happening on the gate frequently. I'm a bit stuck | |
| 14:46:07 | sean-k-mooney | gibi: lyarwood is hopfule preparing for an operation later today and will be recovering for the next ~2 weeks | |
| 14:47:05 | gibi | sean-k-mooney: ack, I know. I just wanted to get back to him. (I update the bug with my finding) | |