| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2023-04-24 | |||
| 15:43:44 | opendevreview | Balazs Gibizer proposed openstack/nova master: Revert "Temporary skip some volume detach test in nova-lvm job" https://review.opendev.org/c/openstack/nova/+/881389 | |
| 16:07:29 | bauzas | sean-k-mooney: dansmith: lemme get it right, so https://zuul.opendev.org/t/openstack/build/5f269ed5244d47be800dab988253c72c is failing because we bumped py to 3.9 and apache httpd complains ? https://review.opendev.org/c/openstack/nova/+/881339/3/.zuul.yaml#586 | |
| 16:07:52 | sean-k-mooney | yes | |
| 16:08:04 | sean-k-mooney | if we move tooz to an extra package | |
| 16:08:10 | sean-k-mooney | we can drop the bump to 3.9 | |
| 16:08:21 | sean-k-mooney | and that job should work since it does not have ironic | |
| 16:08:27 | sean-k-mooney | or barbican | |
| 16:08:38 | sean-k-mooney | so castalan and tooz wont be installed | |
| 16:09:10 | sean-k-mooney | or we can move the nova-ceph-multistore to 22.04 | |
| 16:09:20 | dansmith | I don't actually see the failure logged anywhere, other than keystone can't be imported | |
| 16:09:55 | bauzas | yeah me too, hence my question | |
| 16:10:05 | dansmith | oh I see that's the bump to 3.9 | |
| 16:10:09 | bauzas | this looks to me that keystone can't work with 3.9 | |
| 16:10:22 | dansmith | or uwsgi is using 3.8 more likely I think | |
| 16:10:30 | bauzas | because RegionOne isn't an UUID | |
| 16:10:38 | dansmith | it says importerror but doesn't actually show that it's not a valid module, so I'm not positive | |
| 16:10:51 | dansmith | either way, I feel like 3.9 on focal isn't really an option | |
| 16:10:53 | sean-k-mooney | dansmith: thats failing because uwsgi si installed under python 3.8.10 | |
| 16:10:58 | sean-k-mooney | Python version: 3.8.10 (default, Mar 13 2023, 10:26:41) [GCC 9.4.0] | |
| 16:11:10 | dansmith | sean-k-mooney: yup | |
| 16:11:22 | sean-k-mooney | whihc i think you said was a compile time dep | |
| 16:11:26 | sean-k-mooney | for uwsgi | |
| 16:11:30 | dansmith | no, I didn't say that | |
| 16:11:31 | bauzas | fwiw, the u-c bump to tooz==4.0.0 is still on hold | |
| 16:11:44 | bauzas | so we may ask for a cap | |
| 16:11:45 | dansmith | I said some of our packages we install from bindep to avoid compiling things like mysqlclient (AFAIK) | |
| 16:11:54 | sean-k-mooney | ah | |
| 16:12:06 | sean-k-mooney | ya sorry you did mention mysql | |
| 16:12:11 | sean-k-mooney | not uwsgi | |
| 16:12:16 | dansmith | I think the uwsgi python module *is* tied directly to the python version though | |
| 16:12:27 | dansmith | so we'd need a python3.9-uwsgi-module-python3 (or whatever the name is) | |
| 16:12:32 | sean-k-mooney | at least in the disto package i think that is correct | |
| 16:13:16 | dansmith | uwsgi-plugin-python3 | |
| 16:13:28 | dansmith | this ^ is compiled directly against the base python3, not 3.9 | |
| 16:14:46 | dansmith | see the last answer here: https://stackoverflow.com/questions/68413988/building-a-uwsgi-plugin-for-python-3-9-failed-for-older-version-it-works-are-th | |
| 16:14:55 | sean-k-mooney | for the devstack venv path i think you can override that with https://review.opendev.org/c/openstack/devstack/+/558930/26/files/apache-horizon.template | |
| 16:14:55 | dansmith | might be able to pip install uwsgi with the 3.9 python | |
| 16:15:08 | sean-k-mooney | WSGIPYTHONHOME | |
| 16:15:14 | dansmith | I' | |
| 16:15:17 | dansmith | I am pretty sure not | |
| 16:15:30 | dansmith | uwsgi runs the python interpreter internally, AFAIK | |
| 16:15:44 | dansmith | that's how it provides its phantom importable modules, etc | |
| 16:15:50 | sean-k-mooney | i know i was doing somethign to get it too work in that seriess | |
| 16:15:55 | sean-k-mooney | but i dotn recall | |
| 16:16:31 | sean-k-mooney | oh it was this https://review.opendev.org/c/openstack/devstack/+/558930/26/functions-common#1605 | |
| 16:16:38 | sean-k-mooney | anywya that wont really help here | |
| 16:16:54 | sean-k-mooney | for the ceph job we whould rever back to 3.8 i guess | |
| 16:17:05 | sean-k-mooney | if we are keeping it on focal | |
| 16:18:28 | sean-k-mooney | mixing the workaround to run with uwsgin for a venv and the ceph job is not helpful i tought there was a simple fix in that but no | |
| 16:19:17 | bauzas | stupid question but I guess we can't block a specific tooz version in our own requirements.txt file ? | |
| 16:19:45 | sean-k-mooney | we can but we are not ment too | |
| 16:19:53 | sean-k-mooney | we can do tooz!=whatever | |
| 16:20:08 | sean-k-mooney | that will cause use to downgrade if its already installed | |
| 16:20:12 | bauzas | and tooz<=version ? | |
| 16:20:22 | sean-k-mooney | we dont want to cap | |
| 16:20:24 | dansmith | right but we'll still install the initial version first, then downgrade it, | |
| 16:20:31 | sean-k-mooney | but we can block know broken ones | |
| 16:20:38 | dansmith | and if someone that runs after us has >=4.0 it will be re-re-installed | |
| 16:20:40 | dansmith | so that's not the best solution, IMHO | |
| 16:21:00 | bauzas | I was just trying to buy us some time :) | |
| 16:21:19 | dansmith | yeah, it might be a quick fix | |
| 16:31:18 | bauzas | fwiw https://review.opendev.org/c/openstack/requirements/+/881329 | |
| 16:31:27 | bauzas | feel free to vote (loudly) | |
| 16:34:24 | sean-k-mooney | dansmith: was the same done for castalan? for glance? | |
| 16:34:48 | sean-k-mooney | its currently castellan===4.1.0 | |
| 16:34:49 | dansmith | we just dropped the 38 jobs | |
| 16:34:53 | sean-k-mooney | ah ok | |
| 16:41:55 | bauzas | so, before I leave, https://review.opendev.org/c/openstack/requirements/+/881329 should unblock the gate | |
| 16:42:28 | bauzas | this will give us time, ideally to investigate the uwsgi 3.9 support | |
| 16:42:52 | bauzas | that being said, I'm OK with dropping 3.8 support for the functional tests | |
| 16:54:55 | sean-k-mooney | i thihnk we should just see if we can deploy devstack with ceph on 22.04 using cephadm | |
| 16:55:19 | sean-k-mooney | if we can we can swap the nova ceph jobs to that | |
| 16:55:37 | sean-k-mooney | i can push a DNM patch to test that but i proably wont have time to actully try it myself | |
| 16:57:00 | dansmith | there's a patch started already IIRC | |
| 16:59:11 | dansmith | ah that was an old DNM I was thinking about | |
| 21:59:11 | opendevreview | Lin Yang proposed openstack/os-traits master: CPU: add traits for new X86 feature "AMX" https://review.opendev.org/c/openstack/os-traits/+/868149 | |
| 22:18:12 | dansmith | um, neutron now requires >=3.9 as well? https://zuul.opendev.org/t/openstack/build/c7a96046411c4e05a669003bb67b299d | |
| 22:18:48 | dansmith | yup: https://review.opendev.org/c/openstack/neutron/+/881333 | |
| 22:19:22 | clarkb | looks like they did it in response to the tooz update | |
| 22:23:02 | opendevreview | Dan Smith proposed openstack/nova master: Stop ignoring missing compute nodes in claims https://review.opendev.org/c/openstack/nova/+/880633 | |
| 22:23:02 | opendevreview | Dan Smith proposed openstack/nova master: Remove silent failure to find a node on rebuild https://review.opendev.org/c/openstack/nova/+/880632 | |
| 22:23:03 | opendevreview | Dan Smith proposed openstack/nova master: Make focal job non-voting https://review.opendev.org/c/openstack/nova/+/881409 | |
| 22:23:10 | dansmith | clarkb: yeah, not sure if they were trying to help with that or not... | |
| 22:23:32 | dansmith | so I imagine that's going to take a while to undo, if at all, so this ^ marks that job as non-voting | |
| 22:24:15 | dansmith | I'm also not sure why we have that focal job, tbh | |
| 22:24:51 | dansmith | ah: https://review.opendev.org/c/openstack/nova/+/861111 | |
| 22:25:01 | dansmith | so I can probably just nuke it instead of making it n-v since it'll fail | |
| 22:27:01 | opendevreview | Dan Smith proposed openstack/nova master: Remove silent failure to find a node on rebuild https://review.opendev.org/c/openstack/nova/+/880632 | |
| 22:27:01 | opendevreview | Dan Smith proposed openstack/nova master: Remove focal job for 2023.2 https://review.opendev.org/c/openstack/nova/+/881409 | |
| 22:27:02 | opendevreview | Dan Smith proposed openstack/nova master: Stop ignoring missing compute nodes in claims https://review.opendev.org/c/openstack/nova/+/880633 | |
| 22:28:13 | dansmith | gmann: ^ | |
| 22:42:56 | dansmith | fml | |
| 22:42:56 | dansmith | oh right, the ceph jobs are focal still, which means we're blocked until neutron reverts that or we have to mark ceph jobs as n-v | |
| 23:07:55 | artom | dansmith, hey, just going to drop this here drive-by style: https://github.com/openstack/devstack-plugin-ceph/blob/master/devstack/plugin.sh#L5-L9 | |
| 23:08:18 | dansmith | artom: what about it? | |
| 23:08:21 | artom | Apparently this cephadm thing is the New Correct Way of installing ceph, essentially bypassing all the Ubuntu Ceph RPMs | |
| 23:08:50 | dansmith | yeah we know :) | |
| 23:09:01 | artom | I'll follow up with an email tomorrow, but that's what I got out of a chat with Giulio | |
| 23:09:36 | dansmith | last I checked (when we discussed at the recent ptg) it either didn't work correctly, or something about what we need for our regular jobs doesn't work with that mode | |
| 23:09:46 | dansmith | I don't know the details, but that's what we need to get worked out | |