| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2024-06-18 | |||
| 10:10:38 | sean-k-mooney | ubuntu should be in a good place but c9s is still using a venv | |
| 10:10:46 | sean-k-mooney | so we need to fix that this cycle | |
| 10:10:58 | sean-k-mooney | *still not useing a venv | |
| 10:11:20 | sean-k-mooney | i have not chekced if c10s has blocked "sudo pip install" or not | |
| 10:11:58 | sean-k-mooney | but thats the direction most distor seam to be going so i would not be surpprised if they have, although fedora has not yet so im unsure | |
| 11:45:36 | opendevreview | Fabian Wiesel proposed openstack/nova-specs master: Lazy Metadata Loading in order to Reduce Server Load https://review.opendev.org/c/openstack/nova-specs/+/922201 | |
| 12:16:39 | opendevreview | Fabian Wiesel proposed openstack/nova-specs master: Lazy Metadata Loading in order to Reduce Server Load https://review.opendev.org/c/openstack/nova-specs/+/922201 | |
| 12:35:28 | opendevreview | Fabian Wiesel proposed openstack/nova-specs master: Lazy Metadata Loading in order to Reduce Server Load https://review.opendev.org/c/openstack/nova-specs/+/922201 | |
| 12:55:14 | opendevreview | Fabian Wiesel proposed openstack/nova-specs master: Lazy Metadata Loading in order to Reduce Server Load https://review.opendev.org/c/openstack/nova-specs/+/922201 | |
| 13:15:19 | bauzas | frickler: sean-k-mooney: fwiw, I got some distutils issue when stacking on noble https://zuul.opendev.org/t/openstack/build/9c2329f04a5344b4bbc9661e2360d282/log/job-output.txt#8152-8160 | |
| 13:16:27 | bauzas | thanks py3.12 | |
| 13:17:47 | sean-k-mooney | well distutils was remvoed | |
| 13:17:54 | sean-k-mooney | it wsa deprected for quite a while | |
| 13:18:10 | bauzas | I know | |
| 13:18:23 | bauzas | deprecated in 3.10 | |
| 13:18:26 | sean-k-mooney | so this seams to be a limitaiton in the requirement repo that should be updated | |
| 13:18:29 | bauzas | with a removal on 3.12 | |
| 13:18:37 | sean-k-mooney | its not an issue in openstack istslef | |
| 13:18:41 | bauzas | (which is *again* a short time) | |
| 13:18:52 | sean-k-mooney | 2 years is not short | |
| 13:19:01 | bauzas | for a language ? | |
| 13:19:06 | sean-k-mooney | correct | |
| 13:19:10 | bauzas | you're kidding? | |
| 13:19:13 | sean-k-mooney | i think your postion on that is unreasonable | |
| 13:19:21 | sean-k-mooney | but i dont want to get into that now | |
| 13:19:31 | bauzas | ask the operators what their positions are on something like 2 years | |
| 13:20:12 | bauzas | anyway, ship has sailed | |
| 13:20:22 | frickler | ah, nice, I noticed earlier today that also the use of pkg_resources in reqs repo needs replacing | |
| 13:20:22 | bauzas | and I agree, this is a requirements repo | |
| 13:20:29 | sean-k-mooney | its the cadance we do downtream major releease on and that lts distos often release on | |
| 13:21:05 | sean-k-mooney | also i belive as of 3.11 python are not giving 3 release or 3 years for removals | |
| 13:21:07 | frickler | also seems that there is no unit testing for edit-constraints. more fun | |
| 13:21:28 | sean-k-mooney | frickler: i would expect it to be used in all the tox gets for the cross gating | |
| 13:21:51 | sean-k-mooney | frickler:but probaly nothing direcltly testing it | |
| 13:22:12 | frickler | yes, the cross tests all run the latest support python, which is 3.11 | |
| 13:22:23 | sean-k-mooney | frickler: since this was not seen on the debinian pyevn tests im guessign it was falling back to the dist utils module form the default versio | |
| 13:23:08 | frickler | sean-k-mooney: iiuc the error is seen in devstack only, that didn't run on py312 yet | |
| 13:23:13 | bauzas | frickler: want me to report a bug against requirements ? | |
| 13:23:53 | sean-k-mooney | maybe we dont do the requriemts edit for tox because we are installing the package explcity | |
| 13:25:00 | sean-k-mooney | bauzas: can you try installing "sudo apt-get install python3-distutils" | |
| 13:25:16 | sean-k-mooney | bauzas: it might still be shipped but not instlled by default on 24.04 | |
| 13:25:21 | frickler | bauzas: I won't advise you to use storyboard and I very rarely look at it, but feel free to do so https://storyboard.openstack.org/#!/project/openstack/requirements | |
| 13:25:25 | bauzas | I don't have a box | |
| 13:25:31 | bauzas | I only use CI resources | |
| 13:25:47 | bauzas | but I can spin some noble instance (provided I can on our internal lab) | |
| 13:25:48 | frickler | I have a noble test node running, let me check that | |
| 13:26:00 | sean-k-mooney | oh ok thats fine ill see if the package exist and push a quick patch to devstack to add it | |
| 13:26:20 | bauzas | distutils is continued to be shipped thru setuptools | |
| 13:26:59 | bauzas | https://docs.python.org/3.12/whatsnew/3.12.html#distutils | |
| 13:27:10 | bauzas | so I see a workaround here | |
| 13:27:23 | sean-k-mooney | ok ya for the short term | |
| 13:27:50 | sean-k-mooney | ubuntu dropped the seperate pacakage in 23.10 | |
| 13:28:25 | sean-k-mooney | funny that https://packages.ubuntu.com/noble/python3-distutils-extra is still a thing | |
| 13:28:38 | sean-k-mooney | that pulls in setuptools to provide the core supprot | |
| 13:28:59 | bauzas | that's call "washing our hands" | |
| 13:29:03 | bauzas | called* | |
| 13:29:18 | sean-k-mooney | how, we are still going to need to fix requireemtns | |
| 13:29:25 | sean-k-mooney | this is just a short term workaround | |
| 13:29:27 | frickler | hmm, I don't get the failure on my noble node. and I didn't even run devstack there | |
| 13:29:40 | sean-k-mooney | do you have setuptools | |
| 13:29:52 | frickler | but it does have python3-dev installed, which pulled a lot of deps | |
| 13:30:04 | frickler | yes, python3-setuptools is one of them | |
| 13:30:17 | sean-k-mooney | ya so thats what provides it | |
| 13:30:35 | sean-k-mooney | we are surly installing python3-dev in devstack however | |
| 13:30:40 | bauzas | https://zuul.opendev.org/t/openstack/build/9c2329f04a5344b4bbc9661e2360d282/log/job-output.txt#8152-8160 | |
| 13:30:40 | sean-k-mooney | i wonder is the a venv thing | |
| 13:30:50 | bauzas | I can try to look at the installed packages | |
| 13:30:54 | sean-k-mooney | we dont allow site packages | |
| 13:31:09 | sean-k-mooney | so we might need to explcitly install setuptools form pip in the venv | |
| 13:31:12 | bauzas | https://0dcb2cbd4fa467880edd-6556216e0c08650db1b5109918fbb7f6.ssl.cf2.rackcdn.com/922140/4/experimental/nova-mtty/9c2329f/controller/logs/dpkg-l.txt | |
| 13:31:42 | sean-k-mooney | i dont think python -m venv isntalls setup tools by default and we used to clamp it partly becasue of our use of pbr and clamping pip version in the past | |
| 13:31:58 | sean-k-mooney | my guess is if setuptools is in the venv its too old to provide it | |
| 13:32:30 | opendevreview | Elod Illes proposed openstack/nova master: [CI] Replace deprecated regex https://review.opendev.org/c/openstack/nova/+/922212 | |
| 13:32:30 | opendevreview | Elod Illes proposed openstack/nova master: DNM: test zuul job regex https://review.opendev.org/c/openstack/nova/+/922213 | |
| 13:32:31 | opendevreview | Elod Illes proposed openstack/nova master: DNM: test zuul job regex #2 https://review.opendev.org/c/openstack/nova/+/922214 | |
| 13:32:31 | opendevreview | Elod Illes proposed openstack/nova master: DNM: test zuul job regex #3 https://review.opendev.org/c/openstack/nova/+/922215 | |
| 13:32:50 | sean-k-mooney | ah | |
| 13:32:52 | sean-k-mooney | https://docs.python.org/3.12/whatsnew/3.12.html#ensurepip | |
| 13:32:58 | sean-k-mooney | easy_install, pkg_resources, setuptools and distutils are no longer provided by default in environments created with venv or bootstrapped with ensurepip, since they are part of the setuptools package. For projects relying on these at runtime, the setuptools project should be declared as a dependency and installed separately (typically, using pip). | |
| 13:33:24 | sean-k-mooney | so ya we need to expictly include setuptools in the venv | |
| 13:44:07 | bauzas | sean-k-mooney: frickler: python3-setuptools was installed thru a apt dependency https://0dcb2cbd4fa467880edd-6556216e0c08650db1b5109918fbb7f6.ssl.cf2.rackcdn.com/922140/4/experimental/nova-mtty/9c2329f/controller/logs/devstacklog.txt | |
| 13:46:22 | sean-k-mooney | bauzas: yes but you missed the part i said above about the venv | |
| 13:46:29 | opendevreview | Fabian Wiesel proposed openstack/nova-specs master: Lazy Metadata Loading in order to Reduce Server Load https://review.opendev.org/c/openstack/nova-specs/+/922201 | |
| 13:46:38 | sean-k-mooney | bauzas: we install devstack in a venv without accss to site packages | |
| 13:46:56 | sean-k-mooney | so the setup tools package need to installed form pip in that venv | |
| 13:55:23 | bauzas | sorry, got a fucking IRC blip due my LTE connection | |
| 13:55:39 | sean-k-mooney | no worries | |
| 13:55:49 | bauzas | sean-k-mooney: I just said I thought we were installing devstack in a venv if and only if GLOBAL_VENV was set | |
| 13:55:58 | bauzas | which is not the case with that job | |
| 13:56:13 | sean-k-mooney | bauzas: its the default | |
| 13:56:29 | bauzas | oh, a venv per project then | |
| 13:56:33 | sean-k-mooney | and not installing in a venv is effectilvy deprecated | |
| 13:56:39 | bauzas | compared to a larger global vencv | |
| 13:56:44 | sean-k-mooney | no the venv per project is even more deprecated | |
| 13:56:51 | bauzas | with shared venv for all projects | |
| 13:57:03 | bauzas | hum, I'm lost | |
| 13:57:14 | bauzas | what's the difference between GLOBAL_VENV=True and False? | |
| 13:57:34 | sean-k-mooney | GLOBAL_VENV=True uses a single venv for all project | |
| 13:57:46 | frickler | we are using a dedicated venv in this case /opt/stack/requirements/.venv/bin/edit-constraints | |
| 13:57:51 | sean-k-mooney | GLOBAL_VENV=false does a site wide install | |