Earlier  
Posted Nick Remark
#openstack-nova - 2024-07-04
09:01:40 gibi amorin: I think by https://github.com/openstack/nova/commit/232684b44022f1bc4d72b07045900780de456e63
09:01:49 gibi it shoud not happen any more
09:02:02 bauzas this is indeed an expected behaviour
09:11:35 amorin perfect!
09:12:08 amorin will try cherry-picking that to my antelope openstack then
09:12:21 amorin but wait, it should be there
09:15:44 amorin the exeption raised is the following: exceptions.NotSupported
09:16:17 amorin which is not in the first except block, so it's conesidered as a fatal one
09:16:47 amorin my service is stop and returning http 503
09:26:17 gibi amorin: do you have placement in openstack endpoint list?
09:32:55 frickler amorin: that sounds like the keystone lib might be mishandling that error
09:35:12 amorin yes gibi, it's all set correctly, as soon as I start placement, everything works fine :)
09:37:01 frickler frickler: can you try to run something like "openstack --debug resource provider list" while placement is down and show the output on paste.opendev.org? (and possibly let's move this to #openstack-sdks)
09:37:09 frickler ehm amorin ^^
09:51:05 sean-k-mooney amorin: this is a similar but slightly diffent issue
09:51:43 sean-k-mooney the orginal fix was to allow it to start when there was a keyston outaage not placment actully down
09:51:58 sean-k-mooney i think we have a diffent patch to make loading the placement client lazy
09:52:15 sean-k-mooney so that provided you dont make an api call that need it to talk to palcment it wont try
09:52:38 sean-k-mooney we worked on that for the schduler too but i dont recall whicih serviecs got that change and whihc did not
09:53:36 sean-k-mooney https://review.opendev.org/c/openstack/nova/+/878238 that was the scheduler change
09:56:20 sean-k-mooney i guess it thet same apprch https://github.com/openstack/nova/commit/232684b44022f1bc4d72b07045900780de456e63 make the report clint a property and lazy loads it too
09:58:28 sean-k-mooney my guess is that a "503 Service Unavailable" responce does not count as ConnectionFailure and we just need to add that to the first expection block to cover your edgecase
10:10:53 frickler seems there is another different set of error classes for that, like in this case keystoneauth1.exceptions.http.ServiceUnavailable
10:15:01 sean-k-mooney ya so we just need to add them
10:15:23 sean-k-mooney with that said nova does expect placment ot be aviabel when wee start up we just added this lazy loading to make it more graceful
10:16:05 sean-k-mooney if placement is down for a protacted period of tiem we want to allow you to manage things that dont require interaction with placement but obvioulsy you wont be abel to boot new vms, evaucate them or move them in any way
10:16:36 sean-k-mooney start/stop/snapshot/attache port ectra is ok
10:17:02 sean-k-mooney but we would consdier the openstack to be in a degreated state and expect some operations ot fail
10:20:52 opendevreview Stephen Finucane proposed openstack/placement master: tox: Simplify functional testenv definitions https://review.opendev.org/c/openstack/placement/+/919578
10:20:53 opendevreview Stephen Finucane proposed openstack/placement master: pre-commit: Add sphinx-lint https://review.opendev.org/c/openstack/placement/+/919580
10:20:53 opendevreview Stephen Finucane proposed openstack/placement master: Integrate pre-commit https://review.opendev.org/c/openstack/placement/+/919579
10:20:54 opendevreview Stephen Finucane proposed openstack/placement master: Fix typos https://review.opendev.org/c/openstack/placement/+/923491
10:20:54 opendevreview Stephen Finucane proposed openstack/placement master: pre-commit: Add autopep8 https://review.opendev.org/c/openstack/placement/+/923490
11:37:25 sean-k-mooney sigh.... https://github.com/al45tair/netifaces netifaces is not buildable on debian testin on python 3.12... we need to drop that depency form nova
11:37:33 sean-k-mooney it works on 3.11
11:42:24 opendevreview sean mooney proposed openstack/nova master: port format insepctor tests from glance https://review.opendev.org/c/openstack/nova/+/923504
11:42:55 opendevreview sean mooney proposed openstack/nova master: port format inspector tests from glance https://review.opendev.org/c/openstack/nova/+/923504
11:52:10 frickler hmm, seems at least canonical managed to make it work https://launchpad.net/ubuntu/+source/netifaces
11:52:50 sean-k-mooney it works on 3.11 but it raise an error where it say "you must add supprot for your plathform"
11:52:58 sean-k-mooney ill get the exact message in a sec
11:53:07 sean-k-mooney it might be because im using debian testing
11:53:18 sean-k-mooney but the project is archivbed and not maintaned anymore
11:53:25 sean-k-mooney so we need to replace it anyway
11:54:00 sean-k-mooney i dont thnk nova really should have thsi dep anymore anyway it was mainly for nova-net before and os-vif on windows i think
11:54:07 frickler ack. I'm just wondering why the py312 tests don't seem to notice it
11:54:09 sean-k-mooney so we can likely jsut remove the code that is using it
11:55:54 sean-k-mooney https://paste.opendev.org/show/bzSoczPxEGhAlGJPfcCc/
11:56:03 sean-k-mooney thats what im seeing on 3.12
11:56:13 opendevreview sean mooney proposed openstack/nova master: port format inspector tests from glance https://review.opendev.org/c/openstack/nova/+/923504
11:57:51 sean-k-mooney ok this is what is firing https://github.com/al45tair/netifaces/blob/master/netifaces.c#L206-L211
11:59:22 frickler hmm, can you check why pip is wanting to build the wheel, are you on arm? on noble I just get "Using cached netifaces-0.11.0-cp312-cp312-linux_x86_64.whl"
11:59:49 sean-k-mooney debian testing on x86
12:00:29 sean-k-mooney x86_64 to be precise
12:00:45 sean-k-mooney how would i check that
12:01:01 frickler good question, add some "-v"'s?
12:01:16 sean-k-mooney sure i can add some to tox
12:01:29 sean-k-mooney well the install line in tox.ini
12:02:49 sean-k-mooney https://paste.opendev.org/show/bbCcX0QUpd3RdqD5jUTt/
12:05:06 sean-k-mooney i think all that is wrong is i dont have the required bindep or dev libs installed to allow it to build
12:05:18 sean-k-mooney im not sure why it not finding the prebuilt wheel
12:05:29 sean-k-mooney given it is using weels for most of the other deps
12:07:36 sean-k-mooney https://etherpad.opendev.org/p/netifaces-py312
12:07:40 sean-k-mooney thats the full output
12:08:54 sean-k-mooney it might be somethign to do with the version of pip or settuptools and pyproject.toml or something like that
12:09:38 sean-k-mooney it looks like its beign pull in by oslo.utils and barbican-client
12:13:00 sean-k-mooney anyway that a problem for another day im going to go back to fixing iso supprot which means we need 2 new format detectors, for http://wiki.osdev.org/ISO_9660 and http://wiki.osdev.org/UDF although one is an exteion of the other
12:15:24 frickler fwiw I can also build from source on noble without issues (after running devstack, so that may have installed some necessary deps)
12:15:59 sean-k-mooney yep proably
12:16:09 sean-k-mooney if i was using one of my dev vms it would be fine i suspect
12:16:34 sean-k-mooney ill likel move to one of the shortly as eventrually ill need to do some testing with devstack too
12:19:03 frickler bauzas: Uggla: auniyal: please check https://review.opendev.org/c/openstack/releases/+/923118 which is due today
12:57:40 opendevreview sean mooney proposed openstack/nova master: repoduce iso regression with deep format inspection https://review.opendev.org/c/openstack/nova/+/923507
13:31:45 sahid o/
13:31:54 sahid any chance that you re-approve https://review.opendev.org/c/openstack/nova/+/921665
13:32:01 sahid i had to rebase
14:14:15 sean-k-mooney done
14:43:25 opendevreview Bence Romsics proposed openstack/os-vif master: Do not add taps in trunk bridges to the dead vlan https://review.opendev.org/c/openstack/os-vif/+/923036
15:22:09 opendevreview Balazs Gibizer proposed openstack/nova stable/2024.1: Reject qcow files with data-file attributes https://review.opendev.org/c/openstack/nova/+/923273
15:22:10 opendevreview Balazs Gibizer proposed openstack/nova stable/2024.1: Check images with format_inspector for safety https://review.opendev.org/c/openstack/nova/+/923274
15:22:11 opendevreview Balazs Gibizer proposed openstack/nova stable/2024.1: Additional qemu safety checking on base images https://review.opendev.org/c/openstack/nova/+/923275
15:22:12 opendevreview Balazs Gibizer proposed openstack/nova stable/2024.1: Fix vmdk_allowed_types checking https://review.opendev.org/c/openstack/nova/+/923276
15:32:24 opendevreview Merged openstack/nova master: Fix vmdk_allowed_types checking https://review.opendev.org/c/openstack/nova/+/923258
15:33:19 opendevreview Balazs Gibizer proposed openstack/nova stable/2023.2: Reject qcow files with data-file attributes https://review.opendev.org/c/openstack/nova/+/923284
15:33:20 opendevreview Balazs Gibizer proposed openstack/nova stable/2023.2: Check images with format_inspector for safety https://review.opendev.org/c/openstack/nova/+/923285
15:33:21 opendevreview Balazs Gibizer proposed openstack/nova stable/2023.2: Additional qemu safety checking on base images https://review.opendev.org/c/openstack/nova/+/923286
15:33:22 opendevreview Balazs Gibizer proposed openstack/nova stable/2023.2: Fix vmdk_allowed_types checking https://review.opendev.org/c/openstack/nova/+/923287
15:44:40 opendevreview Balazs Gibizer proposed openstack/nova stable/2023.1: Reject qcow files with data-file attributes https://review.opendev.org/c/openstack/nova/+/923288
15:44:41 opendevreview Balazs Gibizer proposed openstack/nova stable/2023.1: Check images with format_inspector for safety https://review.opendev.org/c/openstack/nova/+/923289
15:44:42 opendevreview Balazs Gibizer proposed openstack/nova stable/2023.1: Additional qemu safety checking on base images https://review.opendev.org/c/openstack/nova/+/923290
15:44:43 opendevreview Balazs Gibizer proposed openstack/nova stable/2023.1: Fix vmdk_allowed_types checking https://review.opendev.org/c/openstack/nova/+/923291
16:45:59 opendevreview Andrei Yachmenev proposed openstack/nova master: Fix processing uniqueness of instance host names https://review.opendev.org/c/openstack/nova/+/923395
17:52:18 frickler two failures on one of the 2024.1 cve backports, not sure if someone's still around to check these and also possibly approve the whole stack?
17:52:23 frickler https://review.opendev.org/c/openstack/nova/+/923274/2
17:55:53 dansmith frickler: looks like the instance booted fine to me, so I'd expect that's typical "sometimes we can't ssh to the guest" problems
17:56:11 dansmith want me to recheck?
17:56:53 frickler frickler: either recheck or if you want to approve the check, I can also enqueue into gate directly, the V-1 is ignored then
17:57:01 frickler s/check/stack/
17:58:04 dansmith oh I see it's missing votes
18:01:51 dansmith frickler: green all the way down on 2024.1 now, I didn't recheck if you want to promote, but left the reason there too
18:05:07 frickler I won't promote, as that would reset the glance stack currently merging, but just enqueue into gate, which isn't too full right now I'd hope

Earlier   Later