Earlier  
Posted Nick Remark
#openstack-nova - 2023-01-27
20:43:24 sean-k-mooney but the agent does not exit and we just get tracebacks in the logs.
20:44:12 sean-k-mooney ill leave it there for today and come back to this on monday
20:46:34 dansmith wait,
20:46:43 dansmith I thought you said it *did* update the placement provider hostname?
20:47:56 sean-k-mooney it appeard too but based on that log it deleted the RP and recreated it the the old uuid and new name
20:48:17 sean-k-mooney so its not updating in place its trying too delete orphan compute and then creating a new one
20:48:27 sean-k-mooney that by the way i think is ironic code
20:48:52 sean-k-mooney or rather code we have in the common manager loop for ironic
20:50:39 sean-k-mooney we we detech hypervior_hostname changes and abort just like conf.host we dont have to care about this
20:50:53 dansmith ah because it had no instances?
20:51:04 sean-k-mooney right so with no instnaces it deelted it fine
20:51:09 dansmith right okay
20:51:18 sean-k-mooney the 409 conflict in placment is because fo the allcoation for the instnace
20:51:23 dansmith so if no instances, maybe no harm to cinder and neutron?
20:51:40 sean-k-mooney it might still break the naming
20:51:51 sean-k-mooney but it might be ok in the no instance case
20:52:12 sean-k-mooney i will confirure bandwith QOS or something next week and see
20:52:23 sean-k-mooney cindier i dont think will use placment at all reight now
20:52:27 sean-k-mooney but cyborg could break
20:53:15 sean-k-mooney cyborg and neutron might need me to restarck so ill test what i can before that
20:54:02 sean-k-mooney dansmith: in this particalr case this placement exception i think happend before your code
20:54:20 dansmith during reshape or something?
20:54:24 sean-k-mooney i have defintly seen this before and its what i was expecting if your code did not block it
20:54:58 dansmith fml
20:54:58 dansmith so that sanity check of the hostname->node mapping generates 94 functional test failures
20:55:07 sean-k-mooney no i have seen this when people actully change dns/hostname but had CONF.host set
20:57:18 sean-k-mooney we dont need to fix all theses cases this cycle either like i know that test case 10 is a prexisitng failure mode
20:57:38 sean-k-mooney anyway im going to go get food
20:57:47 sean-k-mooney dont spend your weekend on this o/
20:59:21 dansmith I shan't, you either
#openstack-nova - 2023-01-28
19:58:06 opendevreview Takashi Natsume proposed openstack/nova-specs master: Create specs directory for 2023.2 Bobcat https://review.opendev.org/c/openstack/nova-specs/+/872068
#openstack-nova - 2023-01-30
09:27:45 plibeau hello guys, if you have sometime to review please: https://review.opendev.org/c/openstack/nova/+/861172
11:17:01 opendevreview Merged openstack/nova master: Fix rescue volume-based instance https://review.opendev.org/c/openstack/nova/+/852737
12:26:44 elodilles bauzas: hi, you've told me to ping you about the ussuri and train gate issue (failed to build cryptography bcrypt). If you have any memories about this error then please let me know :) an example: https://zuul.opendev.org/t/openstack/build/0bc1bf3540c5446fa0026558f30fbec8
12:46:08 opendevreview Rajesh Tailor proposed openstack/nova stable/zed: Handle InstanceInvalidState exception https://review.opendev.org/c/openstack/nova/+/872115
12:46:52 opendevreview Rajesh Tailor proposed openstack/nova stable/zed: Fix rescue volume-based instance https://review.opendev.org/c/openstack/nova/+/872116
13:01:22 opendevreview Rajesh Tailor proposed openstack/nova stable/yoga: Handle InstanceInvalidState exception https://review.opendev.org/c/openstack/nova/+/872117
13:02:09 opendevreview Rajesh Tailor proposed openstack/nova stable/yoga: Fix rescue volume-based instance https://review.opendev.org/c/openstack/nova/+/872118
13:04:02 sean-k-mooney elodilles: we used to work around that by not building it and useing the prebuilt wheel
13:04:31 sean-k-mooney elodilles: the cryptography module added rust as a build dep
13:04:38 sean-k-mooney which is not installed by devstack
13:04:51 sean-k-mooney without rust the module could not be built and installed in the tempest jobs
13:05:08 sean-k-mooney we avoided the need to do that by using the prebuilt wheels
13:05:42 sean-k-mooney it sound like either those have been pulled form pypi or are not n the wheel cache avaiable in the providers fo the ci
13:07:31 elodilles sean-k-mooney: oh. nice. good question how to solve that then in upstream ci... :S
13:07:36 sean-k-mooney the simpletst way to fix this is to user rust_up to install rust so it can compile form source
13:08:55 sean-k-mooney we might have a role for that
13:09:05 sean-k-mooney we do https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/ensure-rust
13:09:47 elodilles oh, that sounds better then \o/
13:10:08 elodilles we just have to add it for failing jobs on the failing branches then i guess
13:10:29 sean-k-mooney add it as or too the pre playbook ya
13:10:37 sean-k-mooney that or have devstack do it
13:10:49 sean-k-mooney but the role is proably simpler
13:11:33 sean-k-mooney it looks like it will have rustup install the latest sable version of the tool chain
13:11:37 sean-k-mooney https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/ensure-rust/defaults/main.yaml
13:11:48 sean-k-mooney so that proably will do what we want out of the box
13:12:44 elodilles cool, thx, i'll try out this \o/
14:38:34 opendevreview Elod Illes proposed openstack/nova master: DNM: CI test https://review.opendev.org/c/openstack/nova/+/872178
14:57:57 opendevreview Elod Illes proposed openstack/nova stable/ussuri: DNM: CI test https://review.opendev.org/c/openstack/nova/+/872184
15:03:10 artom So a CPU is a central processing unit
15:03:18 artom It's found inside computers and other electronics
15:03:27 opendevreview ribaudr proposed openstack/os-traits master: Add 'COMPUTE_SHARE_LOCAL_FS' https://review.opendev.org/c/openstack/os-traits/+/872185
15:03:28 sahid artom: ahaha :-)
15:03:44 sahid bauzas: it's regarding the online/offline cpus?
15:03:49 bauzas yes
15:04:55 sahid cool, interesting work
15:05:14 sahid i will try to continue my review on it
15:06:06 opendevreview Jorge San Emeterio proposed openstack/nova master: Dividing global privsep profile https://review.opendev.org/c/openstack/nova/+/871729
15:06:30 sahid i was just not sure about the files that you have added in one of your patches to simulates hw ;)
15:13:35 opendevreview Jorge San Emeterio proposed openstack/nova master: WIP: Moving privsep profiles to nova/__init__.py https://review.opendev.org/c/openstack/nova/+/872010
15:23:25 dansmith sean-k-mooney: I think I better put this host/node consistency check in its own patch after the last one in the series, because it seems to be death by a thousand cuts on the functional tests
15:23:52 dansmith I also wonder if it might be better to just mock it out completely for functional
15:24:33 dansmith because basically every place we do a compute restart type operation, we'll fail since we don't have the node uuid thing mocked out to what it needs to be at the time
15:32:09 opendevreview Jorge San Emeterio proposed openstack/nova master: WIP: Moving privsep profiles to nova/__init__.py https://review.opendev.org/c/openstack/nova/+/872010
15:46:12 opendevreview Aaron S proposed openstack/nova master: Add further workaround features for qemu_monitor_announce_self https://review.opendev.org/c/openstack/nova/+/867324
15:54:47 elodilles sean-k-mooney: unfortunately ensure-rust does not work: https://zuul.opendev.org/t/openstack/build/f2efc09c770a448297fe90cd73191d5a
15:55:01 elodilles sean-k-mooney: but meanwhile i've checked and the problem is the old pip version.
15:56:02 elodilles sean-k-mooney: with the old pip version i was able to reproduce the 'missing rust' error, and after upgrading pip it installed cryptography fine
16:05:10 sean-k-mooney ack
16:09:47 bauzas sean-k-mooney: maybe you haven't seen but I created a Core API for the CPU states https://review.opendev.org/c/openstack/nova/+/868236/2/nova/virt/libvirt/cpu/core.py#47
16:10:27 bauzas sean-k-mooney: but I can modify both modules to rather only have one Core API that would directly call the filesystem instead of calling the backed module
16:41:07 sean-k-mooney ill take a look later
16:41:44 sean-k-mooney elodilles: ack so using new pip might correct the issue provided that does not break anything with the new resolveer logic
16:45:52 elodilles sean-k-mooney: yes. though i have a fear that it would break something :/
16:47:30 elodilles sean-k-mooney: anyway, i think the prebuilt wheel disappeared from pypi that's why we are facing this issue now :(
16:53:02 elodilles (or we use different pip version now than before, but I haven't find any proof for that yet)
16:53:23 sean-k-mooney ya i suspect it disappeared too
18:29:25 opendevreview Merged openstack/nova master: Persist existing node uuids locally https://review.opendev.org/c/openstack/nova/+/863918
18:29:35 opendevreview Merged openstack/nova master: Fix huge-page doc https://review.opendev.org/c/openstack/nova/+/869689
18:41:02 dansmith sean-k-mooney: I thought on friday you said you were happy with my answer here: https://review.opendev.org/c/openstack/nova/+/863919/12
18:41:22 dansmith but I also thought you commented on it, which I don't see... do we need more on that?
18:41:51 sean-k-mooney i think that was in context of https://review.opendev.org/c/openstack/nova/+/863918/12
18:42:02 sean-k-mooney i have not looked at the rt one since then
18:42:20 sean-k-mooney as in i looked at it before we talked on irc/meet
18:42:36 sean-k-mooney ill try and loop back too it again shortly
18:43:14 dansmith okay just wanted to make sure I wasn't missing some response or action
18:44:08 sean-k-mooney no i think we can likely proceed with that for now
18:44:11 sean-k-mooney https://review.opendev.org/c/openstack/nova/+/863919/12/nova/tests/unit/compute/test_resource_tracker.py#1553
18:44:33 dansmith ack
18:44:44 sean-k-mooney i was expecting to be blocked becasue i was expecting use to block hypervior_hostname changes which we agreed should be done but is out of scope of the spec

Earlier   Later