Earlier  
Posted Nick Remark
#openstack-nova - 2023-01-27
20:09:11 sean-k-mooney after that im going to try changing the value via /etc/hosts
20:09:21 sean-k-mooney i expect changing it back to revert all the chagnes
20:10:00 sean-k-mooney i proably shoudl test this with nested resouce provides form neutron but ill do that after all the simiple tests
20:11:07 sean-k-mooney actully i need to check a few db tables first
20:13:00 dansmith okay, so you're saying it updates plaacement but does *not* update our compute node right?
20:13:24 sean-k-mooney it updates teh cn table and placment they are both kept in sync
20:13:33 sean-k-mooney im checking what the api db looks like
20:14:51 dansmith L219 says otherwise
20:15:00 dansmith or you meant "isn't detected to abort"
20:15:56 sean-k-mooney i think we shoudl abort starting up if the hypervior_hostname for a compute node changes yes
20:16:03 sean-k-mooney at least for libvirt
20:16:30 sean-k-mooney but again thats an extra check we can add to the end fo the series
20:17:15 sean-k-mooney so i proably should have a vm runnign while i do this as i think the instance.node is going to be out of sync
20:17:22 sean-k-mooney so ill boot one before i fix it
20:17:58 sean-k-mooney and my expectation is that when i restor the old hostname the isntance.node will not be updated but placement and the compute nodes table will be
20:18:10 sean-k-mooney thats proably the last test ill do tonight
20:18:18 sean-k-mooney but ill do more on monday.
20:18:25 dansmith yeah, like I said, out of scope of what I'm trying to do, but probably should be in scope
20:18:27 dansmith ack
20:19:23 sean-k-mooney actully i need to test with provider.yaml too at some point
20:19:41 sean-k-mooney we can refernce the RP by name i belive which uses the hypervior_hostname
20:19:48 sean-k-mooney we can also refrrence it by UUID
20:20:05 sean-k-mooney so i suspect the uuid way will be fine but the other way might break
20:20:20 sean-k-mooney again not nessiarly in scope but i want to know what happens
20:41:27 sean-k-mooney ok so if there are allocation in placment we cant delete and rename the resouce provider becaues we get a 409
20:42:08 sean-k-mooney so that fails and we never update the compute node record either
20:42:32 sean-k-mooney the perodic is broken
20:43:24 sean-k-mooney but the agent does not exit and we just get tracebacks in the logs.
20:44:12 sean-k-mooney ill leave it there for today and come back to this on monday
20:46:34 dansmith wait,
20:46:43 dansmith I thought you said it *did* update the placement provider hostname?
20:47:56 sean-k-mooney it appeard too but based on that log it deleted the RP and recreated it the the old uuid and new name
20:48:17 sean-k-mooney so its not updating in place its trying too delete orphan compute and then creating a new one
20:48:27 sean-k-mooney that by the way i think is ironic code
20:48:52 sean-k-mooney or rather code we have in the common manager loop for ironic
20:50:39 sean-k-mooney we we detech hypervior_hostname changes and abort just like conf.host we dont have to care about this
20:50:53 dansmith ah because it had no instances?
20:51:04 sean-k-mooney right so with no instnaces it deelted it fine
20:51:09 dansmith right okay
20:51:18 sean-k-mooney the 409 conflict in placment is because fo the allcoation for the instnace
20:51:23 dansmith so if no instances, maybe no harm to cinder and neutron?
20:51:40 sean-k-mooney it might still break the naming
20:51:51 sean-k-mooney but it might be ok in the no instance case
20:52:12 sean-k-mooney i will confirure bandwith QOS or something next week and see
20:52:23 sean-k-mooney cindier i dont think will use placment at all reight now
20:52:27 sean-k-mooney but cyborg could break
20:53:15 sean-k-mooney cyborg and neutron might need me to restarck so ill test what i can before that
20:54:02 sean-k-mooney dansmith: in this particalr case this placement exception i think happend before your code
20:54:20 dansmith during reshape or something?
20:54:24 sean-k-mooney i have defintly seen this before and its what i was expecting if your code did not block it
20:54:58 dansmith fml
20:54:58 dansmith so that sanity check of the hostname->node mapping generates 94 functional test failures
20:55:07 sean-k-mooney no i have seen this when people actully change dns/hostname but had CONF.host set
20:57:18 sean-k-mooney we dont need to fix all theses cases this cycle either like i know that test case 10 is a prexisitng failure mode
20:57:38 sean-k-mooney anyway im going to go get food
20:57:47 sean-k-mooney dont spend your weekend on this o/
20:59:21 dansmith I shan't, you either
#openstack-nova - 2023-01-28
19:58:06 opendevreview Takashi Natsume proposed openstack/nova-specs master: Create specs directory for 2023.2 Bobcat https://review.opendev.org/c/openstack/nova-specs/+/872068
#openstack-nova - 2023-01-30
09:27:45 plibeau hello guys, if you have sometime to review please: https://review.opendev.org/c/openstack/nova/+/861172
11:17:01 opendevreview Merged openstack/nova master: Fix rescue volume-based instance https://review.opendev.org/c/openstack/nova/+/852737
12:26:44 elodilles bauzas: hi, you've told me to ping you about the ussuri and train gate issue (failed to build cryptography bcrypt). If you have any memories about this error then please let me know :) an example: https://zuul.opendev.org/t/openstack/build/0bc1bf3540c5446fa0026558f30fbec8
12:46:08 opendevreview Rajesh Tailor proposed openstack/nova stable/zed: Handle InstanceInvalidState exception https://review.opendev.org/c/openstack/nova/+/872115
12:46:52 opendevreview Rajesh Tailor proposed openstack/nova stable/zed: Fix rescue volume-based instance https://review.opendev.org/c/openstack/nova/+/872116
13:01:22 opendevreview Rajesh Tailor proposed openstack/nova stable/yoga: Handle InstanceInvalidState exception https://review.opendev.org/c/openstack/nova/+/872117
13:02:09 opendevreview Rajesh Tailor proposed openstack/nova stable/yoga: Fix rescue volume-based instance https://review.opendev.org/c/openstack/nova/+/872118
13:04:02 sean-k-mooney elodilles: we used to work around that by not building it and useing the prebuilt wheel
13:04:31 sean-k-mooney elodilles: the cryptography module added rust as a build dep
13:04:38 sean-k-mooney which is not installed by devstack
13:04:51 sean-k-mooney without rust the module could not be built and installed in the tempest jobs
13:05:08 sean-k-mooney we avoided the need to do that by using the prebuilt wheels
13:05:42 sean-k-mooney it sound like either those have been pulled form pypi or are not n the wheel cache avaiable in the providers fo the ci
13:07:31 elodilles sean-k-mooney: oh. nice. good question how to solve that then in upstream ci... :S
13:07:36 sean-k-mooney the simpletst way to fix this is to user rust_up to install rust so it can compile form source
13:08:55 sean-k-mooney we might have a role for that
13:09:05 sean-k-mooney we do https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/ensure-rust
13:09:47 elodilles oh, that sounds better then \o/
13:10:08 elodilles we just have to add it for failing jobs on the failing branches then i guess
13:10:29 sean-k-mooney add it as or too the pre playbook ya
13:10:37 sean-k-mooney that or have devstack do it
13:10:49 sean-k-mooney but the role is proably simpler
13:11:33 sean-k-mooney it looks like it will have rustup install the latest sable version of the tool chain
13:11:37 sean-k-mooney https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/ensure-rust/defaults/main.yaml
13:11:48 sean-k-mooney so that proably will do what we want out of the box
13:12:44 elodilles cool, thx, i'll try out this \o/
14:38:34 opendevreview Elod Illes proposed openstack/nova master: DNM: CI test https://review.opendev.org/c/openstack/nova/+/872178
14:57:57 opendevreview Elod Illes proposed openstack/nova stable/ussuri: DNM: CI test https://review.opendev.org/c/openstack/nova/+/872184
15:03:10 artom So a CPU is a central processing unit
15:03:18 artom It's found inside computers and other electronics
15:03:27 opendevreview ribaudr proposed openstack/os-traits master: Add 'COMPUTE_SHARE_LOCAL_FS' https://review.opendev.org/c/openstack/os-traits/+/872185
15:03:28 sahid artom: ahaha :-)
15:03:44 sahid bauzas: it's regarding the online/offline cpus?
15:03:49 bauzas yes
15:04:55 sahid cool, interesting work
15:05:14 sahid i will try to continue my review on it
15:06:06 opendevreview Jorge San Emeterio proposed openstack/nova master: Dividing global privsep profile https://review.opendev.org/c/openstack/nova/+/871729
15:06:30 sahid i was just not sure about the files that you have added in one of your patches to simulates hw ;)
15:13:35 opendevreview Jorge San Emeterio proposed openstack/nova master: WIP: Moving privsep profiles to nova/__init__.py https://review.opendev.org/c/openstack/nova/+/872010
15:23:25 dansmith sean-k-mooney: I think I better put this host/node consistency check in its own patch after the last one in the series, because it seems to be death by a thousand cuts on the functional tests
15:23:52 dansmith I also wonder if it might be better to just mock it out completely for functional
15:24:33 dansmith because basically every place we do a compute restart type operation, we'll fail since we don't have the node uuid thing mocked out to what it needs to be at the time

Earlier   Later