| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2024-06-18 | |||
| 16:14:50 | bauzas | nothing on the agenda, unless I'm blind | |
| 16:14:56 | bauzas | so, anything here ? | |
| 16:16:17 | bauzas | ok cool | |
| 16:16:24 | bauzas | giving you a whole of time back | |
| 16:16:28 | bauzas | thanks all | |
| 16:16:30 | opendevmeet | Log: https://meetings.opendev.org/meetings/nova/2024/nova.2024-06-18-16.00.log.html | |
| 16:16:30 | opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/nova/2024/nova.2024-06-18-16.00.txt | |
| 16:16:30 | opendevmeet | Minutes: https://meetings.opendev.org/meetings/nova/2024/nova.2024-06-18-16.00.html | |
| 16:16:30 | opendevmeet | Meeting ended Tue Jun 18 16:16:30 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | |
| 16:16:30 | bauzas | #endmeeting | |
| 16:16:40 | fwiesel | \o | |
| 16:16:52 | gibi | o/ | |
| 16:17:40 | sean-k-mooney | o/ | |
| 16:18:01 | elodilles | o/ | |
| 16:26:52 | opendevreview | sean mooney proposed openstack/nova stable/2024.1: Revert "Always delete NVRAM files when deleting instances" https://review.opendev.org/c/openstack/nova/+/922235 | |
| 16:29:35 | bauzas | frickler: so, please lemme know once the requirements patch will support setuptools for devstack so I could update my own mtty patch | |
| 16:29:42 | bauzas | with a Depends-On | |
| 19:27:56 | opendevreview | Jens Harbott proposed openstack/nova master: WIP : Enable an experimental job for testing mtty https://review.opendev.org/c/openstack/nova/+/922140 | |
| 19:28:42 | frickler | ^^ just because I'm curious ;) | |
| #openstack-nova - 2024-06-19 | |||
| 07:33:49 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : mtty: add devstack compilation for fedora builds https://review.opendev.org/c/openstack/nova/+/918420 | |
| 07:33:49 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : Enable an experimental job for testing mtty https://review.opendev.org/c/openstack/nova/+/922140 | |
| 07:43:11 | sahid | o/ | |
| 07:43:37 | sahid | gibi: morning, regarding https://review.opendev.org/c/openstack/nova/+/921665 - it is not somerhinf that we should fix in placement if this happens? | |
| 08:33:05 | Uggla | Hello sean-k-mooney, can you please have a look the comment https://review.opendev.org/c/openstack/nova/+/833090/comment/82eda0c2_3d07f30a/ | |
| 09:24:15 | bauzas | sean-k-mooney: frickler: do you know why FORCE=yes wasn't passed to compute1 here : https://review.opendev.org/c/openstack/nova/+/922140/6/.zuul.yaml#345 | |
| 09:24:46 | bauzas | it was a global var | |
| 09:25:09 | sean-k-mooney | you have to set it on the sub node too | |
| 09:25:29 | bauzas | https://zuul.opendev.org/t/openstack/build/99ecc0f9124248739e2ec4d1b959cf5e/log/job-output.txt#24841 | |
| 09:25:30 | sean-k-mooney | we run devstack twice indepently when doing multi node so both have diffent local.cons | |
| 09:25:59 | bauzas | even if it was set in vars: | |
| 09:26:01 | bauzas | ? | |
| 09:26:04 | sean-k-mooney | yes | |
| 09:26:09 | sean-k-mooney | even if set in vars | |
| 09:27:05 | sean-k-mooney | look at nova next | |
| 09:28:00 | bauzas | ack | |
| 09:28:03 | bauzas | thanks | |
| 09:32:24 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : Enable an experimental job for testing mtty https://review.opendev.org/c/openstack/nova/+/922140 | |
| 09:32:25 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : mtty: add devstack compilation for fedora builds https://review.opendev.org/c/openstack/nova/+/918420 | |
| 10:22:04 | opendevreview | Andrew Bonney proposed openstack/nova master: WIP: Work around deleted instances when performing data migration https://review.opendev.org/c/openstack/nova/+/922299 | |
| 12:30:45 | obrest | Hi! Would it be a good idea by nova to add Intel AMX to the list of features it identifies an publishes traits for in placement? | |
| 12:31:51 | obrest | I just got a couple of sapphire-rapids compute-nodes; and I would like to expose flavors with AMX to my users; but that proved to be a bit difficult since nova is not identifying this trait. | |
| 12:55:38 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : Enable an experimental job for testing mtty https://review.opendev.org/c/openstack/nova/+/922140 | |
| 12:55:39 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : mtty: add devstack compilation for fedora builds https://review.opendev.org/c/openstack/nova/+/918420 | |
| 13:34:17 | opendevreview | Merged openstack/nova stable/2023.1: [ironic] Partition & use cache for list_instance* https://review.opendev.org/c/openstack/nova/+/922155 | |
| 14:03:15 | elodilles | bauzas: now that you are editing .zuul.yaml: there are some warnings regarding deprecated regex syntax. if that irritates you, here is a fix for that: https://review.opendev.org/c/openstack/nova/+/922212 o:) | |
| 14:05:10 | bauzas | elodilles: I'm just fighting with multinode zuul :) | |
| 14:07:14 | elodilles | yeah i saw that o:) | |
| 14:08:34 | bauzas | sean-k-mooney: I maybe need some help for debugging my mtty job https://59eb0550fb97fc327d84-51181049425e2f372c12ca87aad48047.ssl.cf2.rackcdn.com/922140/8/experimental/nova-mtty/8550c60/controller/logs/screen-br-ex-tcpdump.txt | |
| 14:08:45 | bauzas | the multinode job fails ^ | |
| 14:12:38 | bauzas | everytime you think you can understand OVN, then you find something you don't know | |
| 14:14:58 | bauzas | just saying, the VTEP failed : https://59eb0550fb97fc327d84-51181049425e2f372c12ca87aad48047.ssl.cf2.rackcdn.com/922140/8/experimental/nova-mtty/8550c60/controller/logs/ovn/ovn-controller-vtep_log.txt | |
| 14:15:30 | bauzas | maybe it's related if the public IPs are directly connected thru northbound OVN with br-ex | |
| 14:20:22 | sean-k-mooney | well you can trun off the tcpdump service | |
| 14:20:30 | sean-k-mooney | its just an extra dbuging thing for the ci | |
| 14:20:45 | sean-k-mooney | and its really only used by the neuron team | |
| 14:20:57 | sean-k-mooney | so for right now you could disabel it as a work around | |
| 14:21:25 | bauzas | k | |
| 14:21:42 | sean-k-mooney | ill quickly take a look at the devstack log and see if anything jumps out | |
| 14:23:46 | sean-k-mooney | ya so looking at the ovs-vswitchd log on the compute https://59eb0550fb97fc327d84-51181049425e2f372c12ca87aad48047.ssl.cf2.rackcdn.com/922140/8/experimental/nova-mtty/8550c60/compute1/logs/openvswitch/ovs-vswitchd_log.txt | |
| 14:23:50 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : mtty: add devstack compilation for fedora builds https://review.opendev.org/c/openstack/nova/+/918420 | |
| 14:23:50 | sean-k-mooney | there is not br-ex | |
| 14:23:50 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : Enable an experimental job for testing mtty https://review.opendev.org/c/openstack/nova/+/922140 | |
| 14:23:52 | sean-k-mooney | which is normal | |
| 14:24:20 | bauzas | I just disabled the service, we'll see | |
| 14:24:32 | sean-k-mooney | so for ml2-ovs in DVR (distirbuted virtural router) mode we also create an instance of the l3 agent on all the compute and create a br-ex | |
| 14:24:47 | sean-k-mooney | but for ovn we do not use the l3 agent and the br-ex is only created on the contoler | |
| 14:25:00 | sean-k-mooney | so you basicaly shoudl not run that service on the subnode | |
| 14:25:11 | sean-k-mooney | you can just disable it on both if you want however | |
| 14:25:54 | sean-k-mooney | on the contoler the bride does exist https://59eb0550fb97fc327d84-51181049425e2f372c12ca87aad48047.ssl.cf2.rackcdn.com/922140/8/experimental/nova-mtty/8550c60/controller/logs/openvswitch/ovs-vswitchd_log.txt | |
| 14:26:44 | sean-k-mooney | and tcpdump was installed | |
| 14:30:32 | sean-k-mooney | bauzas: there is noting obvious in the journal or in the devstack log but my guess is eitehr there has been a command line change or something like apparmour is causing the comand to fail | |
| 14:31:04 | bauzas | ack thanks for digging | |
| 14:31:13 | sean-k-mooney | im not sure what 203/EXEC is evstack@br-ex-tcpdump.service: Main process exited, code=exited, status=203/EXEC | |
| 14:34:28 | bauzas_ | yeah, that's a weird error code | |
| 14:34:30 | bauzas_ | shit my bouncer restarted the conn | |
| 14:34:32 | bauzas_ | shit my bouncer restarted the conn | |
| 16:13:44 | bauzas | https://zuul.opendev.org/t/openstack/build/32d394d8265e4cc188fc3c5a50d33993 🎉 | |
| 16:20:57 | bauzas | dang, Tempest is creating new flavors and they don't ask for VGPUs | |
| 16:21:17 | bauzas | 2024-06-19 15:18:47.346 | ++ lib/tempest:configure_tempest:298 : openstack --os-cloud devstack-admin flavor create --id 42 --ram 128 --disk 1 --vcpus 1 --property hw_rng:allowed=True m1.nano | |
| 16:22:00 | bauzas | sean-k-mooney: do you think I could change my own ansible script in https://review.opendev.org/c/openstack/nova/+/922140/9/playbooks/nova-mtty/pre.yaml to do post.yaml for updating all the flavors ? | |
| 16:23:00 | bauzas | https://d2ba671e5a990e8f3d73-f7c3a0f9889b6932e080ae1513d0dd0b.ssl.cf1.rackcdn.com/922140/9/experimental/nova-mtty/32d394d/controller/logs/devstacklog.txt => here I see that my pre.yaml script updates all the pre-existing flavors with resources:VGPU=1 | |
| 16:23:05 | bauzas | 2024-06-19 15:17:53.434 | ++ opt/stack/devstack/local.sh:main:8 : openstack flavor set --property resources:VGPU=1 1 | |
| 16:23:13 | sean-k-mooney | you could but the flavors used by tempest by defautl have know ides | |
| 16:23:19 | sean-k-mooney | namely 42 an 84 | |
| 16:23:30 | sean-k-mooney | which are m1.nano and m1.micro | |
| 16:23:41 | sean-k-mooney | so you dont need to update all of them you can just update the two used by tempest | |
| 16:24:19 | sean-k-mooney | local.sh will be run after tempest has created all the flavors | |
| 16:26:03 | bauzas | sean-k-mooney: if I use post.yaml tbc, right? | |
| 16:26:10 | sean-k-mooney | no | |
| 16:26:30 | sean-k-mooney | local.sh is used by devstack and included after tempest is configured but before tempest test are run | |
| 16:26:31 | bauzas | because pre.yaml runs before tempest creates its own flavors | |
| 16:26:43 | sean-k-mooney | pre runs before the run playbook | |
| 16:26:48 | sean-k-mooney | so be fore devstack is run | |
| 16:27:41 | sean-k-mooney | local.sh is run here https://github.com/openstack/devstack/blob/master/stack.sh#L1485-L1492 | |
| 16:27:56 | bauzas | 2024-06-19 15:18:24.159 | ++ lib/tempest:install_tempest:815 : git_clone https://opendev.org/openstack/tempest.git /opt/stack/tempest master | |
| 16:28:09 | bauzas | compared to 2024-06-19 15:17:50.794 | + ./stack.sh:main:1489 : [[ -x /opt/stack/devstack/local.sh ]] | |
| 16:28:27 | bauzas | so pre-run is called before install_tempest | |
| 16:28:42 | sean-k-mooney | pre-run is called before the run playbook | |
| 16:28:54 | sean-k-mooney | so its run after all the parent jobs pre playbooks | |
| 16:29:04 | sean-k-mooney | and be fore the current jobs run playbook | |