Earlier  
Posted Nick Remark
#openstack-nova - 2021-09-28
16:59:48 ganso great!
16:59:49 ganso thanks!
17:00:06 bauzas *if we can* as we have some blockers that need help
17:00:16 bauzas but we're overtime
17:00:23 bauzas thanks all
17:00:25 bauzas #endmeeting
17:00:25 opendevmeet Meeting ended Tue Sep 28 17:00:25 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)
17:00:25 opendevmeet Minutes: https://meetings.opendev.org/meetings/nova/2021/nova.2021-09-28-16.00.html
17:00:25 opendevmeet Minutes (text): https://meetings.opendev.org/meetings/nova/2021/nova.2021-09-28-16.00.txt
17:00:25 opendevmeet Log: https://meetings.opendev.org/meetings/nova/2021/nova.2021-09-28-16.00.log.html
17:01:04 gibi gmann: do you say that we need something like https://github.com/openstack/devstack/blob/stable/wallaby/lib/tempest#L669-L685 to stable/xena in devstack to fix nova-grenade-multinode?
17:01:08 gibi lyarwood: ^^
17:01:27 opendevreview Ivan Kolodyazhny proposed openstack/nova master: Add release note which descrube NVMe attach issue https://review.opendev.org/c/openstack/nova/+/811447
17:01:55 gmann gibi: yes but I saw neutron-truck extension is not enabled there so checking if that is correct or wrong
17:02:15 gibi gmann: this change sets NETWORK_API_EXTENSIONS which we saw missing in the failing grenade jobs
17:02:44 gibi gmann: as far as I see we never enabled trunk in grenade before
17:02:50 gibi gmann: but we can try
17:02:51 gmann gibi: yeah, as you mentioned in review, master is with 'all' which means everything is enabled
17:04:46 gibi gmann: OK, thanks for pointing out the solution. We chased this for a day without success.
17:05:28 gmann gibi: I should have done that while capping the microversion in stable/xena but just late by one day and then apache thing came up
17:05:49 gibi gmann: I guess this capping is logically part of the devstack xena branch cut and the grenade switch from testing wallaby -> master to testing xena -> master
17:06:10 gibi gmann: I see.
17:06:29 gibi gmann: I should remember this
17:07:28 gmann yeah, its just all these should go into sequence. I have added all of these stuff in QA release wiki but let me add it with depends-on things so that we avoid any issue in future
17:09:23 gibi gmann: could you paste the link to that wiki, I want to learn more :)
17:09:52 gmann gibi: this one https://wiki.openstack.org/wiki/QA/releases
17:09:56 gibi thanks
17:20:29 gmann lyarwood: can you remove WIP from https://review.opendev.org/c/openstack/grenade/+/811117
17:21:09 lyarwood gmann: I can if you don't want to fix this by capping things in tempest?
17:21:23 lyarwood I haven't had a positive test run with this yet because of the other issues as well btw
17:21:49 gmann lyarwood: capping is skipping the tests which is what happening in stable/wallaby so not broken :)
17:22:25 gmann lyarwood: ok, let me enable this extension in stable/wallaby|xena and then we can test it with your fix
17:22:56 lyarwood gmann: right but we should be skipping if the extension isn't installed right?
17:23:21 lyarwood gmann: oh sorry tempest is hardcoded to assume these things are available
17:23:25 gmann lyarwood: right but we do enable service in tempest multinode job
17:23:42 gmann so basically grenade also should
17:23:43 gmann yeah
17:23:46 lyarwood right the issue is that grenade isn't derived from that
17:23:49 lyarwood yeah
17:23:51 lyarwood okay
17:23:58 lyarwood let me remove the WIP now
19:30:17 admin1 hi all ..suddenly nova-compute is connecting and disconnecting to rabbitmq .. OSError: Server unexpectedly closed connection .. and then reconnected .... in all 3 rabbitmq containers, netstat shows around 2000 connected sockets in each .. is this something that others have also seen ?
19:30:24 admin1 did i hit a bug at rabbitmq
21:27:57 gouthamr hello seeing a devstack failure in some of the manila jobs; the "nova-status upgrade check" in devstack's post tasks fails the Placement API check... Details: Placement API does not seem to be running.
21:28:48 gouthamr these jobs don't disable placement, and the placement-api logs don't show anything abnormal; example: https://zuul.opendev.org/t/openstack/build/727954069097463495e9e9d774101278/log/controller/logs/screen-placement-api.txt
21:28:57 tosky gouthamr: there is an email iirc
21:29:43 tosky gouthamr: isn't it http://lists.openstack.org/pipermail/openstack-discuss/2021-September/025101.html ?
21:29:50 gouthamr ah! it is!
21:29:53 gouthamr thanks tosky!
21:30:31 clarkb the fixes are all in the gate right now
21:30:40 clarkb we have to roll them forward from victoria to master due to grenade
21:32:11 gouthamr great, thank you clarkb (/me watches https://review.opendev.org/c/openstack/devstack/+/811399 and the train)
22:22:59 gmann gouthamr: as you are here, nova ceph jobs also broken which need fix in devstack-plugin-ceph. https://review.opendev.org/q/I7061f8d1491ff957452c9c777e40186a4e9c324e
22:23:16 gmann I am still testing it on victoria and wallaby
22:23:29 gouthamr ack, saw your change gmann
22:23:49 gmann gouthamr: ok, I might need your help to merge it after testing
22:23:55 gouthamr thanks for the patch! yep :) i'm on it
22:24:01 gmann thanks
23:20:03 opendevreview Ghanshyam proposed openstack/nova stable/wallaby: DNM: Testing nova-grenade-multinode with neutron-trunk https://review.opendev.org/c/openstack/nova/+/811513
23:22:48 opendevreview Ghanshyam proposed openstack/nova stable/xena: DNM: Testing nova-grenade-multinode with neutron-trunk https://review.opendev.org/c/openstack/nova/+/811491
#openstack-nova - 2021-09-29
00:51:35 opendevreview Ghanshyam proposed openstack/nova master: DNM testing grenade neutron-trunk fix https://review.opendev.org/c/openstack/nova/+/811118
01:02:48 opendevreview Ghanshyam proposed openstack/nova stable/xena: DNM: Testing nova-grenade-multinode with neutron-trunk https://review.opendev.org/c/openstack/nova/+/811491
01:03:18 opendevreview Ghanshyam proposed openstack/nova stable/wallaby: DNM: Testing nova-grenade-multinode with neutron-trunk https://review.opendev.org/c/openstack/nova/+/811513
01:34:42 opendevreview Hang Yang proposed openstack/nova master: Support creating servers with RBAC SGs https://review.opendev.org/c/openstack/nova/+/811521
01:48:58 opendevreview melanie witt proposed openstack/nova stable/train: address open redirect with 3 forward slashes https://review.opendev.org/c/openstack/nova/+/806629
01:52:57 opendevreview Federico Ressi proposed openstack/nova master: Check Nova project changes with Tobiko scenario test cases https://review.opendev.org/c/openstack/nova/+/806853
01:56:37 opendevreview Federico Ressi proposed openstack/nova master: Debug Nova APIs call failures https://review.opendev.org/c/openstack/nova/+/806683
04:10:29 opendevreview Ghanshyam proposed openstack/nova stable/victoria: DNM: Testing nova-grenade-multinode with neutron-trunk https://review.opendev.org/c/openstack/nova/+/811540
06:43:02 bauzas good morning Nova
08:16:00 deke Hi
08:16:48 deke Has there been any discussion about implementing a MAAS driver for nova to enable ironic-like functionality for users who have deployed openstack with juju on MAAS?
08:36:13 bauzas deke: I haven't heard anything about this
08:36:30 bauzas deke: tbh, it would be a laaaarge discussion, right?
08:36:38 deke yea it would
08:36:43 deke it was just a thought I had
08:37:00 deke if we are already deploying on top of a baremetal provisioning service
08:37:15 deke then why deploy another baremetal provisioning service
08:39:35 bauzas we are not saying "no" for a new virt driver
08:40:31 bauzas but for having a new virt driver upstream, that means we need to discuss how to use it and how we could verify it by the CI
08:40:55 bauzas that means large discussions during a lot of PTGs + making sure we at least have a third-party CI
08:42:49 lyarwood dansmith: https://review.opendev.org/c/openstack/grenade/+/811117 - looks like you're the only remaining active core on grenade, can you ack this when you get online to unblock Nova's gate?
09:03:28 gibi gmann: thanks for the patches!
09:05:12 bauzas gmann: what gibi said, thanks for having worked on them
09:06:08 bauzas so the xena and master changes for fixing the placement API endpoints are now merged, we only have the grenade issue left, right?
09:07:08 lyarwood Yup I believe so
09:07:12 lyarwood and I think we only need it in master
09:07:15 gibi yupp thats my view too
09:07:17 lyarwood I don't know why we've backported it tbh
09:07:53 gibi lyarwood: you mean why we are enabling trunk testing on wallaby and back?
09:08:26 lyarwood on stable/xena and backwards, I thought grenade used the current branch of itself and the previous branch for everything else for the initial deploy
09:08:47 lyarwood so master grenade deploys a stable/xena env and then upgrades that to master
09:10:08 bauzas gibi: I stupidely forgot to +1 the RC2 patches yesterday before leaving
09:10:14 bauzas :facepalm:
09:10:29 bauzas now we need elodilles_pto but as his nick says, he's on PTO :)
09:12:17 gibi lyarwood: if we do this https://review.opendev.org/c/openstack/devstack/+/811518/2/lib/tempest then we need to do this as well https://review.opendev.org/c/openstack/grenade/+/811542/1/.zuul.yaml on stable. But I agre that we don't have to enable trunk on stable, skip is OK to me too.
09:12:59 lyarwood yeah I agree with the comment on the stable/wallaby change that we shouldn't be adding tests to stable this late on
09:13:01 gibi bauzas: I think other release cores can approve the RC2 we don't necessary need to wait for elodilles_pto.
09:13:12 gibi anyhow he is back tomorrow so no worries
09:14:13 gibi lyarwood: ack, we can discuss this with gmann when he is up
09:20:45 lyarwood kk

Earlier   Later