| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-12-17 | |||
| 15:59:07 | mriedem | melwitt: i dumped thoughts in https://review.opendev.org/#/c/678100/ about splitting that up | |
| 16:11:38 | stephenfin | mriedem: You've probably seen this already, but it looks like grenade is properly broken. Ansible version mismatches | |
| 16:13:57 | mriedem | nope i hadn't noticed but now i see | |
| 16:13:57 | mriedem | ERROR: ara 0.16.6 has requirement ansible>=2.6.0, but you'll have ansible 2.5.7 which is incompatible. | |
| 16:15:17 | stephenfin | Yup. I'm not sure where it's coming from. Clearly not us | |
| 16:15:50 | mriedem | fungi: known issue ^? | |
| 16:16:26 | fungi | weird. ansible 2.5 is well past eol and i didn't think we had any jobs using it | |
| 16:16:44 | mriedem | seeing it here https://zuul.opendev.org/t/openstack/build/ce17ff84afb04b339cb98917c3625ced/log/job-output.txt#2225 | |
| 16:16:51 | fungi | zuul is about to completely drop support for ansible 2.5 as well (just saw the change for that approved) | |
| 16:17:28 | mriedem | hmm, grenade jobs are not happy: | |
| 16:17:31 | mriedem | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22ERROR%3A%20ara%200.16.6%20has%20requirement%20ansible%3E%3D2.6.0%2C%20but%20you'll%20have%20ansible%202.5.7%20which%20is%20incompatible.%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=7d | |
| 16:18:02 | fungi | https://zuul.opendev.org/t/openstack/build/ce17ff84afb04b339cb98917c3625ced/log/job-output.txt#2052 | |
| 16:18:15 | fungi | "Collecting ansible==2.5.7" | |
| 16:22:03 | stephenfin | jackpot | |
| 16:22:09 | stephenfin | devstack-vm-gate-wrap.sh | |
| 16:22:14 | stephenfin | whoops | |
| 16:22:16 | stephenfin | $ ag ANSIBLE_VERSION | |
| 16:22:16 | stephenfin | devstack-vm-gate-wrap.sh | |
| 16:22:16 | stephenfin | 31:ANSIBLE_VERSION=${ANSIBLE_VERSION:-2.5. | |
| 16:22:22 | stephenfin | 7} | |
| 16:22:47 | stephenfin | fungi: I wonder what should that be set to now? | |
| 16:25:01 | fungi | oof | |
| 16:25:21 | mriedem | 2.8.7 is what tempest-integrated-compute is using | |
| 16:25:24 | fungi | it's too bad our cycle goal to move off devstack-gate isn't already done | |
| 16:25:27 | mriedem | https://zuul.opendev.org/t/openstack/build/e0aa96296eea4930977c80cf599bc6c5/log/job-output.txt#33 | |
| 16:25:57 | mriedem | devstack-gate is branchless so i'm not sure if that will cause issues, but we could control that variable via the grenade jobs maybe | |
| 16:26:07 | fungi | note that devstack-gate is branchless, but maybe grenade can override $ANSIBLE_VERSION | |
| 16:26:13 | mriedem | jinx | |
| 16:26:32 | fungi | indeed ;) | |
| 16:26:41 | mriedem | i'll push a patch to play with it | |
| 16:26:44 | fungi | worth bringing up with the qa team too | |
| 16:26:54 | stephenfin | mriedem: I was just about to ask :) | |
| 16:27:15 | fungi | infra has been pushing to drop devstack-gate for a couple years already, so really doesn't want to have to make new changes to it | |
| 16:28:59 | mriedem | ok starting with https://bugs.launchpad.net/grenade/+bug/1856732 to at least track it | |
| 16:28:59 | openstack | Launchpad bug 1856732 in grenade "ERROR: ara 0.16.6 has requirement ansible>=2.6.0, but you'll have ansible 2.5.7 which is incompatible." [Undecided,New] | |
| 17:02:50 | mriedem | stephenfin: i don't think that's a blocker, it's a red herring, | |
| 17:02:57 | mriedem | in the case above the job failed because of a network issue | |
| 17:02:57 | mriedem | https://zuul.opendev.org/t/openstack/build/ce17ff84afb04b339cb98917c3625ced/log/logs/devstack-gate-setup-host.txt#1847 | |
| 17:03:25 | mriedem | stephenfin: which explains why this isn't a 100% failure and ara 0.16.6 was released in november - we would have noticed sooner if it was a blocker | |
| 17:03:37 | stephenfin | gdi | |
| 17:03:49 | stephenfin | makes sense | |
| 17:05:19 | mriedem | doesn't look like it | |
| 17:05:19 | mriedem | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ed7/638047/56/check/nova-grenade-multinode/ed76ba4/logs/ara/index.html.gz | |
| 17:05:40 | mriedem | fungi: i thought ara was replaced with the zuul dashboard console stuff? | |
| 17:06:12 | mriedem | yeah the tempest jobs don't even have ara it looks like | |
| 17:07:00 | stephenfin | damn :( | |
| 17:12:58 | KeithMnemonic | mriedem ok all done hopefully. thank again for the great feedback | |
| 17:15:39 | fungi | mriedem: effectively replaced for purposes of the ansible run directly by zuul executors, but some jobs may include an ara of their own if they do any "nested" ansible | |
| 17:15:52 | fungi | which grenade seems to do | |
| 17:15:58 | fungi | maybe | |
| 17:16:27 | fungi | i honestly don't know that much about grenade's internals, and to be perfectly honest i probably don't want to either ;) | |
| 17:17:49 | mriedem | grenade is just devstack at n-1 and devstack at master, orchestrated via devstack-gate | |
| 17:18:06 | mriedem | with some scripts to run upgrade stuff between and test that resources created on the old side are still there after the upgrade | |
| 17:18:10 | mriedem | runs tempest smoke tests | |
| 17:18:25 | mriedem | so the only ansible involved would be in d-g | |
| 17:52:01 | openstackgerrit | Nathan Kinder proposed openstack/nova master: Allow TLS ciphers/protocols to be configurable for console proxies https://review.opendev.org/679502 | |
| 18:25:05 | melwitt | mriedem: cool thank you! | |
| 18:40:23 | openstackgerrit | Merged openstack/nova stable/pike: Stabilize unshelve notification sample tests https://review.opendev.org/676677 | |
| 19:34:15 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: lxc: make use of filter python3 compatible https://review.opendev.org/676502 | |
| 19:38:20 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: lxc: make use of filter python3 compatible https://review.opendev.org/676502 | |
| 20:10:22 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Add functional test for resize crash compute restart revert https://review.opendev.org/687913 | |
| 20:10:22 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Prevent init_host test to interfere with other tests https://review.opendev.org/687916 | |
| 20:10:24 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Functional reproduce for bug 1833581 https://review.opendev.org/687917 | |
| 20:10:24 | openstack | bug 1833581 in OpenStack Compute (nova) train "instance stuck in BUILD state if nova-compute is restarted" [Low,Fix committed] https://launchpad.net/bugs/1833581 - Assigned to Balazs Gibizer (balazs-gibizer) | |
| 20:10:24 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Error out interrupted builds https://review.opendev.org/687918 | |
| 20:10:24 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Move restart_compute_service to a common place https://review.opendev.org/699488 | |
| 20:21:38 | openstackgerrit | Merged openstack/nova stable/pike: Explicitly fail if trying to attach SR-IOV port https://review.opendev.org/695408 | |
| 20:42:49 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Fix false ERROR message at compute restart https://review.opendev.org/699496 | |
| 20:49:18 | KeithMnemonic_ | mriedem thanks for your patience and +2 . have a great day | |
| 20:51:11 | mriedem | yw | |
| 20:51:15 | mriedem | my xmas gift to you | |
| 20:52:53 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/ocata: Fix incompatible version handling in BuildRequest https://review.opendev.org/660456 | |
| 20:54:56 | KeithMnemonic_ | lol | |
| 20:55:33 | KeithMnemonic_ | how far can i take it back once it merges? pike or just rocky? | |
| 20:57:03 | mriedem | heh, you skipped queens | |
| 20:57:15 | mriedem | you mean your target is pike b/c suse, but <rocky is EM | |
| 20:57:31 | mriedem | either way the question probably goes to dtroyer | |
| 20:57:56 | mriedem | i'd say if you can get it to train, stein and rocky upstream you're doing ok | |
| 20:58:43 | KeithMnemonic_ | ok rocky is fine | |
| 20:59:58 | KeithMnemonic_ | but since queen/pike are EM was not sure if i should take it there as it was sort of related to the marker/limit fix you did | |
| 21:00:15 | KeithMnemonic_ | and those went to pike | |
| 21:03:32 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: DNM: test that the ceph job is fixed on pike https://review.opendev.org/699500 | |
| 21:36:14 | mriedem | things in EM branches won't be released, and fixes in OSC would need to be released to be used by someone | |
| 21:36:21 | mriedem | so i don't see much point in backporting osc stuff past rocky | |
| 21:36:27 | mriedem | upstream anyway | |
| 21:38:39 | KeithMnemonic_ | ok thanks | |
| 22:00:04 | KeithMnemonic_ | mriedem can i run that issue with the "prev" button by you again. i know you said it was sort_dir/sort_key and in fact we found something interesting | |
| 22:00:28 | KeithMnemonic_ | using the nova cli and sort_key uuid and marker show correct results when using asc or desc | |
| 22:01:01 | KeithMnemonic_ | using the default sort created_at does not and that would explain why horizons "prev" button is not working | |
| 22:36:24 | KeithMnemonic | mriedem: so would you expect this command to work? nova list --sort created_at:desc and nova list --sort created_at:asc | |
| 22:36:48 | KeithMnemonic | they work with any field that is not a time field | |
| 22:37:42 | KeithMnemonic | but with a time field it does not sort correctly | |
| 22:42:53 | KeithMnemonic | if anyone has any ideas http://paste.openstack.org/show/787694/ | |
| 22:43:11 | KeithMnemonic | uuid works fine, created_at does not for the sort_key | |
| 22:43:38 | KeithMnemonic | and this was run as admin in devstack | |
| 22:56:13 | openstackgerrit | Curt Moore proposed openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD https://review.opendev.org/574301 | |
| 23:03:11 | openstackgerrit | Curt Moore proposed openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD https://review.opendev.org/574301 | |
| 23:42:07 | openstackgerrit | Luigi Toscano proposed openstack/nova master: Zuul v3: use devstack-plugin-nfs-tempest-full https://review.opendev.org/699516 | |
| #openstack-nova - 2019-12-18 | |||
| 01:20:21 | openstackgerrit | Merged openstack/nova master: Add revert_snapshot_based_resize conductor RPC method https://review.opendev.org/638047 | |
| 03:45:34 | openstackgerrit | melanie witt proposed openstack/nova master: Add functional regression test for bug 1817833 https://review.opendev.org/699538 | |