| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-12-17 | |||
| 07:11:43 | openstack | bug 1550919 in OpenStack Compute (nova) "[Libvirt]Evacuate fail may cause disk image be deleted" [Medium,In progress] https://launchpad.net/bugs/1550919 - Assigned to Matthew Booth (mbooth-9) | |
| 07:11:43 | openstackgerrit | Ning Yao proposed openstack/nova master: Add functional test for bug 1550919 https://review.opendev.org/631294 | |
| 08:09:00 | openstackgerrit | Boxiang Zhu proposed openstack/nova master: Make evacuation respects anti-affinity rule https://review.opendev.org/649963 | |
| 08:29:05 | openstackgerrit | Boxiang Zhu proposed openstack/nova master: Fix live migration break group policy simultaneously https://review.opendev.org/651969 | |
| 14:28:12 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Ensure source compute is up when confirming a resize https://review.opendev.org/699291 | |
| 15:12:20 | mriedem | KeithMnemonic: a few things in your osc patch https://review.opendev.org/#/c/691045/ | |
| 15:20:11 | KeithMnemonic | thanks mriedem, did you want that full context added to the commit message | |
| 15:21:28 | mriedem | up to you | |
| 15:22:16 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Use graceful_exit=True in ComputeTaskManager.revert_snapshot_based_resize https://review.opendev.org/699238 | |
| 15:22:16 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Plumb graceful_exit through to EventReporter https://review.opendev.org/699237 | |
| 15:22:17 | openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Add negative test to delete server during cross-cell resize claim https://review.opendev.org/688832 | |
| 15:22:17 | openstackgerrit | Matt Riedemann proposed openstack/nova master: FUP for docs nits in cross-cell-resize series https://review.opendev.org/699259 | |
| 15:22:18 | openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Implement reschedule logic for cross-cell resize/migrate https://review.opendev.org/696213 | |
| 15:29:46 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Use COMPUTE_SAME_HOST_COLD_MIGRATE trait during migrate https://review.opendev.org/695220 | |
| 15:37:53 | KeithMnemonic | mriedem, i will make all of those. the only one i can not is line 81 in the test, it is as you said due to the order of how the instances are launched, the first one actually is the second one in the list once both are ACTIVE | |
| 15:38:14 | KeithMnemonic | i saw that in testing when i first tried id1 | |
| 15:44:18 | mriedem | i wasn't asking for a change in the test, just making a note to myself | |
| 15:59:07 | mriedem | melwitt: i dumped thoughts in https://review.opendev.org/#/c/678100/ about splitting that up | |
| 16:11:38 | stephenfin | mriedem: You've probably seen this already, but it looks like grenade is properly broken. Ansible version mismatches | |
| 16:13:57 | mriedem | ERROR: ara 0.16.6 has requirement ansible>=2.6.0, but you'll have ansible 2.5.7 which is incompatible. | |
| 16:13:57 | mriedem | nope i hadn't noticed but now i see | |
| 16:15:17 | stephenfin | Yup. I'm not sure where it's coming from. Clearly not us | |
| 16:15:50 | mriedem | fungi: known issue ^? | |
| 16:16:26 | fungi | weird. ansible 2.5 is well past eol and i didn't think we had any jobs using it | |
| 16:16:44 | mriedem | seeing it here https://zuul.opendev.org/t/openstack/build/ce17ff84afb04b339cb98917c3625ced/log/job-output.txt#2225 | |
| 16:16:51 | fungi | zuul is about to completely drop support for ansible 2.5 as well (just saw the change for that approved) | |
| 16:17:28 | mriedem | hmm, grenade jobs are not happy: | |
| 16:17:31 | mriedem | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22ERROR%3A%20ara%200.16.6%20has%20requirement%20ansible%3E%3D2.6.0%2C%20but%20you'll%20have%20ansible%202.5.7%20which%20is%20incompatible.%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=7d | |
| 16:18:02 | fungi | https://zuul.opendev.org/t/openstack/build/ce17ff84afb04b339cb98917c3625ced/log/job-output.txt#2052 | |
| 16:18:15 | fungi | "Collecting ansible==2.5.7" | |
| 16:22:03 | stephenfin | jackpot | |
| 16:22:09 | stephenfin | devstack-vm-gate-wrap.sh | |
| 16:22:14 | stephenfin | whoops | |
| 16:22:16 | stephenfin | 31:ANSIBLE_VERSION=${ANSIBLE_VERSION:-2.5. | |
| 16:22:16 | stephenfin | devstack-vm-gate-wrap.sh | |
| 16:22:16 | stephenfin | $ ag ANSIBLE_VERSION | |
| 16:22:22 | stephenfin | 7} | |
| 16:22:47 | stephenfin | fungi: I wonder what should that be set to now? | |
| 16:25:01 | fungi | oof | |
| 16:25:21 | mriedem | 2.8.7 is what tempest-integrated-compute is using | |
| 16:25:24 | fungi | it's too bad our cycle goal to move off devstack-gate isn't already done | |
| 16:25:27 | mriedem | https://zuul.opendev.org/t/openstack/build/e0aa96296eea4930977c80cf599bc6c5/log/job-output.txt#33 | |
| 16:25:57 | mriedem | devstack-gate is branchless so i'm not sure if that will cause issues, but we could control that variable via the grenade jobs maybe | |
| 16:26:07 | fungi | note that devstack-gate is branchless, but maybe grenade can override $ANSIBLE_VERSION | |
| 16:26:13 | mriedem | jinx | |
| 16:26:32 | fungi | indeed ;) | |
| 16:26:41 | mriedem | i'll push a patch to play with it | |
| 16:26:44 | fungi | worth bringing up with the qa team too | |
| 16:26:54 | stephenfin | mriedem: I was just about to ask :) | |
| 16:27:15 | fungi | infra has been pushing to drop devstack-gate for a couple years already, so really doesn't want to have to make new changes to it | |
| 16:28:59 | openstack | Launchpad bug 1856732 in grenade "ERROR: ara 0.16.6 has requirement ansible>=2.6.0, but you'll have ansible 2.5.7 which is incompatible." [Undecided,New] | |
| 16:28:59 | mriedem | ok starting with https://bugs.launchpad.net/grenade/+bug/1856732 to at least track it | |
| 17:02:50 | mriedem | stephenfin: i don't think that's a blocker, it's a red herring, | |
| 17:02:57 | mriedem | https://zuul.opendev.org/t/openstack/build/ce17ff84afb04b339cb98917c3625ced/log/logs/devstack-gate-setup-host.txt#1847 | |
| 17:02:57 | mriedem | in the case above the job failed because of a network issue | |
| 17:03:25 | mriedem | stephenfin: which explains why this isn't a 100% failure and ara 0.16.6 was released in november - we would have noticed sooner if it was a blocker | |
| 17:03:37 | stephenfin | gdi | |
| 17:03:49 | stephenfin | makes sense | |
| 17:05:19 | mriedem | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ed7/638047/56/check/nova-grenade-multinode/ed76ba4/logs/ara/index.html.gz | |
| 17:05:19 | mriedem | doesn't look like it | |
| 17:05:40 | mriedem | fungi: i thought ara was replaced with the zuul dashboard console stuff? | |
| 17:06:12 | mriedem | yeah the tempest jobs don't even have ara it looks like | |
| 17:07:00 | stephenfin | damn :( | |
| 17:12:58 | KeithMnemonic | mriedem ok all done hopefully. thank again for the great feedback | |
| 17:15:39 | fungi | mriedem: effectively replaced for purposes of the ansible run directly by zuul executors, but some jobs may include an ara of their own if they do any "nested" ansible | |
| 17:15:52 | fungi | which grenade seems to do | |
| 17:15:58 | fungi | maybe | |
| 17:16:27 | fungi | i honestly don't know that much about grenade's internals, and to be perfectly honest i probably don't want to either ;) | |
| 17:17:49 | mriedem | grenade is just devstack at n-1 and devstack at master, orchestrated via devstack-gate | |
| 17:18:06 | mriedem | with some scripts to run upgrade stuff between and test that resources created on the old side are still there after the upgrade | |
| 17:18:10 | mriedem | runs tempest smoke tests | |
| 17:18:25 | mriedem | so the only ansible involved would be in d-g | |
| 17:52:01 | openstackgerrit | Nathan Kinder proposed openstack/nova master: Allow TLS ciphers/protocols to be configurable for console proxies https://review.opendev.org/679502 | |
| 18:25:05 | melwitt | mriedem: cool thank you! | |
| 18:40:23 | openstackgerrit | Merged openstack/nova stable/pike: Stabilize unshelve notification sample tests https://review.opendev.org/676677 | |
| 19:34:15 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: lxc: make use of filter python3 compatible https://review.opendev.org/676502 | |
| 19:38:20 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: lxc: make use of filter python3 compatible https://review.opendev.org/676502 | |
| 20:10:22 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Prevent init_host test to interfere with other tests https://review.opendev.org/687916 | |
| 20:10:22 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Add functional test for resize crash compute restart revert https://review.opendev.org/687913 | |
| 20:10:24 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Move restart_compute_service to a common place https://review.opendev.org/699488 | |
| 20:10:24 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Error out interrupted builds https://review.opendev.org/687918 | |
| 20:10:24 | openstack | bug 1833581 in OpenStack Compute (nova) train "instance stuck in BUILD state if nova-compute is restarted" [Low,Fix committed] https://launchpad.net/bugs/1833581 - Assigned to Balazs Gibizer (balazs-gibizer) | |
| 20:10:24 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Functional reproduce for bug 1833581 https://review.opendev.org/687917 | |
| 20:21:38 | openstackgerrit | Merged openstack/nova stable/pike: Explicitly fail if trying to attach SR-IOV port https://review.opendev.org/695408 | |
| 20:42:49 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Fix false ERROR message at compute restart https://review.opendev.org/699496 | |
| 20:49:18 | KeithMnemonic_ | mriedem thanks for your patience and +2 . have a great day | |
| 20:51:11 | mriedem | yw | |
| 20:51:15 | mriedem | my xmas gift to you | |
| 20:52:53 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/ocata: Fix incompatible version handling in BuildRequest https://review.opendev.org/660456 | |
| 20:54:56 | KeithMnemonic_ | lol | |
| 20:55:33 | KeithMnemonic_ | how far can i take it back once it merges? pike or just rocky? | |
| 20:57:03 | mriedem | heh, you skipped queens | |
| 20:57:15 | mriedem | you mean your target is pike b/c suse, but <rocky is EM | |
| 20:57:31 | mriedem | either way the question probably goes to dtroyer | |
| 20:57:56 | mriedem | i'd say if you can get it to train, stein and rocky upstream you're doing ok | |
| 20:58:43 | KeithMnemonic_ | ok rocky is fine | |
| 20:59:58 | KeithMnemonic_ | but since queen/pike are EM was not sure if i should take it there as it was sort of related to the marker/limit fix you did | |
| 21:00:15 | KeithMnemonic_ | and those went to pike | |
| 21:03:32 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: DNM: test that the ceph job is fixed on pike https://review.opendev.org/699500 | |
| 21:36:14 | mriedem | things in EM branches won't be released, and fixes in OSC would need to be released to be used by someone | |