Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2017-01-27
22:50:04 superdan I think the nova patch was running against a stale version of the grenade one,
22:50:08 superdan so it's going again now
22:50:16 superdan john fixed up a bunch of the unit and pep8 issues
22:50:34 mriedem yeah i see the series must have been rebased
22:50:38 mriedem i'll review that all again
22:51:34 superdan still getting NoValidHost on 11 tests on regular grenade ...
22:51:56 superdan jeez
22:52:05 superdan compute is still not starting because of detecting the placement config
22:52:11 mriedem i thought things were peachy this morning?
22:52:18 mriedem or was that not valid b/c of bad deps?
22:52:48 superdan yeah, I dunno now, I thought we were past that
22:53:36 mriedem maybe changing the grenade patch messed something up?
22:53:55 superdan PS3 worked. but that was the last time
22:54:11 openstackgerrit Pushkar Umaranikar proposed openstack/nova: Adopts keystoneauth with glance client. https://review.openstack.org/412634
22:54:21 superdan but I see no reason why, there's been almost no change since
22:56:53 superdan yeah no placement config in nova.conf
22:56:55 superdan grr
22:58:00 mriedem hmm,
22:58:13 mriedem we're now deploying placement before nova in grenade right?
22:58:18 superdan yeah
22:58:24 mriedem which should configure nova.conf on the primary node,
22:58:33 mriedem which would actually be newton at that point
22:58:36 mriedem since it's pre-upgrade
22:58:44 mriedem 55 is updating a newton compute i mean
22:58:57 superdan but we still call the configure bit
22:59:03 mriedem sure,
22:59:13 mriedem and that shouldn't get wiped out or anything by the 60_nova part
22:59:19 openstackgerrit Pushkar Umaranikar proposed openstack/nova: Adopts keystoneauth with glance client. https://review.openstack.org/412634
23:00:46 mriedem huh, so now both of the nova changes depend on the grenade change
23:00:50 mriedem doesn't hurt anything
23:01:02 superdan I did that because it ran against a stale grenade patch for some reason
23:01:06 superdan so when I rebased I just added it on
23:01:11 superdan didn't know why
23:01:32 superdan ahhh
23:01:47 superdan I wonder if we still need to do configure_placement_nova_compute in the 60_nova bit
23:02:02 superdan not sure why it wouldn't survive, but that's the part that gets us placemetn config
23:02:35 superdan also, what about this? http://logs.openstack.org/06/425806/6/check/gate-grenade-dsvm-neutron-ubuntu-xenial/fb281f1/logs/grenade.sh.txt.gz#_2017-01-27_20_02_44_142
23:02:38 mriedem https://review.openstack.org/#/c/424730/15/projects/55_placement/from-newton/upgrade-placement@17
23:02:47 mriedem ^ should configure nova-compute on the primary node for placement
23:02:57 superdan I know
23:03:02 superdan but
23:03:09 superdan after the run it's not set
23:03:18 superdan oh wait
23:03:26 superdan it doesn't have $NOVA_CONF in the run
23:04:16 mriedem because we didn't source the nova stuff yet?
23:04:22 superdan yeah
23:04:25 mriedem teehee
23:04:30 mriedem i believe i called this ~6 hours ago
23:04:35 superdan yes you did
23:05:18 superdan it's definitely weird doing this out of body but still part of nova
23:05:53 mriedem superdan: so do we no longer need the thing you added where it saves off the number of computes before and checks for that after?
23:06:09 superdan mriedem: that is being challenged, so I split it out
23:06:49 superdan with this set we're introducing a very specific race because the scheduler checks the min vers at startup
23:06:50 superdan which is why I think we need it
23:06:51 superdan but we haven't hit it yet, so ...
23:07:49 superdan mriedem: this is the standalone patch: https://review.openstack.org/#/c/426310/
23:08:09 superdan which I see I have tabs in.. gdi
23:17:56 mriedem ok the 55_placement thing looks good now
23:19:18 mriedem now we play the waiting game
23:21:29 superdan cool
23:21:34 superdan personally,
23:21:38 superdan I hate the effing waiting game
23:21:45 superdan I've been playing it all week and I'm done with it
23:40:59 openstackgerrit Pushkar Umaranikar proposed openstack/nova: Adopts keystoneauth with glance client. https://review.openstack.org/412634
23:42:19 openstackgerrit Pushkar Umaranikar proposed openstack/nova: Adopts keystoneauth with glance client. https://review.openstack.org/412634
23:48:16 mriedem diana_clarke: just went through https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:man - some comments inline,
23:48:21 mriedem i think there are only a few that need some tweaks
23:48:44 mriedem like discover_hosts should come after create_cell because you can't map the hosts to a cell w/o a cell
23:50:45 openstackgerrit Matt Riedemann proposed openstack/nova: DNM: hack ironic with resource providers https://review.openstack.org/426296
23:52:53 diana_clarke mriedem: Yes, thanks a ton! I'll circle back and add more detail etc monday at the latest.
23:53:32 mriedem superdan: passed http://logs.openstack.org/61/417961/40/check/gate-grenade-dsvm-neutron-multinode-ubuntu-xenial/5fb6f74/
23:53:58 superdan like, yay
23:54:21 mriedem http://logs.openstack.org/61/417961/40/check/gate-grenade-dsvm-neutron-multinode-ubuntu-xenial/5fb6f74/logs/new/screen-n-sch.txt.gz#_2017-01-27_23_44_07_736
23:54:30 mriedem 2017-01-27 23:44:07.736 12381 DEBUG nova.scheduler.filter_scheduler [req-f76d4b01-c248-4de4-8675-a4cd3cb6d4cb tempest-AttachInterfacesTestJSON-881960388 tempest-AttachInterfacesTestJSON-881960388] Skipping call to placement, as upgrade in progress. _get_all_host_states /opt/stack/new/nova/nova/scheduler/filter_scheduler.py:179
23:54:37 superdan woot
23:55:45 mriedem wonder what the whiny ass grenade + live migration job is complaining about
23:56:44 mriedem heh wtf http://logs.openstack.org/61/417961/40/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/8c363cd/logs/devstack-gate-post_test_hook.txt.gz
23:57:02 mriedem tdurakov: ^
23:57:08 mriedem grenade + live migration apparently never passes
23:57:17 superdan lol
23:57:29 mriedem http://logs.openstack.org/61/417961/40/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/8c363cd/logs/new/tempest_conf.txt.gz
23:57:39 mriedem block_migration_for_live_migration = False live_migration = False
23:58:50 melwitt I've noticed that before. when all tests are skipped, it doesn't consider that a success
#openstack-nova - 2017-01-28
00:00:45 mriedem something changed on 1/21
00:08:07 mriedem single-node grenade failed http://logs.openstack.org/61/417961/40/check/gate-grenade-dsvm-neutron-ubuntu-xenial/e16142b/
00:09:57 mriedem looks like placement didn't get installed http://logs.openstack.org/61/417961/40/check/gate-grenade-dsvm-neutron-ubuntu-xenial/e16142b/logs/new/screen-n-cpu.txt.gz?level=TRACE
00:10:00 mriedem or upgraded
00:10:28 mriedem http://logs.openstack.org/61/417961/40/check/gate-grenade-dsvm-neutron-ubuntu-xenial/e16142b/logs/new/screen-n-sch.txt.gz?level=TRACE
00:12:19 mriedem hmmm
00:12:35 mriedem superdan: in grenade, when we install placement, are we installing the newton version or ocata version?
00:13:43 superdan mriedem: well.....
00:13:50 superdan mriedem: I dunno when the git tree gets updated, let me look
00:14:03 superdan you think we're starting an old placement service which only single node grenade cares about?
00:14:07 superdan that's...a good point
00:15:10 tdurakov mriedem: double wtf http://logs.openstack.org/61/417961/40/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/8c363cd/console.html#_2017-01-27_23_16_09_271784
00:15:39 mriedem superdan: i think we're installing old placement in any grenade scenario,
00:15:53 superdan multinode doesn't care though
00:15:54 mriedem it's just that we don't fail in the multinode grenade job b/c the scheduler doesn't use placement b/c of the newton compute
00:15:56 mriedem right
00:15:59 mriedem single-node cares, and dies

Earlier   Later