Earlier  
Posted Nick Remark
#openstack-nova - 2017-05-15
13:31:35 mriedem edleafe: i won't be able to make the scheduler meeting in 30 minutes, not sure how much was going to be talked about besides recaps from summit discussions
13:33:06 mriedem edleafe: for the most part claims in the scheduler/conductor had agreement from ops, although they still wanted us to pass the chosen hosts down to the cell conductor for retries
13:33:31 ArchiFleKs bauzas: yes I mean even if i enable configdrive inside a Nova::Server heat resource, it will still use the API and apply the limits
13:33:46 mriedem edleafe: and https://review.openstack.org/#/c/463597/ came up as a side item during that discussion, as just a good to have
13:37:45 mriedem johnthetubaguy: doing summit recaps is going to be weird this time because there weren't a set of vertical 'nova' tracks; were you going to provide a recap of the 3 vm/bm sessions to the ML/
13:37:46 mriedem ?
13:37:49 mriedem b/c i didn't make it to all of them
13:39:16 edleafe mriedem: thanks for the info. I'm sure we will discuss all of that at the meeting.
13:39:24 edleafe mriedem: I know I'll be asking about it :)
13:40:31 mriedem edleafe: cool; notes are in https://etherpad.openstack.org/p/BOS-forum-cellsv2-developer-community-coordination and https://etherpad.openstack.org/p/BOS-forum-move-claims-from-compute-to-scheduler
13:40:46 mriedem i'll try to do some high level recaps in the ML this week
13:41:26 mriedem Kevin_Zheng: were you going to update https://review.openstack.org/#/c/459593/ soon?
13:42:45 mriedem avolkov: btw thanks for the sqla make_url tip
13:43:32 Kevin_Zheng mriedem: yeah, I will update tomorrow, btw, I left one remaining comment about deleting tags, could you have a look?
13:43:34 ildikov stvnoyes1: on my list, thanks for the heads up
13:43:58 mriedem Kevin_Zheng: this? https://review.openstack.org/#/c/459593/10/nova/conductor/manager.py@1086
13:44:28 Kevin_Zheng Ah yes
13:44:34 mriedem :)
13:45:52 Kevin_Zheng mriedem: thanks, we are flying to Suzhou tomorrow and I will update it tomorrow evening or the day after that
13:45:52 edleafe Scheduler subteam meeting in 15 minutes in #openstack-meeting-alt
13:47:19 bauzas edleafe: just in case you don't know, I'm working on updating my series
13:47:40 bauzas edleafe: please stop updating your ones, given I'd prefer you reviewing mine
13:50:20 avolkov mriedem: you're welcome
13:51:21 mriedem Kevin_Zheng: thanks
13:57:30 edleafe bauzas: I saw your notes
13:58:04 bauzas ack
14:02:49 edleafe Scheduler subteam meeting going on now in #openstack-meeting-alt
14:13:55 lyarwood slaweq_: https://bugs.launchpad.net/nova/+bug/1690819 FYI, I'm also seeing that in F25
14:13:55 openstack Launchpad bug 1690819 in OpenStack Compute (nova) "nova-manage [..] api_db sync on F25 results in RuntimeError: no suitable implementation for this system" [Undecided,New]
14:23:11 sdague lyarwood: that's a blow up deep in monotonic
14:23:41 sdague lyarwood: I wonder why it's blowing up there
14:25:28 lyarwood sdague: yeah this is odd, stepping through this in a venv now and getting the following trace http://paste.openstack.org/show/609576/
14:27:01 openstackgerrit Mathieu Gagné proposed openstack/nova master: Add ability to signal and perform online volume size change https://review.openstack.org/454322
14:27:20 artom So, I tried find_library('foo') and it just returns False, without blowing up...
14:30:37 bauzas oh man
14:31:23 bauzas I was about to write a reservoir sampling method for getting a random subset of a long iterator
14:31:52 bauzas until I just discovered that we put all the hosts in memory after weighing those !
14:32:04 bauzas so, weighed_hosts is a full list
14:32:19 bauzas I thought we were smarter
14:33:49 bauzas like getting weights for each of the items of an iterator and just sorting them by indexes instead of putting all in memory
14:33:55 bauzas fairly inefficient
14:36:01 stvnoyes1 nova core: review 'add Cinder v3 detach to shutdown_instance' - https://review.openstack.org/#/c/463987/ - it has a +2, but it needs a workflow +1. thanks.
14:36:10 bauzas oh man, even the filtering creates a list...
14:36:48 bauzas so, we're gentle with operators by using iterators when getting a full list from DB, but then we put that all in memory once we loop over filters
14:36:58 bauzas and then we do that again with weighers
14:37:12 bauzas so we basically duplicate the size in memory
14:38:14 bauzas ^ that could be a problem with large deployments
14:39:22 lyarwood sdague / artom ; I think it's https://github.com/eventlet/eventlet/issues/401 , I can't reproduce with eventlet 0.20.1
14:41:19 sean-k-mooney sfinucan: hi o/, back from boston?
14:41:58 sdague lyarwood: yeh, that seems likely, I wonder why you are hitting it consistently but it's not showing up other places
14:46:34 lyarwood sdague: no idea, we have eventlet==0.21.0 in the gate at the moment
14:47:12 sdague lyarwood: I guess it's a race, I wonder if your env is on the slower or faster side of things
14:47:20 sdague just to figure out when things expose
14:49:07 lyarwood sdague: hopefully on the faster side vs the gate given it's the only heavy workload on my current pretty beefy host
14:50:36 openstackgerrit Matt Riedemann proposed openstack/nova master: Make discover_hosts only query for unmapped ComputeNode records https://review.openstack.org/427903
14:58:37 mriedem jaypipes: https://review.openstack.org/#/c/427903/ is the last piece in the 'make auto-discover_hosts faster' series
14:59:01 jaypipes mriedem: k, will review. currently on a plane out to China...
14:59:08 jaypipes mriedem: spotty internet..
14:59:10 mriedem oh fun
15:01:14 alex_xu jaypipes: $20 for more than 10 hours flight, it is totally worth :)
15:03:13 openstackgerrit Monty Taylor proposed openstack/nova master: WIP Add description of server addresses objects https://review.openstack.org/464331
15:05:07 jaypipes mriedem: done.
15:05:23 mriedem thanks
15:05:34 jaypipes alex_xu: still on way to LAX first, then the biggie. :)
15:06:59 jaypipes mriedem, sdague, anyone: seen this? from monotonic import monotonic as now # noqa
15:07:00 jaypipes RuntimeError: no suitable implementation for this system
15:07:00 jaypipes
15:07:00 jaypipes File "/home/jaypipes/src/git.openstack.org/openstack/nova/.tox/functional/local/lib/python2.7/site-packages/monotonic.py", line 169, in <module>
15:07:00 jaypipes raise RuntimeError('no suitable implementation for this system')
15:07:26 jaypipes just installed a fresh venv for tox/functional...
15:07:38 mriedem i have no
15:07:40 mriedem *not
15:07:51 artom jaypipes, there's been some chatter about it, yeah
15:07:57 artom jaypipes, see lyarwood's link above
15:08:10 artom https://github.com/eventlet/eventlet/issues/401
15:09:25 lyarwood & https://bugs.launchpad.net/nova/+bug/1690819
15:09:25 openstack Launchpad bug 1690819 in OpenStack Compute (nova) "nova-manage [..] api_db sync on F25 results in RuntimeError: no suitable implementation for this system" [Undecided,New]
15:09:45 lyarwood jaypipes: going back to eventlet 0.20.1 works around the issue for now btw
15:09:51 lyarwood for me at least
15:11:19 sdague that looks like it landed today
15:11:47 jaypipes lyarwood, artom: thx much for the help!
15:12:01 jaypipes yet another buggy eventlet release...
15:12:19 artom Well, if you monkey-patch all evarything...
15:12:46 jaypipes indeed.
15:13:48 sdague I proposed a revert on it - https://review.openstack.org/#/c/464664/
15:17:09 jaypipes sdague: cool, cheers
15:27:17 artom mriedem, mind checking out https://review.openstack.org/#/c/415520/33 again? There's a link down there to the passing Tempest test. Thanks :)
15:27:27 mriedem yeah
15:27:50 cfriesen has anyone looked at the "fairness" behaviour of the oslo_concurrency.Lock() and Semaphore() and RWLock()? We're seeing some indications that if one eventlet drops the lock and immediately reaquires it then it can "starve" other eventlets waiting on the same lock.
15:29:17 mriedem dansmith: see alex_xu's question here https://review.openstack.org/#/c/461532/4/nova/compute/api.py - was there a reason we didn't do a 409 on HostAPI.compute_node_get when there are duplicates? apparently i pointed that out in the original review but never published my comments until just now.
15:31:07 dansmith mriedem: will looks when I'm off this cal
15:43:31 openstackgerrit Mathieu Gagné proposed openstack/nova master: Add ability to signal and perform online volume size change https://review.openstack.org/454322
15:46:04 ralonsoh Hi, I have bug related to SR-IOV. When a PF is attached again to the OS (detached from the VM), the VF config (sriov_numvfs) is unset
15:46:09 ralonsoh #link https://bugs.launchpad.net/nova/+bug/1679703
15:46:09 openstack Launchpad bug 1679703 in OpenStack Compute (nova) "Unable to boot instance with VF( direct-port ) because the PF is not online" [Undecided,New] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez)
15:46:30 ralonsoh I propose two ideas in the bug. Do you have any feedback?
15:47:02 ralonsoh IMO, the second one is cheaper and easier
15:56:50 openstackgerrit Jay Pipes proposed openstack/nova master: placement: tests for non-shared with shared https://review.openstack.org/461899
15:56:50 openstackgerrit Jay Pipes proposed openstack/nova master: placement: test for agg association not sharing https://review.openstack.org/461901
15:56:51 openstackgerrit Jay Pipes proposed openstack/nova master: placement: test non-shared out of inventory https://review.openstack.org/461900

Earlier   Later