Earlier  
Posted Nick Remark
#openstack-nova - 2018-11-21
16:49:11 artom Foiled again!
16:49:39 artom mriedem, in seriousness, I know y'all are overloaded, I'm just trying to get it over the line, so if you have energy/bandwidth, it'd be appreciated
16:50:59 gibi xek, mriedem: yeah, I just found that it is only emitted from the nova network code patch, this is why they are not on the todo list for versioned transformation
16:51:44 gibi xek: I don't know if neturon has a similar notification mechanism
16:52:25 xek gibi, mriedem, it makes sense, thanks for clarifying that.
16:52:30 gibi mlavalle: ^^ do you happen to know if neutron emits notification about floating ips?
17:05:48 mlavalle gibi: what kind of notification are we talking about? the code sends notifications like this: https://github.com/openstack/neutron/blob/master/neutron/db/l3_db.py#L1408
17:06:18 mlavalle These are internal notifications. modules subscribe to these notifications to listen to events and process them
17:08:11 mriedem mlavalle: yes same thing
17:08:15 mriedem over rpc
17:14:37 mriedem mnaser: let's see what explodes https://review.openstack.org/619319
17:15:55 mnaser mriedem: seems reasonable. i'll have to fix the functional tests soon
17:15:58 mnaser ugh the logs have been rotated out already
17:16:10 mriedem yeah one thing at a time
17:16:12 mriedem not urgent
17:44:57 openstackgerrit Matt Riedemann proposed openstack/nova master: Remove NovaException logging from scatter_gather_cells https://review.openstack.org/619110
18:17:53 dansmith I think Greg's windows box has a virus
18:31:48 openstackgerrit Elod Illes proposed openstack/nova master: Transform scheduler.select_destinations notification https://review.openstack.org/508506
18:39:46 jangutter dansmith: please take this as a late night bad joke: isn't that a redundant statement?
18:40:20 dansmith jangutter: yeah, maybe I should say "Greg's windows box has a virus and is proud enough to show off in public"
18:45:28 openstackgerrit Merged openstack/nova stable/queens: De-dupe subnet IDs when calling neutron /subnets API https://review.openstack.org/616551
19:10:17 openstackgerrit Matt Riedemann proposed openstack/nova master: libvirt: implement reshaper for vgpu https://review.openstack.org/599208
19:14:55 openstackgerrit Elod Illes proposed openstack/nova master: Transform scheduler.select_destinations notification https://review.openstack.org/508506
19:15:14 openstack bug 1799892 in OpenStack Compute (nova) rocky "Placement API crashes with 500s in Rocky upgrade with downed compute nodes" [Medium,In progress] https://launchpad.net/bugs/1799892 - Assigned to Matt Riedemann (mriedem)
19:15:14 openstackgerrit Merged openstack/nova stable/rocky: Add recreate test for bug 1799892 https://review.openstack.org/619075
19:24:00 mriedem easy bug fix https://review.openstack.org/#/c/615134/
19:46:32 mriedem anyone have any bright ideas on how to assert a semaphore context manager is called in unit tests? https://review.openstack.org/#/c/609180/7/nova/tests/unit/virt/libvirt/test_driver.py
19:51:56 sean-k-mooney mriedem: as in assert the semaphore was aquired on a partaclar code path?
19:52:00 sean-k-mooney just looking
19:57:31 mriedem http://paste.openstack.org/show/735916/
19:58:57 sean-k-mooney mriedem: do you want sema.__enter__.assert_called_once() or just assert it is called
19:59:56 mriedem does'nt matter
20:00:09 mriedem point is, i don't really want to add a bunch of mocks all over test code and never assert it's used
20:00:23 sean-k-mooney ah ok
20:02:40 sean-k-mooney im not sure that does what you want
20:03:27 sean-k-mooney you are asserting that the __enter__ metod of the sema context manager is called but will that not always be called by the with statement
20:03:48 mriedem if i remove the code change for that method, the test fails
20:03:53 mriedem which is what i'd expect
20:04:51 sean-k-mooney hum ok this is one of those things in python that i always have to trow in an interpreter to prove to myself it scorrect
20:06:16 mriedem i also don't know why we have nova.privsep.qemu.convert_image but not everything uses it, there are a few places in here that are calling qemu-img convert outside of privsep
20:06:43 mriedem dansmith: do you know anything about that? ^
20:06:53 mriedem b/c i thought we declared mission accomplished on privsep stuff
20:07:10 sean-k-mooney mriedem: are the fucntion that call it out side of privsep called from function with the prive sep decorator applied
20:08:00 mriedem umm, no
20:08:12 mriedem grep _disk_raw_to_qcow2 in the libvirt driver
20:08:31 mriedem it's using processutils from oslo
20:09:04 mriedem and we're passing through a rootwrap helper
20:10:09 dansmith mriedem: not everything like that needs to run privileged
20:10:13 sean-k-mooney ttp://git.openstack.org/cgit/openstack/nova/tree/nova/virt/libvirt/driver.py#n8361 is using oslo but i dont see a rootwarap helper
20:10:30 dansmith mriedem: might be that we need image convert sometimes when reading from an lvm or something like that, I dunno
20:11:15 mriedem ok i'll pretend this never happene
20:11:20 dansmith good plan
20:11:25 sean-k-mooney assuimg the nova user has the correct permisiosn to read and write the vm images it shoudl be able to execute that command with out elevating
20:11:34 mriedem jackding: so on that io concurrency change,
20:11:45 mriedem i would just like to see that for the functional code paths that add the context manager,
20:11:53 mriedem that at least one corresponding unit test asserts the context manager is called
20:12:01 mriedem like i noted for _disk_raw_to_qcow2
20:12:06 mriedem then i'm +20 on that change
20:12:21 mriedem the privsep one might not be possible
20:12:27 sean-k-mooney based on code search its only ever called once
20:12:29 sean-k-mooney http://codesearch.openstack.org/?q=_disk_raw_to_qcow2&i=nope&files=&repos=nova
20:12:51 jackding mriedem: I have added asserts for all places where sema is used. running tox now, will push after it's done.
20:12:56 sean-k-mooney here in finish migration http://git.openstack.org/cgit/openstack/nova/tree/nova/virt/libvirt/driver.py#n8437
20:13:00 mriedem jackding: sweet
20:15:35 openstackgerrit Jack Ding proposed openstack/nova master: Add I/O Semaphore to limit concurrent disk ops https://review.openstack.org/609180
20:18:34 openstackgerrit sean mooney proposed openstack/os-vif master: always create ovs port during plug https://review.openstack.org/602384
20:18:49 openstackgerrit sean mooney proposed openstack/os-vif master: add isolate_vif config option https://review.openstack.org/612534
20:18:59 openstackgerrit Matt Riedemann proposed openstack/nova stable/rocky: Default embedded instance.flavor.is_public attribute https://review.openstack.org/619349
20:28:35 openstackgerrit Matt Riedemann proposed openstack/nova stable/queens: Default embedded instance.flavor.is_public attribute https://review.openstack.org/619351
20:36:33 openstackgerrit Matt Riedemann proposed openstack/nova stable/pike: Default embedded instance.flavor.is_public attribute https://review.openstack.org/619352
20:46:52 openstackgerrit Merged openstack/nova stable/rocky: Consider root id is None in the database case https://review.openstack.org/619076
20:57:24 openstackgerrit Jack Ding proposed openstack/nova master: Add I/O Semaphore to limit concurrent disk ops https://review.openstack.org/609180
20:58:51 mriedem there are some assertions made in this change which i'm not sure i agree with https://review.openstack.org/#/c/617927/
20:58:56 mriedem hopefully that doesn't set some kind of precedent
20:59:24 mriedem saying nova supports cinder v1 is a stretch, but i wouldn't want someone to think, nova stein can't work with cinder from queens
20:59:27 mriedem because it totally should
21:20:02 openstackgerrit Merged openstack/nova master: Default embedded instance.flavor.is_public attribute https://review.openstack.org/615134
21:41:51 mriedem stephenfin: artom: i've granted your wish and reviewed the numa aware live migration spec and dumped some questions
21:42:01 mriedem artom: can you tl;dr the diff from the approved spec in rocky to stein?
21:42:25 mriedem because this essentially sounds like, do the RT/claim stuff like cold migration already does (and what nikola's old patch did)
21:42:54 mriedem was the rocky version of the spec much more dependent on actually modeling numa in placement?
21:44:07 openstackgerrit Zane Bitter proposed openstack/nova stable/rocky: Don't use private interface in oslo.service https://review.openstack.org/619360
21:44:21 sean-k-mooney the stine one has been refined somewhat to not depend on plamcennt at all
21:44:36 openstackgerrit melanie witt proposed openstack/nova-specs master: Propose counting quota usage from placement and API database https://review.openstack.org/509042
21:45:54 sean-k-mooney mriedem: it will prefrom claims in the RT on the destination node and pass back the topology info as ovo form the dest to the source the same way we did for the multi port bindings spec
21:47:41 mriedem sean-k-mooney: i just read the stein one
21:47:52 mriedem i was looking for the summary on the diff from the rocky spec
21:48:36 sean-k-mooney ah ok stephen just proposed tthe rocky one as is so the delta should just be comparing to v1 of the stein one
21:50:08 sean-k-mooney there was no content change when stepen reproposed it so https://review.openstack.org/#/c/599587/1..6/specs/stein/approved/numa-aware-live-migration.rst will show you the delta
21:51:05 sean-k-mooney basicaly we added detail for the resouce claimes section and how the nume info on the destinaiton woudl be generated
21:53:20 artom mriedem, whoa, thanks dude
21:53:43 artom What sean-k-mooney said. And also how the destination will communicate said NUMA stuff to the source
21:54:30 mriedem right, ok so no placement
21:54:31 mriedem got it
21:54:32 artom And more explicitly spelled out why we can't use just placement (even if it was ready, which it isn't) and still need the resource tracker
21:54:53 mriedem given that, i'm going to f off for thanksgiving now
21:55:05 artom Fair enough, r right off then :)
21:55:12 artom *f
21:55:13 sean-k-mooney mriedem: enjoy the break o/
21:55:52 artom I haven't fully parsed your feedback then, but I'll have a new version for you when you're back

Earlier   Later