| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-01-11 | |||
| 21:45:10 | mriedem | dansmith: i can see your nippies from here | |
| 21:45:11 | melwitt | hah, yay | |
| 21:45:29 | mriedem | i guess that should have been in a PM | |
| 21:45:42 | dansmith | haha | |
| 21:46:11 | openstackgerrit | Vasyl Saienko proposed openstack/nova: Support Ironic interface attach/detach in nova virt https://review.openstack.org/364413 | |
| 21:51:55 | bauzas | mriedem: jaypipes: could you maybe look at https://review.openstack.org/#/c/392569/ soon ? | |
| 21:52:33 | bauzas | given it's adding a microversion, I'd make sure that this change could be quickly merged | |
| 21:52:57 | bauzas | edleafe had some comments, but I could follow-up the change | |
| 21:54:23 | bauzas | mriedem: do you know if we have a problem with the Xen 3rd party CI? | |
| 21:54:26 | bauzas | wrt https://review.openstack.org/#/c/365505/ | |
| 21:54:42 | bauzas | I'm waiting to see it there | |
| 21:54:56 | mriedem | bauzas: it was good before | |
| 21:55:22 | mriedem | bauzas: i've rechecked https://review.openstack.org/#/c/416797/ which runs the attach/detach interfaces tests on that patch | |
| 21:55:47 | mriedem | bauzas: and yeah on the placement API change, i'm trying to wrap up some of the hyperv patches and then can move on | |
| 21:56:11 | mriedem | bauzas: we should also get alex_xu and sdague to help review https://review.openstack.org/#/c/392569/ | |
| 21:56:19 | bauzas | mriedem: cool by me | |
| 21:56:59 | bauzas | mriedem: last run of XenServer for the above change was -1 with http://dd6b71949550285df7dc-dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/05/365505/22/check/dsvm-tempest-neutron-network/e2bfe3d/ | |
| 21:57:15 | bauzas | for PS22 | |
| 21:57:42 | mriedem | bauzas: that was some devstack setup issue http://dd6b71949550285df7dc-dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/05/365505/22/check/dsvm-tempest-neutron-network/e2bfe3d/logs/devstacklog.txt.gz | |
| 21:57:59 | bauzas | oh right | |
| 21:58:06 | bauzas | meh | |
| 21:58:21 | mriedem | http://dd6b71949550285df7dc-dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/97/416797/3/check/dsvm-tempest-neutron-network/d75b62d/run_tests.log was happy on 1/9 | |
| 21:58:53 | mriedem | bauzas: if you want to +2 and leave the +W to me that's fine too | |
| 21:59:08 | mriedem | given time of day i mean | |
| 21:59:13 | bauzas | mriedem: just looking at the XenServer change | |
| 21:59:26 | bauzas | I mean the tempest test removal | |
| 21:59:40 | bauzas | well, the exception removal rather | |
| 22:00:41 | bauzas | mriedem: how can we be sure that https://review.openstack.org/#/c/416797/ is run by XenServer CI ? | |
| 22:00:58 | bauzas | I'm verifying that | |
| 22:01:44 | bauzas | actually looking at the regex here http://dd6b71949550285df7dc-dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/97/416797/3/check/dsvm-tempest-neutron-network/d75b62d/run_tests.log | |
| 22:02:19 | bauzas | awesome {2} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_create_list_show_delete_interfaces [349.753425s] ... ok | |
| 22:02:25 | bauzas | mriedem: okay, +Wing it | |
| 22:02:31 | bauzas | because of ^ | |
| 22:02:58 | mriedem | http://dd6b71949550285df7dc-dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/97/416797/3/check/dsvm-tempest-neutron-network/d75b62d/logs/devstacklog.txt.gz | |
| 22:03:06 | mriedem | 2017-01-10 03:15:31.180 | + functions-common:git_clone:566 : git show --oneline 2017-01-10 03:15:31.194 | 823b053 xenapi: support the hotplug of a neutron port | |
| 22:03:10 | mriedem | tells you which nova change it's testing | |
| 22:03:17 | mriedem | which is our happy friend the vif hotplug patch | |
| 22:04:44 | mriedem | btw, easy tangential patch to the flavor notification series https://review.openstack.org/#/c/419086/ | |
| 22:04:53 | mriedem | but i'm going to mark that bp complete since the update patch is merged | |
| 22:11:06 | openstackgerrit | OpenStack Proposal Bot proposed openstack/nova: Updated from global requirements https://review.openstack.org/415978 | |
| 22:13:18 | mriedem | claudiub|2: tweak needed here :) https://review.openstack.org/#/c/140045/ | |
| 22:13:43 | mriedem | or i'll just do it if you're trying to end your day | |
| 22:14:42 | dansmith | "end your day" .. sounds ominous | |
| 22:16:35 | claudiub|2 | mriedem: i'm not trying to end my days. :D | |
| 22:16:42 | mriedem | if you're trying to rest your weary head | |
| 22:17:07 | mriedem | the plurality is significant | |
| 22:17:35 | claudiub|2 | still, VirtualInterfaceUnplugException does have a reason formatting argument, while the VirtualInterfacePlugException doesn't. | |
| 22:18:14 | claudiub|2 | i was expecting both of them to have a reason argument. | |
| 22:18:56 | claudiub|2 | https://github.com/openstack/nova/blob/f55815b2f90b934801a88e10bf750876b0587328/nova/exception.py#L132 | |
| 22:20:04 | zzzeek | mriedem: dumb Q as I am clueless. does the nova.task_log table grow unbounded and if so is that part of truncate/cleanup | |
| 22:20:29 | mriedem | claudiub|2: yeah i just noticed the same and left a comment to correct that unplug type | |
| 22:20:43 | mriedem | zzzeek: let me look | |
| 22:23:45 | mriedem | zzzeek: so it's going to be unbounded, | |
| 22:23:55 | mriedem | runs in a periodic task as long as CONF.instance_usage_audit is True | |
| 22:24:11 | openstackgerrit | Claudiu Belu proposed openstack/nova: Adds Hyper-V OVS ViF driver https://review.openstack.org/140045 | |
| 22:24:17 | mriedem | zzzeek: the archive command should move it from the nova.task_log table to the nova.shadow_task_log table | |
| 22:24:29 | mriedem | zzzeek: but nothing deletes those records as far as i know | |
| 22:24:50 | zzzeek | mriedem: OK so on a highly used nova DB i might have 30-40M rows in this thing, at least in the shadow table | |
| 22:25:17 | mriedem | sure | |
| 22:25:33 | mriedem | my understanding of this thing is it's for the REST API to pull these audit logs which ceilometer consumes | |
| 22:25:57 | zzzeek | mriedem: right, but the DB size is never mitigated | |
| 22:25:59 | mriedem | http://developer.openstack.org/api-ref/compute/#server-usage-audit-log-os-instance-usage-audit-log | |
| 22:26:02 | mriedem | zzzeek: nope | |
| 22:26:21 | mriedem | neither is...anything except for nova.tags and anything in the nova_api db | |
| 22:26:34 | zzzeek | mriedem: and...not anytime soon, but people might someday like that DB tables like these don't grow to be billions of rows? or that's how they want it | |
| 22:26:36 | mriedem | all of the old tables in the nova db use the soft delete mixin | |
| 22:27:09 | zzzeek | mriedem: right but task_log seems to be, accumulate rows just for doing things, so it's a fast grower | |
| 22:27:11 | mriedem | zzzeek: i think most operators have their own purge scripts, i know there are some in the osops tooling repos | |
| 22:27:16 | zzzeek | mriedem: OK | |
| 22:27:32 | mriedem | there was a bp at one point to add a purge cli to nova | |
| 22:27:44 | mriedem | for not archiving, no shadow tables, but delete things over a certain age | |
| 22:28:02 | mriedem | last i remember someone from red hat was looking into implementing that | |
| 22:28:07 | mriedem | i'll try to find it | |
| 22:28:36 | mriedem | zzzeek: v | |
| 22:28:37 | mriedem | https://specs.openstack.org/openstack/nova-specs/specs/mitaka/approved/purge-deleted-instances-cmd.html | |
| 22:29:23 | mriedem | ^ only addresses instances though, so that'd have to be tweaked to handle task_log | |
| 22:29:33 | mriedem | or to add something to nova to self-clean that table | |
| 22:29:44 | mriedem | like only keep audit logs under a certain age | |
| 22:30:55 | openstackgerrit | Jay Pipes proposed openstack/nova: placement: create aggregate map in report client https://review.openstack.org/407309 | |
| 22:32:59 | mriedem | zzzeek: what's even funnier/sadder about that thing, | |
| 22:33:22 | mriedem | zzzeek: is the periodic task emits a notification, which someone (ceilometer) is consuming and probably throwing that data into a time series db | |
| 22:33:36 | mriedem | so nova storing it is probably much less relevant, except for nova's own REST API | |
| 22:34:52 | zzzeek | mriedem: im on a search to figure out how big people's databases might be reasonably getting | |
| 22:35:23 | openstackgerrit | Dan Smith proposed openstack/nova: Make metadata server know about cell mappings https://review.openstack.org/417962 | |
| 22:35:24 | openstackgerrit | Dan Smith proposed openstack/nova: Multicell support for instance listing https://review.openstack.org/396775 | |
| 22:36:24 | mriedem | zzzeek: at one point not too long ago dansmith had a fairly large db for testing the archive command | |
| 22:36:38 | mriedem | dansmith: did that have task_log stuff in it? | |
| 22:36:53 | dansmith | mriedem: probably | |
| 22:36:56 | dansmith | it's in a bug somewhere | |
| 22:37:03 | mriedem | mikal might be able to get his hands on some large db with task_log in it since that feature was all added by rax people | |
| 22:37:06 | dansmith | the dump I mean | |
| 22:37:39 | mriedem | zzzeek: or jhesketh | |
| 22:38:18 | mriedem | if i had 1% more energy right now i might email the operators list asking if anyone uses the nova REST API for this feature | |
| 22:39:19 | zzzeek | mriedem: yeah i can manufacture fake large DBs with a script here am more wondering, if i went into the nova DB of some huge customer, how big would these tables be. because migrating from mariadb5.5 -> 10.1 requires a dump+ restore | |
| 22:39:35 | zzzeek | and for tens of millions of rows it's a hit | |
| 22:40:00 | mriedem | zzzeek: so i'd ask jhesketh b/c he has some large dbs for just that kind of question | |
| 22:40:12 | mriedem | zzzeek: otherwise we'd have to ask some godaddy or cern people probably | |
| 22:40:20 | zzzeek | mriedem: thanks | |
| 22:46:51 | mriedem | dansmith: so i guess on https://review.openstack.org/#/c/416585/ we have some kind of weird catch-22 because the cellsv1 job fails on that patch, but passes on your nova one that uses that | |
| 22:47:07 | mriedem | http://logs.openstack.org/85/416585/8/experimental/gate-tempest-dsvm-cells-ubuntu-xenial/e9f1fe9/console.html#_2017-01-11_19_25_38_191005 | |