Earlier  
Posted Nick Remark
#openstack-nova - 2017-09-27
01:46:48 mriedem i'll run that all active scenario tomorrow to see if it could be the fault stuff,
01:46:54 mriedem it's nearly 9pm so i'm not going to do it tonight
01:47:09 dansmith there was something the API was doing that made it seem way better to do this than what it was doing
01:47:19 dansmith but it's been a while now
01:48:34 dansmith we could also plumb the logic of when to load the fault into the lower layers
01:49:14 mriedem yup i was thinking that too
01:49:34 mriedem another thing that might be causing the microversion bloat, is maybe the microversion to pull the embedded flavor out of the instance
01:49:42 mriedem added in pike
01:50:01 dansmith you could run through each microversion and see where the spike is
01:50:33 dansmith the sorting layer on top of this really has nothing to do with what we're sorting though
01:50:42 dansmith it doesn't make any more copies of things, nor iterate the list more times
01:50:47 mriedem 2.47
01:51:59 dansmith so, the change right before the switchover should do the fault loading but not the sorting, so you could run against that and see if it's more like the earlier or more like the later
01:53:49 mriedem https://review.openstack.org/#/c/506774/ ?
01:53:59 mriedem like, revert that on top of the change that uses the new code in the API
01:54:00 mriedem ?
01:54:14 mriedem oh, nvm,
01:54:15 dansmith oh, I guess you were running on master already?
01:54:23 mriedem yes, new devstack as of today
01:54:38 dansmith yeah, okay
01:55:19 mriedem so 2.16 makes us join on services, 2.26 makes us join on tags, 2.47 returns instance.flavor, and your change always joins on faults
01:55:25 mriedem 2.47 is suspicious
01:55:31 mriedem since that's from instance_extra
01:55:41 dansmith but again, it shouldn't be any different
01:57:41 mriedem yeah, nvm, we also didn't start loading that in the api as of 2.47, we already pulled out instance.flavor to get the link stuff
01:59:17 mriedem totally unrelated, but when we lazy-load instance.flavor, we're still joining on system_metadata now, we should be able to stop doing that
02:00:02 dansmith yeah
02:04:40 mriedem ok, i'll run through with 1000 active instances tomorrow with your change and see if that makes a big difference, and if so, it could be the fault thing
02:05:13 dansmith alright
02:29:52 yushb JOIN #openstack-karbor
03:01:31 dansmith mriedem: I don't auto-join fault until: https://review.openstack.org/#/c/505456/10/nova/api/openstack/compute/servers.py
03:01:36 dansmith so I don't think it's the fault
03:33:50 openstackgerrit Michael Still proposed openstack/nova master: Read from console ptys using privsep. https://review.openstack.org/489486
03:33:50 openstackgerrit Michael Still proposed openstack/nova master: Move ploop commands to privsep. https://review.openstack.org/492325
03:33:51 openstackgerrit Michael Still proposed openstack/nova master: Cleanup mount / umount and associated rmdir calls https://review.openstack.org/494423
03:33:51 openstackgerrit Michael Still proposed openstack/nova master: Don't shell out to mkdir, use ensure_tree() https://review.openstack.org/492326
03:33:52 openstackgerrit Michael Still proposed openstack/nova master: Move shred to privsep. https://review.openstack.org/495537
03:33:52 openstackgerrit Michael Still proposed openstack/nova master: Move lvm handling to privsep. https://review.openstack.org/495516
03:33:53 openstackgerrit Michael Still proposed openstack/nova master: Move the idmapshift binary into privsep. https://review.openstack.org/495541
03:33:53 openstackgerrit Michael Still proposed openstack/nova master: Move xend existence probes to privsep. https://review.openstack.org/495538
03:33:54 openstackgerrit Michael Still proposed openstack/nova master: Move nbd commands to privsep. https://review.openstack.org/500351
03:33:54 openstackgerrit Michael Still proposed openstack/nova master: Move loopback setup and removal to privsep. https://review.openstack.org/495664
03:33:55 openstackgerrit Michael Still proposed openstack/nova master: Move blkid calls to privsep. https://review.openstack.org/500398
03:33:55 openstackgerrit Michael Still proposed openstack/nova master: Move kpartx calls to privsep. https://review.openstack.org/500354
03:54:40 openstackgerrit Merged openstack/nova master: Add slowest command to tox.ini https://review.openstack.org/507657
06:07:24 openstackgerrit jichenjc proposed openstack/nova master: check query param for used_limits function https://review.openstack.org/499091
06:21:07 lennyb Hi, I am working on devstack master, and my n-cond-cell1.service got stucked during stop #link http://paste.openstack.org/show/622005/. it's log is empty, no exceptions in other logs. Any tips/ideas will be appreciated.
06:37:49 openstackgerrit jichenjc proposed openstack/nova master: check query param for server groups function https://review.openstack.org/500347
06:39:06 openstackgerrit Yikun Jiang proposed openstack/nova master: Update Instance action's updated_at when action event updated. https://review.openstack.org/507473
06:57:04 openstackgerrit Lajos Katona proposed openstack/nova master: factor out compute service start in ServerMovingTest https://review.openstack.org/503037
06:57:04 openstackgerrit Lajos Katona proposed openstack/nova master: Moving more utils to ServerResourceAllocationTestBase https://review.openstack.org/499539
06:57:05 openstackgerrit Lajos Katona proposed openstack/nova master: Test resource allocation during soft delete https://review.openstack.org/495159
06:59:09 openstackgerrit Alex Xu proposed openstack/nova-specs master: Add trait support in the allocation candidates API https://review.openstack.org/497713
07:10:27 openstackgerrit Yikun Jiang proposed openstack/nova-specs master: Add pagination and changes since filter support for os-instance-action API https://review.openstack.org/507762
07:20:22 openstackgerrit Yikun Jiang proposed openstack/nova-specs master: Add pagination and changes since filter support for os-instance-action API https://review.openstack.org/507762
07:25:09 openstackgerrit Zhenyu Zheng proposed openstack/nova stable/pike: Mention API behavior change when over quota limit https://review.openstack.org/507769
07:58:42 openstackgerrit Zhenyu Zheng proposed openstack/nova master: nova-manage db archive_deleted_rows is not multi-cell aware https://review.openstack.org/507486
08:30:57 gibi johnthetubaguy: hi! do you have any comments on http://lists.openstack.org/pipermail/openstack-dev/2017-September/122658.html ? mikal has already stated that rackspace private cloud is not using it http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2017-09-26.log.html#t2017-09-26T19:57:03
08:49:54 openstackgerrit Balazs Gibizer proposed openstack/nova master: Remove dead code of api.fault notification sending https://review.openstack.org/505164
08:56:37 ralonsoh dansmith: hi, can I talk about https://review.openstack.org/#/c/449257/42/nova/objects/instance_pci_requests.py?
08:58:32 johnthetubaguy gibi: I am very far removed from if that would be used now
08:59:05 johnthetubaguy gibi: I believe the context around that was providing an SLA that involved knowing about the 500 errors in the API, and doing bug fixes to reduce them
08:59:42 johnthetubaguy gibi: i.e. the SLA is related to the % of 5xx errors from the API, so errors in the API are really important to those folks
09:00:48 johnthetubaguy gibi: I don't remember using those notifications myself, mostly got that data from ELK when I was last looking at that stuff
09:01:26 johnthetubaguy gibi: tl;dr +1 on killing it
09:02:46 gibi johnthetubaguy: thanks for the info
09:02:54 johnthetubaguy gibi: np
09:04:07 stephenfin gibi: Super easy docs patch needing another +2 here, if you're twiddling your thumbs at any point today :) https://review.openstack.org/#/c/502105/
09:04:20 stephenfin Well, kinda easy
09:04:39 gibi stephenfin: I will look shortly
09:04:46 stephenfin no rush
09:29:57 openstackgerrit Moshe Levi proposed openstack/nova master: Don't overwrite binding-profile https://review.openstack.org/505613
09:42:05 gibi stephenfin: left some comments in https://review.openstack.org/#/c/502105/
09:42:24 stephenfin gibi: On it. Thanks :)
09:42:57 gibi stephenfin: sorry for being picky. I can accept if most of my comments are fixed in a followup
09:43:51 gibi stephenfin: the only thing that I think is a must https://review.openstack.org/#/c/502105/1/doc/source/cli/nova-compute.rst@25
09:47:48 gibi stephenfin: if you need something to review then I can suggest this test improvement series https://review.openstack.org/#/c/499539/ :)
09:50:02 openstackgerrit Zhenyu Zheng proposed openstack/nova master: nova-manage db archive_deleted_rows is not multi-cell aware https://review.openstack.org/507486
10:12:26 openstackgerrit Stephen Finucane proposed openstack/nova master: doc: Rework man pages https://review.openstack.org/502105
10:52:06 openstackgerrit Lee Yarwood proposed openstack/python-novaclient stable/newton: Fix aggregate_update name and availability_zone clash https://review.openstack.org/507816
11:06:46 alex_xu gmann: sorry, I can't make the api meeting today, have cold today, headache
11:27:33 cdent efried: you on the scene yet?
11:28:20 cdent efried: when you are, I’ve got a few questions about non-openstack managed workloads
11:46:27 openstackgerrit Lajos Katona proposed openstack/nova master: Change live_migrate tests to use fakedriver https://review.openstack.org/505202
11:57:18 manasm bauzas: you may want to take a look at https://bugs.launchpad.net/nova/+bug/1719859 .
11:57:19 openstack Launchpad bug 1719859 in OpenStack Compute (nova) "Resize failure due to instance group being None in request spec" [Undecided,New]
12:35:41 openstackgerrit Yikun Jiang proposed openstack/nova master: Update Instance action's updated_at when action event updated. https://review.openstack.org/507473
12:42:25 gmann alex_xu: oh, i also do not have much for this week. we can cancel the meeting
12:42:36 gmann alex_xu: take rest and get well soon
12:53:16 tssurya Hi, I was just playing around with cell_v2 and came across the nova-manage cell_v2 map_instances command; so I went through the source code (manage.py) but was not able to find a connection as to which sql_connection string is used to query the 'instances' table in the nova DB. It should be taking this from the conf file ? But could someone point me to the section of code that does this ?
13:00:36 sdague tssurya: it's coming from the same nova.conf that your API server is expected to be using
13:01:10 sdague tssurya: all nova-manage commands are assumed to be run from the shell on the API server (and have the same db access)
13:03:36 openstackgerrit zhangyangyang proposed openstack/nova master: Move libvirts qemu-img support to privsep. https://review.openstack.org/507848
13:05:12 tssurya sdague : thanks for the reply, so here is my situation : I have some instances lying in my nova_cell1 DB which need to be mapped to my new cell (cell1). however the db access URL for this is inside nova_cell1.conf ? so when I run the map instances command, they do not get mapped.
13:06:42 tssurya sdague: I think its because the queries are sent to the nova_cell0 DB since nova.conf has that access url.
13:07:29 efried cdent Yo
13:07:52 openstackgerrit zhangyangyang proposed openstack/nova master: Move libvirts qemu-img support to privsep https://review.openstack.org/507848
13:08:13 cdent efried: yo
13:09:27 cdent efried: my question is basically: in powervm does the thing which is the actual hypervisor ever host workloads that are not managed by nova. The comments on this bug for context: https://bugs.launchpad.net/nova/+bug/1718212
13:09:28 openstack Launchpad bug 1718212 in OpenStack Compute (nova) "Compute resource tracker does not report correct information for drivers such as vSphere" [Medium,In progress] - Assigned to Radoslav Gerganov (rgerganov)

Earlier   Later