Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2017-10-25
15:58:00 mriedem stephenfin: like we do here: self.stdlog = nova_fixtures.StandardLogging()
15:58:12 mriedem then you can access the attributes in the fixture from a test
15:58:13 liuyulong mriedem, great, thank you.
15:59:32 sdague stephenfin: yeh, what mriedem said
16:01:18 stephenfin mriedem, sdague: Spot on. I'll do that so
16:08:23 mriedem sdague: something i didn't think about in the flavor description spec, but i didn't say i'd return the description in GET /flavors - which is the limited response - only id, name and links
16:08:33 mriedem not sure if i should include the description or not
16:09:12 mriedem i never use GET /flavors because i want to see how much ram/cpu/disk i'm getting
16:10:25 openstackgerrit sahid proposed openstack/nova master: libvirt: disconnect volume from host during detach https://review.openstack.org/515008
16:17:09 cdent anyone have today’s count on number of different in progress changes racing for placement microversion 1.11?
16:30:33 stephenfin melwitt: Quick one - how come we don't need 'dump_inactive' for the additional call here? https://review.openstack.org/#/c/498983/4/nova/virt/libvirt/driver.py
16:32:20 melwitt stephenfin: that controls whether we pull the active (live) or inactive (persistent) config from the domain. we want to pull the live config after the volume was updated to write it back to the persistent config. does that make sense?
16:32:41 openstackgerrit Chris Dent proposed openstack/nova master: [placement] manage cache headers for inventories https://review.openstack.org/510954
16:32:41 openstackgerrit Chris Dent proposed openstack/nova master: [placement] manage cache headers for /resource_providers https://review.openstack.org/495380
16:32:42 openstackgerrit Chris Dent proposed openstack/nova master: [placement] manage cache headers for usages https://review.openstack.org/513174
16:32:42 openstackgerrit Chris Dent proposed openstack/nova master: [placement] manage cache headers for resource classes https://review.openstack.org/513161
16:32:43 openstackgerrit Chris Dent proposed openstack/nova master: [placement] manage cache headers for aggregates https://review.openstack.org/515128
16:33:02 stephenfin melwitt: Ah, that wasn't immediately obvious to me. Yup, makes sense. +2d
16:33:44 melwitt stephenfin: it could stand to have a code comment, tbh. at the time, I thought I was explaining it with the comment I added but it doesn't call out dump_inactive specifically
16:34:12 stephenfin Yeah, I added a comment to leave that in there. However, it's nit so only address if you can
16:35:17 cfriesen is there a novaclient/openstackclient command that does a GET on /os-hypervisors/detail ?
16:35:33 mriedem nova hypervisor-list?
16:35:41 cfriesen that doesn't have the detail
16:35:45 melwitt stephenfin: k, lemme do an edit on it
16:37:35 mriedem cfriesen: doesn't look like it on the CLI, the python API binding has a detailed kwarg though
16:37:41 mriedem so it could be easily added to the CLI
16:38:13 cfriesen mriedem: good, I'm not going blind.
16:38:41 mriedem although, the amount of stuff you'd get out of /detalis
16:38:42 mriedem *details
16:38:42 openstackgerrit melanie witt proposed openstack/nova master: Save updated libvirt domain XML after swapping volume https://review.openstack.org/498983
16:38:46 mriedem is a lot
16:39:28 mriedem which is why cli users would probably do hypervisor-list and then hypervisor-show on specific ones
16:39:42 cfriesen mriedem: I'm envisioning something like "nova list" where you could specify which fields you wanted.
16:41:44 openstackgerrit melanie witt proposed openstack/nova master: Save updated libvirt domain XML after swapping volume https://review.openstack.org/498983
16:47:07 arxcruz dansmith: hi, I'm having a problem with a temprest test test_volume_boot_pattern, failing with Block Device Mapping is Invalid: failed to get volume 800c3fc8-aa91-45ac-a27c-a15158582a3e
16:47:14 arxcruz the problem seems to be in nova
16:47:42 dansmith arxcruz: can you link to a CI run or something?
16:48:05 arxcruz dansmith: 2017-10-25 12:14:49.944 99098 INFO nova.api.openstack.wsgi [req-3b691589-73af-4fda-aee3-c5f962e4c8b7 - - - - -] HTTP exception thrown: Block Device Mapping is Invalid: failed to get volume 800c3fc8-aa91-45ac-a27c-a15158582a3e.
16:48:07 arxcruz this is from nova
16:48:11 arxcruz dansmith: let me check
16:49:04 dansmith arxcruz: that message likely means nova couldn't contact cinder or cinder complained
16:49:16 arxcruz dansmith: https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset006-master/0bb0995/undercloud/home/jenkins/tempest_output.log.txt.gz
16:49:22 arxcruz dansmith: there's nothing in cinder log
16:49:33 arxcruz dansmith: btw, this is tripleo
16:49:44 arxcruz dansmith: also, I have a env up on rdo-cloud if you want to take a look
16:51:43 dansmith arxcruz: okay, tripleo's log layout is hard for me to navigate, but I'm looking
16:51:56 arxcruz yeah... :/
16:52:09 dansmith arxcruz: "nothing in cinder log" meaning no big stack traces or something, right? have you tracked the request nova is making to cinder to see that it's not showing up at all?
16:52:28 arxcruz dansmith: yes, I track down, there's no request in cinder
16:52:45 dansmith arxcruz: the timestamps of the failures in tempest are *after* the latest log message in nova-api
16:52:54 arxcruz it's pretty instantly the failure when I was debuging tempest, when it calls the create_server function, it returns pretty faster
16:52:56 dansmith arxcruz: which seems unpossible
16:53:19 dansmith arxcruz: also, the log you link to is for the undercloud.. is there cinder in the undercloud?
16:53:22 arxcruz dansmith: you're talking about the line I pasted ?
16:53:34 arxcruz dansmith: no, the cinder is in overcloud
16:53:36 arxcruz just a sec
16:54:00 arxcruz dansmith: https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset006-master/0bb0995/subnode-2/var/log/
16:54:04 arxcruz logs for cinder and nova
16:54:57 dansmith arxcruz: is this 100% fail?
16:55:01 arxcruz dansmith: yes
16:55:11 mriedem arxcruz: i think i have a tempest patch for this already...
16:55:12 mriedem sec
16:55:54 arxcruz mriedem: cool :D
16:55:58 mriedem arxcruz: https://review.openstack.org/#/c/510951/ ?
16:56:02 mriedem that merged already though
16:56:22 mriedem you need to provide more details on where this actually fails, like trace the request as dan said
16:56:31 mriedem is it on attach, detach, other?
16:57:39 mriedem although that tempest patch wouldn't fix test_volume_boot_pattern which is a scenario test
16:59:28 mriedem looks like req-733a784c-6fed-48c5-a62b-3876edb56d57 is the request id
16:59:51 sdague mriedem: if it's being used to choose and understand, I sort of assumed it would be in GET /flavors
16:59:56 sdague but honestly, I can go either way
17:00:07 sdague maybe just ask the folks that wanted it
17:01:19 arxcruz mriedem: it's on test_volume_boot_pattern test, from my debug, it create the volume successfully, then when it tries to create the instance from the volume, it fails
17:01:46 arxcruz mriedem: here's the track from tempest https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset006-master/0bb0995/undercloud/home/jenkins/tempest_output.log.txt.gz#_2017-10-23_17_30_43
17:03:15 mriedem arxcruz: why don't i see the POST /servers request id in the nova-api undercloud logs? https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset006-master/0bb0995/undercloud/var/log/nova/nova-api.log.txt.gz
17:03:20 mriedem or would it be in the overcloud?
17:03:54 arxcruz in overcloud
17:04:19 arxcruz mriedem: https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset006-master/0bb0995/subnode-2/var/log/nova/nova-api.log.txt.gz
17:04:23 arxcruz this is the overcloud nova log
17:05:00 arxcruz https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset006-master/0bb0995/subnode-2/var/log/nova/nova-api.log.txt.gz#_2017-10-23_17_30_30_020
17:05:04 arxcruz the failure
17:05:40 mriedem huh, not helpful at all
17:06:56 arxcruz yeah, that's all that I can see...
17:07:04 arxcruz there's no call to cinder, just trow this error
17:07:33 mriedem in the dsvm ci logs we trace the requests to cinder via python-cinderclient
17:07:44 mriedem that would be helpful here in debugging failures in triple0 logs
17:10:42 BrazierCustoms hello. I am looking for a way to import an existing LXD container into glance for use as a base image. is this possible?
17:10:55 BrazierCustoms for nova-lxd
17:11:50 mriedem arxcruz: looks like it's getting the volume fine from the cinder-api side https://logs.rdoproject.org/openstack-periodic-4hr/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset006-master/0bb0995/subnode-2/var/log/cinder/cinder-api.log.txt.gz#_2017-10-23_17_30_30_474
17:11:54 mriedem around the time of the nova-api failure
17:11:57 BrazierCustoms I have tried searching and I have tried a couple things I thought would have worked but unsuccessful.
17:12:04 mriedem BrazierCustoms: this wouldn't be the channel for nova-lxd
17:12:10 mriedem as it's not an in-tree driver
17:12:19 BrazierCustoms i couldnt fint that either :(
17:12:30 mriedem it's in the nova-lxd repo readme i think
17:12:39 mriedem https://github.com/openstack/nova-lxd#support-and-discussions
17:12:54 BrazierCustoms thank you mriedem
17:12:59 mriedem yw
17:13:25 mriedem arxcruz: looking at the nova code that returns that exception, unfortunately we return it for just about any kind of response from cinder
17:13:59 arxcruz mriedem: yeah, i tried to adventure in the wild nova code and notice that

Earlier   Later