| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-06-04 | |||
| 20:57:05 | mordred | efried: aroo? | |
| 20:59:46 | efried | mordred: See https://bugs.launchpad.net/nova/+bug/1775075 and https://review.openstack.org/#/c/510947/1/nova/context.py@121 | |
| 20:59:47 | openstack | Launchpad bug 1775075 in OpenStack Compute (nova) "EndpointNotFound raised by Pike n-cpu when running alongside Queens n-api" [Undecided,New] | |
| 21:00:59 | efried | mordred: What lyarwood is finding is that when he adds 'volumev2' back in on the queens side, it fixes the problem. Which I don't quite understand why doing that on the *queens* side would fix. Because that guy has os-service-types and the right ksa... oh, unless this is one of those ksa bugs we've since fixed, where endpoint lookup isn't happening right. | |
| 21:02:10 | lyarwood | efried: so the Pike side is looking for the cinderv2 endpoint in the catalog stashed in the request context | |
| 21:02:28 | lyarwood | efried: the cinderv3 endpoint is there correctly, but without the cinderv2 endpoint it just fails | |
| 21:02:37 | mordred | efried: probably. when you say "queens side" and "pike side" - what does that mean here? | |
| 21:02:51 | lyarwood | mordred: queens n-api, pike n-cpu | |
| 21:02:56 | mordred | gotcha | |
| 21:03:49 | mordred | yah - I think you'll need the volumev2 in there until everything is on queens - I think efried is correct about there being missing fixes | |
| 21:05:11 | lyarwood | oh I forgot to say that our P n-cpu's have catalog_info=volumev2:cinderv2:internal in nova.conf forcing them to look for cinderv2 | |
| 21:06:19 | efried | ah | |
| 21:06:31 | efried | well then yeah | |
| 21:06:38 | lyarwood | yeah my bad, the default is cinderv3 right? | |
| 21:06:48 | efried | so is this a bug in the code, or is this something that should be fixed via conf on site? | |
| 21:07:21 | lyarwood | I'd say code still if possible | |
| 21:08:10 | efried | lyarwood: Is there a similar argument for restoring 'volume' ? | |
| 21:08:41 | lyarwood | efried: yeah assuming you could set catalog_info to look for it | |
| 21:11:12 | efried | lyarwood: tbc, this patch doesn't exist on pike, right? | |
| 21:11:19 | efried | https://review.openstack.org/#/c/510947/ that is | |
| 21:11:28 | lyarwood | efried: correct | |
| 21:11:31 | lyarwood | efried: just Queens | |
| 21:12:13 | efried | lyarwood: Okay, well, restoring 'volume' is not necessary because https://review.openstack.org/#/c/409904/ | |
| 21:12:45 | efried | lyarwood: But volumev2 was dropped in q (https://review.openstack.org/#/c/501874/) | |
| 21:13:09 | efried | lyarwood: So I guess unless queens n-api can talk to ocata n-cpu? Is that a thing? | |
| 21:13:40 | lyarwood | efried: nope, shouldn't be. | |
| 21:14:17 | efried | okay. Then I suppose restoring volumev2 on the premise that q can talk to p is a reasonable thing. Though I'm still confused as to why the problem would manifest if the endpoint lookup is being done on the q side. | |
| 21:14:52 | efried | lyarwood: Do you have the ability to check whether upgrading ksa (without reintroducing 'volumev2' in that RequestContext filter) also fixes the problem? | |
| 21:15:13 | lyarwood | efried: on the Q n-api host? | |
| 21:15:38 | efried | yeah - upgrade ksa and service-types-authoryt. | |
| 21:15:42 | efried | authority | |
| 21:15:58 | efried | lyarwood: That would give us the info as to whether the issue lies with missing ksa fixes, as mordred quasi-corroborated. | |
| 21:16:13 | lyarwood | efried: just to the latest stable versions I assume? | |
| 21:16:20 | lyarwood | efried: I can give that a try | |
| 21:16:26 | efried | lyarwood: yeah, that should be adequate. | |
| 21:20:51 | mordred | latest ksa SHOULD make this happier | |
| 21:27:02 | lyarwood | efried / mordred ; still fails with ksa 3.7.0 | |
| 21:27:42 | efried | lyarwood: Okay, that's an interesting data point. Are you sure the RequestContext itself is really going across the wire, complete with its service catalog? | |
| 21:28:28 | efried | lyarwood: If the cached service catalog is being stripped, but the remainder of the context is being trasmitted, then that would certainly cause the problem. Because the pike side doesn't have os-service-types so it doesn't know what to do with 'block-storage'. | |
| 21:29:10 | efried | or maybe we haven't looked up (the cinder endpoint in) the service catalog yet by the time it's being sent over. | |
| 21:29:39 | lyarwood | efried: yeah I'm sure, cinderv3 is there when it's going over the wire from Q | |
| 21:30:06 | efried | lyarwood: Ohh, because the queens side would be using the cinderv3 endpoint. | |
| 21:30:12 | efried | lyarwood: But the pike side wants the v2 endpoint. | |
| 21:30:23 | lyarwood | efried: yeah indeed | |
| 21:30:51 | efried | So if the q request context only looked up v3, even if it sent the cached service catalog over the wire, the p side wouldn't see the v2 endpoint in it. | |
| 21:31:51 | lyarwood | efried: it's actually finding both before we hit nova/context.py iirc | |
| 21:32:06 | efried | lyarwood: But would have no reason to load up the discovery info for v2 | |
| 21:32:08 | lyarwood | efried: on Q, but we then strip cinderv2 out causing the problem | |
| 21:32:20 | efried | oh, I see, yes. | |
| 21:32:42 | efried | lyarwood: IMO the bug sounds like we shouldn't be sending the RequestContext from Q to P. But we're not gonna fix that at this point. Adding volumev2 back in sounds like the less intrusive fix. | |
| 21:46:49 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/queens: Allow cinderv2 endpoints within the request context catalog https://review.openstack.org/572213 | |
| 21:47:25 | lyarwood | efried: ^ I'll follow up with more tests in the morning. | |
| 21:47:30 | lyarwood | efried: thanks again :) | |
| 21:47:35 | efried | lyarwood: Thank you | |
| 22:08:02 | openstackgerrit | David Bingham proposed openstack/nova master: Adding apply_cells to nova-manage to enable automated cells_v2 configuration. https://review.openstack.org/572216 | |
| 22:28:25 | openstackgerrit | David Bingham proposed openstack/nova master: Adding apply_cells to nova-manage to enable automated cells_v2 configuration. https://review.openstack.org/568987 | |
| 22:36:22 | kb__ | I am running Mitaka with log leve in nova.conf set to INFO.. I want to capture the compute host info in any of the nova-*.logs . Setting up Verbose=True doesn't help, only setting debug=True in the nova.conf displays the compute host info. | |
| 22:36:34 | kb__ | Is there a way to display compute host info while having log level set to INFO. | |
| #openstack-nova - 2018-06-05 | |||
| 00:09:29 | openstackgerrit | Tsuyoshi Nagata proposed openstack/nova master: openstack server add volume fails over 26vols https://review.openstack.org/567472 | |
| 00:14:02 | openstackgerrit | Chris Dent proposed openstack/nova master: [placement] Do not import oslo_service for log_options https://review.openstack.org/572231 | |
| 01:31:14 | openstackgerrit | tianhui proposed openstack/nova master: Fix bug for hypervisors https://review.openstack.org/572063 | |
| 02:09:47 | pvc | hi | |
| 02:16:10 | openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: Fix wrong commands in launch-from-volume doc https://review.openstack.org/572241 | |
| 02:19:46 | pvc | Filter PciPassthroughFilter returned 0 hosts | |
| 02:45:27 | pvc | qemu unexpectedly | |
| 02:45:31 | pvc | libvirtError: internal error: qemu unexpectedly closed the monitor: 2018-06-05T02:43:47.447602Z qemu-kvm: -device vfio-pci,host=01:00.0,id=hostdev0,bus=pci.0,addr=0x5: vfio error: 0000:01:00.0: group 1 is not viable | |
| 02:48:18 | openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Use ThreadPoolExecutor for max_concurrent_live_migrations https://review.openstack.org/563505 | |
| 02:48:53 | pvc | gibi | |
| 02:48:58 | pvc | libvirtError: internal error: qemu unexpectedly closed the monitor: 2018-06-05T02:43:47.447602Z qemu-kvm: -device vfio-pci,host=01:00.0,id=hostdev0,bus=pci.0,addr=0x5: vfio error: 0000:01:00.0: group 1 is not viable | |
| 02:56:23 | pvc | Hi all can some help me vfio error: 0000:01:00.0: group 1 is not viable | |
| 04:47:19 | openstackgerrit | Bhagyashri Shewale proposed openstack/nova master: libvirt: Don't report DISK_GB if sharing https://review.openstack.org/560459 | |
| 05:10:14 | openstackgerrit | Chris Dent proposed openstack/nova master: [placement] Do not import oslo_service for log_options https://review.openstack.org/572231 | |
| 05:27:56 | pvc | hi | |
| 05:27:59 | pvc | hi | |
| 05:28:01 | pvc | can i ask? | |
| 05:38:40 | openstackgerrit | Merged openstack/nova stable/ocata: libvirt: Report the virtual size of RAW disks https://review.openstack.org/568382 | |
| 06:30:45 | openstackgerrit | Zhenyu Zheng proposed openstack/nova master: WIP abort live migration in queue. https://review.openstack.org/568542 | |
| 06:47:46 | openstackgerrit | tianhui proposed openstack/nova master: Fix bug to doc https://review.openstack.org/572268 | |
| 07:11:45 | openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: Microversion 2.63 - Use new format policy in server group https://review.openstack.org/567534 | |
| 07:12:05 | openstackgerrit | jichenjc proposed openstack/nova master: z/VM Driver: Initial change set of z/VM driver https://review.openstack.org/523387 | |
| 07:12:06 | openstackgerrit | jichenjc proposed openstack/nova master: z/VM Driver: Spawn and destroy function of z/VM driver https://review.openstack.org/527658 | |
| 07:12:07 | openstackgerrit | jichenjc proposed openstack/nova master: z/VM Driver: add snapshot function https://review.openstack.org/534240 | |
| 07:12:08 | openstackgerrit | jichenjc proposed openstack/nova master: z/VM Driver: add power actions https://review.openstack.org/543340 | |
| 07:12:09 | openstackgerrit | jichenjc proposed openstack/nova master: z/VM Driver: add get console output https://review.openstack.org/543344 | |
| 07:20:31 | openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: Fix wrong commands in launch-from-volume doc https://review.openstack.org/572241 | |
| 07:28:12 | openstackgerrit | Chris Dent proposed openstack/nova master: Re-base placement object unit tests on NoDBTestCase https://review.openstack.org/572279 | |
| 07:28:13 | openstackgerrit | Chris Dent proposed openstack/nova master: Move db using provider unit tests to functional https://review.openstack.org/572280 | |
| 07:28:14 | openstackgerrit | Chris Dent proposed openstack/nova master: Move db using allocation unit tests to functional https://review.openstack.org/572281 | |
| 07:28:15 | openstackgerrit | Chris Dent proposed openstack/nova master: Remove nova dependencies from test_resource_provider https://review.openstack.org/572282 | |
| 07:39:02 | openstackgerrit | Bhagyashri Shewale proposed openstack/python-novaclient master: Modify novaclient to support basic attributes. https://review.openstack.org/572285 | |
| 07:56:16 | openstackgerrit | Naichuan Sun proposed openstack/nova master: xenapi(N-R-P): Add API to support vgpu resource provider create https://review.openstack.org/520313 | |
| 08:01:09 | tssurya | good morning gibi, whenever you have the time could you confirm the comment from mriedem in this spec https://review.openstack.org/#/c/557369/1/specs/rocky/approved/handling-down-cell.rst regarding the Notifications impact ? | |
| 08:01:35 | tssurya | thanks in advance! | |
| 08:22:59 | jangutter | Good morning! In the spirit of spec review day, is anyone interested in reviewing a spec for a $network $thingy? As a pleasant side effect, hopefully one more legacy VIF can be moved to os-vif. https://review.openstack.org/#/c/567148/ | |
| 08:34:52 | openstackgerrit | jichenjc proposed openstack/nova master: Enhance api-guide general info some updates https://review.openstack.org/561773 | |
| 08:37:27 | openstackgerrit | jichenjc proposed openstack/nova master: Trivial: let internal use only func has _ prefix https://review.openstack.org/572304 | |
| 08:39:34 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Fix some wrong urls in doc https://review.openstack.org/571147 | |
| 08:54:27 | openstackgerrit | jichenjc proposed openstack/nova master: Enhance api-guide general info some updates https://review.openstack.org/561773 | |
| 08:58:09 | gibi | tssurya: good morning! looking... | |
| 09:31:56 | gibi | tssurya: left couple of comments. But I agree with Matt that there is no notification impact | |