| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-04-13 | |||
| 14:11:53 | mriedem | or demigod if you like | |
| 14:12:07 | mriedem | fief lord seems more appropriate | |
| 14:12:14 | lbragstad | yeah | |
| 14:12:53 | mriedem | johnthetubaguy: my main question was can we split fixing the db issue (the trove service user 404 case) from the scope check overhaul? | |
| 14:13:06 | mriedem | because the former i think i understand the mechanics of, the latter i don't so much | |
| 14:13:18 | johnthetubaguy | mriedem: I don't believe we can | |
| 14:13:26 | johnthetubaguy | mriedem: I think one check is there to replace the other | |
| 14:13:29 | mriedem | i figured that would be the answer | |
| 14:13:49 | johnthetubaguy | mriedem: is it worth a quick hangout? | |
| 14:13:59 | mriedem | in that case, you have to answer my gauntlet of questions in the scope check section | |
| 14:14:16 | johnthetubaguy | yeah, heading down them now | |
| 14:14:16 | mriedem | we could, | |
| 14:14:26 | mriedem | would be good if it were more than just me though | |
| 14:15:49 | johnthetubaguy | mriedem: very true, I wonder if sdague and lbragstad would be up for it? | |
| 14:16:01 | sdague | ?? | |
| 14:16:16 | lbragstad | ? | |
| 14:17:00 | johnthetubaguy | wondering about a quick hangout | |
| 14:17:06 | johnthetubaguy | around policy stuff, with mriedem | |
| 14:17:15 | sdague | sure, give me 2 minutes, then I could do it | |
| 14:17:25 | lbragstad | I have some time now - meeting in 45 | |
| 14:17:47 | johnthetubaguy | lbragstad: same here | |
| 14:17:53 | johnthetubaguy | well, same meeting | |
| 14:17:54 | openstackgerrit | Monty Taylor proposed openstack/python-novaclient master: Add novaclient client_name and client_version to user-agent https://review.openstack.org/456638 | |
| 14:17:58 | lbragstad | johnthetubaguy :) | |
| 14:18:55 | sdague | ok, well let me know when | |
| 14:19:15 | johnthetubaguy | policy hangout: https://hangouts.google.com/call/5zxc7sggwndgrcihsydb5o37mmy | |
| 14:19:23 | johnthetubaguy | mriedem: lbragstad: sdague: ^ | |
| 14:19:30 | mriedem | johnthetubaguy: i'll also be totally honest and say i worry about starting a new big slog of changes like this, when we have some things we haven't completed yet from previous releases | |
| 14:20:02 | mordred | jamielennox|away: ^^ see 456638 and double-check me that that's right before I do it for the other clients | |
| 14:20:05 | johnthetubaguy | mriedem: I kinda thought we finished the conf now, hence opening this up | |
| 14:21:05 | mriedem | my av is all screwed up | |
| 14:21:08 | openstackgerrit | Sergey Nikitin proposed openstack/nova-specs master: PCI NUMA Policies https://review.openstack.org/361140 | |
| 14:21:15 | johnthetubaguy | mriedem: your mic was working great | |
| 14:21:27 | mriedem | oh, no audio for me :) | |
| 14:22:26 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: Delete nic metadata when detaching interface https://review.openstack.org/435387 | |
| 14:22:26 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: Plumbing for tagged nic attachment https://review.openstack.org/415622 | |
| 14:22:27 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: Libvirt support for tagged volume attachment https://review.openstack.org/418100 | |
| 14:22:30 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: Delete disk metadata when detaching volume https://review.openstack.org/435082 | |
| 14:22:33 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: Plumbing for tagged volume attachment https://review.openstack.org/391941 | |
| 14:22:35 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: API support for tagged device attachment https://review.openstack.org/376021 | |
| 14:22:36 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: Libvirt support for tagged nic attachment https://review.openstack.org/415520 | |
| 14:31:39 | mriedem | johnthetubaguy: i meant https://blueprints.launchpad.net/nova/+spec/prep-for-network-aware-scheduling-pike specifically, but we have other things too | |
| 14:33:30 | mriedem | sfinucan: dansmith: bauzas: easy fix https://review.openstack.org/#/c/455183/ | |
| 14:34:19 | sfinucan | mriedem: I see your change and raise you https://review.openstack.org/#/c/456227/ | |
| 14:34:43 | mriedem | clarkb: looks like we have a new set of live migration failures since the UCA change http://logs.openstack.org/83/455183/5/check/gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial/38fe0cd/logs/screen-n-cpu.txt.gz?level=TRACE#_2017-04-13_11_58_36_986 - not sure if it's related to the other things we've already seen and UCA was meant to fix, i.e. the i/o error | |
| 14:34:58 | bauzas | mriedem: looks like the live-mig job is bonkers | |
| 14:35:01 | mriedem | sfinucan: that tab was already open :) | |
| 14:35:14 | mriedem | it is http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Live%20Migration%20failure%3A%20operation%20failed%3A%20Failed%20to%20connect%20to%20remote%20libvirt%20URI%5C%22%20AND%20message%3A%5C%22End%20of%20file%20while%20reading%20data%3A%20sh%3A%201%3A%20nc%3A%20not%20found%3A%20Input%2Foutput%20error%5C%22%20AND%20tags%3A%5C%22screen-n-cpu.txt%5C%22&from=7d | |
| 14:37:54 | kashyap | sfinucan: I'm obviously not a "core", but there's nothing inherently wrong with "two RH +2s" | |
| 14:38:02 | kashyap | Assuming they're acting in good faith | |
| 14:38:15 | sfinucan | kashyap: True, but it's just good practice | |
| 14:38:23 | kashyap | Having a blind rule (I'm not saying there is) like "We don't want two RH +2s" is just plain silly | |
| 14:38:30 | sfinucan | especially when the patch was RH authored | |
| 14:38:42 | kashyap | sfinucan: Ah, like that | |
| 14:38:58 | kashyap | sfinucan: Sure, it's a "nice to have" to keep biases in check | |
| 14:39:01 | mriedem | i'll review it when i'm off this call | |
| 14:39:14 | kashyap | But if they're are mature adults, then it's okay to assume they're acting in good faith :-) | |
| 14:39:16 | openstackgerrit | Sergey Nikitin proposed openstack/nova-specs master: PCI NUMA Policies https://review.openstack.org/361140 | |
| 14:39:28 | mriedem | kashyap: they are also rushing because of tripleo pressure | |
| 14:39:30 | mriedem | so there is a conflict | |
| 14:39:36 | mriedem | just hold up 30 minutes please :) | |
| 14:39:38 | sfinucan | kashyap: z'actly :) | |
| 14:39:40 | kashyap | sfinucan: Case in point: Upstream QEMU block layer has lots of RH-authored patches reviewed by RHers | |
| 14:39:49 | kashyap | And the quality of those discussions is one of the highest I've ever seen. | |
| 14:40:00 | kashyap | And they disagree all the time with each other | |
| 14:40:03 | jaypipes | bauzas, sfinucan: will try my best. really not feeling well today :( | |
| 14:40:16 | kashyap | mriedem: Ah, I see - didn't know the TripleO context | |
| 14:40:17 | bauzas | jaypipes: no worries man | |
| 14:40:22 | bauzas | jaypipes: take rest | |
| 14:44:34 | sfinucan | jaypipes: Aye, take it easy in that case | |
| 14:45:21 | jangutter | Massive apologies again for the insane lateness of "Spec to enable Netronome SmartNIC support" https://review.openstack.org/#/c/456386/ | |
| 14:46:15 | jangutter | At least I should be online for the next couple of hours if anyone is still willing to review it. | |
| 14:50:14 | openstackgerrit | Sylvain Bauza proposed openstack/nova master: Fix AZ related API docs https://review.openstack.org/456655 | |
| 14:50:30 | bauzas | mriedem: johnthetubaguy: attempt to clarify our API docs wrt: AZs https://review.openstack.org/456655 | |
| 14:55:37 | mriedem | live migration job is spiking at 75%+ fail, i'm going to make it non-voting | |
| 14:56:28 | kashyap | mriedem: Any specific bug (or a set of bugs) that's causing it? | |
| 14:56:39 | openstack | Launchpad bug 1682453 in OpenStack Compute (nova) "Live Migration failure: operation failed: Failed to connect to remote libvirt URI - End of file while reading data: sh: 1: nc: not found: Input/output error" [High,Confirmed] | |
| 14:56:39 | mriedem | https://bugs.launchpad.net/nova/+bug/1682453 | |
| 14:56:44 | mriedem | libvirt craps it's pants | |
| 14:56:51 | mriedem | with newer libvirt/qemu | |
| 14:57:06 | mriedem | which we were told by some (cough cough) it would fix all of our problems :) | |
| 14:58:58 | kashyap | mriedem: I never make blanket promises, certainly to _you_ that it will "fix all the problems" | |
| 14:59:26 | mriedem | https://review.openstack.org/456656 | |
| 14:59:28 | kashyap | s/to/not to/ | |
| 14:59:39 | mriedem | kashyap: i'm just teasing | |
| 14:59:49 | kashyap | I know, I forgot to add a smiley | |
| 15:07:34 | owalsh | kashyap: that looks like a packaging issue, nc not installed | |
| 15:08:48 | jangutter | :O "nc not installed" conjures the same horror in me as "gcc not installed". | |
| 15:10:16 | sdague | mriedem: the fix is merged now, right? | |
| 15:10:53 | mriedem | clarks? | |
| 15:10:56 | mriedem | that merged last night | |
| 15:10:57 | mriedem | this is something else | |
| 15:11:14 | sdague | mriedem: https://review.openstack.org/#/c/456388/ | |
| 15:11:21 | sdague | no, it didn't merge until this morning | |
| 15:11:50 | sdague | also, it seems totally weird to me that libvirt would shell out to nc | |
| 15:12:56 | dansmith | sdague: it has definitely used nc for things | |
| 15:13:26 | dansmith | sdague: used to be you couldn't connect a fedora virt-manager to an ubuntu host without installing netcat, or something like that | |
| 15:13:33 | dansmith | the reverse maybe, I forget | |
| 15:19:15 | sdague | so I think this is probably the problematic commit for us - https://libvirt.org/git/?p=libvirt.git;a=commitdiff;h=22eaee8e011645162e4b00d313bf2abdd4eb54e5 | |
| 15:19:30 | sdague | probably good to get an ubuntu packaging bug openned up on that | |