| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-01-18 | |||
| 09:00:13 | openstackgerrit | Merged openstack/nova master: Fix overcommit for NUMA-based instances https://review.openstack.org/629281 | |
| 09:00:54 | jangutter | :-O finally! | |
| 09:08:22 | openstackgerrit | Bhagyashri Shewale proposed openstack/os-resource-classes master: Add PCPU standard resource class https://review.openstack.org/631711 | |
| 09:10:51 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/queens: libvirt: Add workaround to cleanup instance dir when using rbd https://review.openstack.org/628726 | |
| 09:12:10 | openstackgerrit | Elod Illes proposed openstack/nova stable/rocky: Fix incompatible version handling in BuildRequest https://review.openstack.org/631731 | |
| 11:04:15 | openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: Import IP implementation modules outside privsep context https://review.openstack.org/629025 | |
| 11:49:52 | openstackgerrit | Daniel Alvarez proposed openstack/os-vif master: Don't set iface-id when creating an OVS port https://review.openstack.org/631782 | |
| 11:52:08 | openstackgerrit | Daniel Alvarez proposed openstack/os-vif master: Don't set iface-id when creating an OVS port https://review.openstack.org/631782 | |
| 12:15:27 | openstackgerrit | Daniel Alvarez proposed openstack/os-vif master: Don't set iface-id when creating an OVS port https://review.openstack.org/631782 | |
| 14:15:55 | edleafe | fanzhang: Sorry, but I haven't worked with keystone in many years. Perhaps someone else here might have more insight into how to debug the BadStatusLine errors. | |
| 14:18:14 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/queens: Send context.global_id on neutron calls https://review.openstack.org/627604 | |
| 14:34:55 | mriedem | i've been seeing this traceback in n-cpu logs in the gate, it seems harmless but is ugly, and i haven't dug into what introduced it http://logs.openstack.org/80/630980/5/check/grenade-py3/49818d8/logs/screen-n-cpu.txt.gz#_Jan_17_08_04_31_907868 | |
| 14:35:01 | mriedem | something trying to hit the db from nova-compute | |
| 14:35:10 | mriedem | w/o going through conductor | |
| 14:36:20 | cdent | ah, interesting, I saw that in the vmware ci logs and assumed it was the vmware ci being set up incorrectly (it is, but apparently not because of that) | |
| 14:39:30 | mriedem | kashyap: https://review.openstack.org/#/q/topic:bp/support-qemu-native-tls-for-live-migration+status:open would be OK except for you have libvirt 4.0.0 as a minimum requirement in a couple of places | |
| 14:39:34 | mriedem | which i'm guessing is a typo | |
| 14:40:15 | kashyap | Meeting hell, will check back shortly here; sorry. | |
| 14:41:11 | mriedem | cdent: looks like it's actually in rocky too... | |
| 14:41:33 | mriedem | i think i know what it is | |
| 14:42:46 | kashyap | mriedem: Damn, indeed :-( it is 4.4.0 | |
| 14:42:58 | mriedem | https://review.openstack.org/#/q/Icddbe4760eaff30e4e13c1e8d3d5d3f489dac3c4 | |
| 14:43:10 | mriedem | dansmith: i think ^ is causing the tracebacks in the n-cpu logs on startup | |
| 14:43:13 | kashyap | Eagle eyes. /me curses himself for missing that detail | |
| 14:44:03 | mriedem | well, maybe not | |
| 14:44:43 | mriedem | https://bugs.launchpad.net/nova/+bug/1812398 | |
| 14:44:44 | openstack | Launchpad bug 1812398 in OpenStack Compute (nova) "DBNotAllowed tracebacks in nova-compute logs" [High,Confirmed] | |
| 14:44:45 | dansmith | hmm | |
| 14:45:06 | cdent | mriedem: that conditional seems a bit weird anyway: having a configuration for the api database doesn't mean you have a real connection does it? | |
| 14:45:14 | cdent | (in that process) | |
| 14:45:39 | mriedem | it means compute is configured to be able to reach the api db | |
| 14:45:42 | mriedem | up-calls | |
| 14:47:19 | cdent | that's all it takes? So (accidentally?) reusing conf between a controller node and compute node is bad? | |
| 14:47:41 | cdent | or even between a nova-compute process on a controller node and the rest of the nova processes | |
| 14:48:00 | mriedem | there are some cases where people have to allow nova-compute to hit the api db | |
| 14:48:04 | mriedem | for things that aren't properly isolated yet | |
| 14:48:27 | dansmith | hang on, | |
| 14:48:31 | mriedem | docshttps://docs.openstack.org/nova/latest/user/cellsv2-layout.html#operations-requiring-upcalls | |
| 14:48:49 | cdent | thanks mriedem | |
| 14:48:50 | mriedem | this traceback isn't giving me much | |
| 14:48:57 | dansmith | this traceback would be for the non-api db not api | |
| 14:49:03 | dansmith | yeah, it's confusingly ambiguous | |
| 14:49:24 | mriedem | Jan 17 08:04:31.900276 ubuntu-xenial-inap-mtl01-0001764122 nova-compute[29129]: DEBUG nova.context [None req-6462a6fa-ac8b-4802-bed8-18c335fc623f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d97f3c8-5ea1-41e1-b849-6cfbf74eefec(cell1) {{(pid=29129) load_cells /opt/stack/old/nova/nova/context.py:479}} | |
| 14:49:32 | mriedem | something is hitting the api db here... | |
| 14:51:00 | dansmith | yeah, so maybe the deal is, | |
| 14:51:09 | dansmith | it hit the api database to get the cell mappings (which it seems to have), | |
| 14:51:24 | dansmith | but then is hitting the db prohibition for compute while trying to get service | |
| 14:51:51 | mriedem | http://logs.openstack.org/80/630980/5/check/grenade-py3/49818d8/logs/screen-n-cpu.txt.gz#_Jan_17_08_04_32_547867 | |
| 14:51:51 | mriedem | well this taint right | |
| 14:51:56 | mriedem | Jan 17 08:04:32.547867 ubuntu-xenial-inap-mtl01-0001764122 nova-compute[29129]: DEBUG oslo_service.service [None req-6462a6fa-ac8b-4802-bed8-18c335fc623f None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=29129) log_opt_values /usr/local/lib/python3.5/dist-packages/oslo_config/cfg.py:3008}} | |
| 14:52:09 | mriedem | that's why it's hitting the api db | |
| 14:52:21 | openstackgerrit | Maciej Kucia proposed openstack/nova master: SR-IOV passthrough: Check PF only if VF is enabled https://review.openstack.org/476642 | |
| 14:52:28 | dansmith | hrm | |
| 14:52:30 | dansmith | yeah | |
| 14:53:53 | mriedem | oh... | |
| 14:53:55 | mriedem | https://github.com/openstack-dev/devstack/commit/f165ad49206f520e8fc3aac535e77f82ea410ea4 | |
| 14:54:04 | mriedem | but i think grenade runs in singleconductor mode | |
| 14:57:00 | dansmith | well, that means we probably need to tweak it so it gets a neutered config like in devstack | |
| 14:57:21 | mriedem | that is devstack, but yes on the neutering | |
| 14:57:45 | dansmith | I mean a devstack job | |
| 15:09:20 | mriedem | checking logstash yeah it's all grenade jobs | |
| 15:25:34 | kashyap | What is this "badge" thing you speak of? Fedora project does these "badges" for fun (e.g. if your build failed 20 times, you get a badge; you write a doc, you get a "Junior Editor" badge, etc.) | |
| 15:25:45 | kashyap | So recently I got an "adult frog" badge :D -- https://badges.fedoraproject.org/badge/adult-frog | |
| 15:26:20 | kashyap | Anyway. Enough with the diggression. | |
| 15:27:07 | mriedem | so if someone licks your back now they hallucinate? | |
| 15:27:45 | kashyap | Heh, just learnt about "licking toads" | |
| 15:28:19 | kashyap | Here are all the "fun" badges I accumulated :D: https://badges.fedoraproject.org/user/kashyapc | |
| 15:28:35 | kashyap | mriedem: On that review; just saw your remarks, will address the nits. | |
| 15:44:31 | mriedem | will see if this cleans up the logs in grenade runs https://review.openstack.org/631811 | |
| 15:50:14 | melwitt | ||
| 16:22:13 | openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: Import IP implementation modules outside privsep context https://review.openstack.org/629025 | |
| 16:43:04 | jroll | mriedem | jroll: ironic has a task engine thing right? does that use taskflow? <- yes, no | |
| 16:45:42 | openstackgerrit | sean mooney proposed openstack/os-vif master: do not always plug ovs ports. https://review.openstack.org/631829 | |
| 16:52:46 | openstackgerrit | sean mooney proposed openstack/os-vif master: Cleanup device at the end of 'test_iproute_object_closes_correctly' test https://review.openstack.org/629112 | |
| 16:52:47 | openstackgerrit | sean mooney proposed openstack/os-vif master: Import IP implementation modules outside privsep context https://review.openstack.org/629025 | |
| 16:55:49 | mriedem | jaypipes: are you going to be able to jump on this qos minimum bandwidth call in 5 minutes? | |
| 16:55:58 | mriedem | also, isn't it friday? | |
| 16:56:01 | mriedem | no superdan | |
| 16:56:03 | mriedem | no leakypipes | |
| 16:56:10 | mriedem | no fried_rice | |
| 16:57:09 | lbragstad | but where's hans_moleman? | |
| 16:57:39 | fried_rice | Thanks mriedem | |
| 16:58:02 | cdent | I assumed that casual nick friday was shut down as part of the federal shutdown | |
| 16:58:17 | hansmoleman | i've got a table full of fast food that says otherwise | |
| 16:58:40 | cdent | self-funded? It's only legit if its self-funded | |
| 16:59:10 | gibi | bandwidth hangouts https://hangouts.google.com/call/oZAfCFV3XaH3IxaA0-ITAEEI | |
| 16:59:10 | hansmoleman | it's funded via my non-profit yes | |
| 16:59:12 | sean-k-mooney | hi can i get some eye on the 3 os-vif change i just pushed i want to fast track them to do a release of os-vif today to unblock the gate | |
| 16:59:30 | cdent | hansmoleman: the depth you are able to carry a reference is impressive | |
| 16:59:40 | jaypipes | mrhillsman: yes | |
| 17:00:00 | jaypipes | doink, sorry mrhillsman, I meant hansmoleman | |
| 17:00:47 | hansmoleman | https://etherpad.openstack.org/p/bandwidth-way-forward | |
| 17:01:08 | mrhillsman | np | |
| 17:01:47 | hansmoleman | sean-k-mooney: we're on this call if you care | |
| 17:02:03 | sean-k-mooney | oh sorry yes i should join continue with out me | |
| 17:02:42 | sean-k-mooney | ill be there in a sec | |
| 17:03:06 | melwitt | guess no one cares about jgwentworth | |
| 17:04:34 | hansmoleman | so this is the functional test stub https://review.openstack.org/#/c/567268/43/nova/tests/functional/test_servers.py@5711 | |
| 17:04:47 | hansmoleman | to enable the code in functional tests even though the API doesn't allow the new stuff | |
| 17:05:10 | dansmith | hansmoleman: I think that grenade patch makes sense at first glance | |