| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-01-18 | |||
| 14:39:34 | mriedem | which i'm guessing is a typo | |
| 14:40:15 | kashyap | Meeting hell, will check back shortly here; sorry. | |
| 14:41:11 | mriedem | cdent: looks like it's actually in rocky too... | |
| 14:41:33 | mriedem | i think i know what it is | |
| 14:42:46 | kashyap | mriedem: Damn, indeed :-( it is 4.4.0 | |
| 14:42:58 | mriedem | https://review.openstack.org/#/q/Icddbe4760eaff30e4e13c1e8d3d5d3f489dac3c4 | |
| 14:43:10 | mriedem | dansmith: i think ^ is causing the tracebacks in the n-cpu logs on startup | |
| 14:43:13 | kashyap | Eagle eyes. /me curses himself for missing that detail | |
| 14:44:03 | mriedem | well, maybe not | |
| 14:44:43 | mriedem | https://bugs.launchpad.net/nova/+bug/1812398 | |
| 14:44:44 | openstack | Launchpad bug 1812398 in OpenStack Compute (nova) "DBNotAllowed tracebacks in nova-compute logs" [High,Confirmed] | |
| 14:44:45 | dansmith | hmm | |
| 14:45:06 | cdent | mriedem: that conditional seems a bit weird anyway: having a configuration for the api database doesn't mean you have a real connection does it? | |
| 14:45:14 | cdent | (in that process) | |
| 14:45:39 | mriedem | it means compute is configured to be able to reach the api db | |
| 14:45:42 | mriedem | up-calls | |
| 14:47:19 | cdent | that's all it takes? So (accidentally?) reusing conf between a controller node and compute node is bad? | |
| 14:47:41 | cdent | or even between a nova-compute process on a controller node and the rest of the nova processes | |
| 14:48:00 | mriedem | there are some cases where people have to allow nova-compute to hit the api db | |
| 14:48:04 | mriedem | for things that aren't properly isolated yet | |
| 14:48:27 | dansmith | hang on, | |
| 14:48:31 | mriedem | docshttps://docs.openstack.org/nova/latest/user/cellsv2-layout.html#operations-requiring-upcalls | |
| 14:48:49 | cdent | thanks mriedem | |
| 14:48:50 | mriedem | this traceback isn't giving me much | |
| 14:48:57 | dansmith | this traceback would be for the non-api db not api | |
| 14:49:03 | dansmith | yeah, it's confusingly ambiguous | |
| 14:49:24 | mriedem | Jan 17 08:04:31.900276 ubuntu-xenial-inap-mtl01-0001764122 nova-compute[29129]: DEBUG nova.context [None req-6462a6fa-ac8b-4802-bed8-18c335fc623f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d97f3c8-5ea1-41e1-b849-6cfbf74eefec(cell1) {{(pid=29129) load_cells /opt/stack/old/nova/nova/context.py:479}} | |
| 14:49:32 | mriedem | something is hitting the api db here... | |
| 14:51:00 | dansmith | yeah, so maybe the deal is, | |
| 14:51:09 | dansmith | it hit the api database to get the cell mappings (which it seems to have), | |
| 14:51:24 | dansmith | but then is hitting the db prohibition for compute while trying to get service | |
| 14:51:51 | mriedem | well this taint right | |
| 14:51:51 | mriedem | http://logs.openstack.org/80/630980/5/check/grenade-py3/49818d8/logs/screen-n-cpu.txt.gz#_Jan_17_08_04_32_547867 | |
| 14:51:56 | mriedem | Jan 17 08:04:32.547867 ubuntu-xenial-inap-mtl01-0001764122 nova-compute[29129]: DEBUG oslo_service.service [None req-6462a6fa-ac8b-4802-bed8-18c335fc623f None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=29129) log_opt_values /usr/local/lib/python3.5/dist-packages/oslo_config/cfg.py:3008}} | |
| 14:52:09 | mriedem | that's why it's hitting the api db | |
| 14:52:21 | openstackgerrit | Maciej Kucia proposed openstack/nova master: SR-IOV passthrough: Check PF only if VF is enabled https://review.openstack.org/476642 | |
| 14:52:28 | dansmith | hrm | |
| 14:52:30 | dansmith | yeah | |
| 14:53:53 | mriedem | oh... | |
| 14:53:55 | mriedem | https://github.com/openstack-dev/devstack/commit/f165ad49206f520e8fc3aac535e77f82ea410ea4 | |
| 14:54:04 | mriedem | but i think grenade runs in singleconductor mode | |
| 14:57:00 | dansmith | well, that means we probably need to tweak it so it gets a neutered config like in devstack | |
| 14:57:21 | mriedem | that is devstack, but yes on the neutering | |
| 14:57:45 | dansmith | I mean a devstack job | |
| 15:09:20 | mriedem | checking logstash yeah it's all grenade jobs | |
| 15:25:34 | kashyap | What is this "badge" thing you speak of? Fedora project does these "badges" for fun (e.g. if your build failed 20 times, you get a badge; you write a doc, you get a "Junior Editor" badge, etc.) | |
| 15:25:45 | kashyap | So recently I got an "adult frog" badge :D -- https://badges.fedoraproject.org/badge/adult-frog | |
| 15:26:20 | kashyap | Anyway. Enough with the diggression. | |
| 15:27:07 | mriedem | so if someone licks your back now they hallucinate? | |
| 15:27:45 | kashyap | Heh, just learnt about "licking toads" | |
| 15:28:19 | kashyap | Here are all the "fun" badges I accumulated :D: https://badges.fedoraproject.org/user/kashyapc | |
| 15:28:35 | kashyap | mriedem: On that review; just saw your remarks, will address the nits. | |
| 15:44:31 | mriedem | will see if this cleans up the logs in grenade runs https://review.openstack.org/631811 | |
| 15:50:14 | melwitt | ||
| 16:22:13 | openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: Import IP implementation modules outside privsep context https://review.openstack.org/629025 | |
| 16:43:04 | jroll | mriedem | jroll: ironic has a task engine thing right? does that use taskflow? <- yes, no | |
| 16:45:42 | openstackgerrit | sean mooney proposed openstack/os-vif master: do not always plug ovs ports. https://review.openstack.org/631829 | |
| 16:52:46 | openstackgerrit | sean mooney proposed openstack/os-vif master: Cleanup device at the end of 'test_iproute_object_closes_correctly' test https://review.openstack.org/629112 | |
| 16:52:47 | openstackgerrit | sean mooney proposed openstack/os-vif master: Import IP implementation modules outside privsep context https://review.openstack.org/629025 | |
| 16:55:49 | mriedem | jaypipes: are you going to be able to jump on this qos minimum bandwidth call in 5 minutes? | |
| 16:55:58 | mriedem | also, isn't it friday? | |
| 16:56:01 | mriedem | no superdan | |
| 16:56:03 | mriedem | no leakypipes | |
| 16:56:10 | mriedem | no fried_rice | |
| 16:57:09 | lbragstad | but where's hans_moleman? | |
| 16:57:39 | fried_rice | Thanks mriedem | |
| 16:58:02 | cdent | I assumed that casual nick friday was shut down as part of the federal shutdown | |
| 16:58:17 | hansmoleman | i've got a table full of fast food that says otherwise | |
| 16:58:40 | cdent | self-funded? It's only legit if its self-funded | |
| 16:59:10 | hansmoleman | it's funded via my non-profit yes | |
| 16:59:10 | gibi | bandwidth hangouts https://hangouts.google.com/call/oZAfCFV3XaH3IxaA0-ITAEEI | |
| 16:59:12 | sean-k-mooney | hi can i get some eye on the 3 os-vif change i just pushed i want to fast track them to do a release of os-vif today to unblock the gate | |
| 16:59:30 | cdent | hansmoleman: the depth you are able to carry a reference is impressive | |
| 16:59:40 | jaypipes | mrhillsman: yes | |
| 17:00:00 | jaypipes | doink, sorry mrhillsman, I meant hansmoleman | |
| 17:00:47 | hansmoleman | https://etherpad.openstack.org/p/bandwidth-way-forward | |
| 17:01:08 | mrhillsman | np | |
| 17:01:47 | hansmoleman | sean-k-mooney: we're on this call if you care | |
| 17:02:03 | sean-k-mooney | oh sorry yes i should join continue with out me | |
| 17:02:42 | sean-k-mooney | ill be there in a sec | |
| 17:03:06 | melwitt | guess no one cares about jgwentworth | |
| 17:04:34 | hansmoleman | so this is the functional test stub https://review.openstack.org/#/c/567268/43/nova/tests/functional/test_servers.py@5711 | |
| 17:04:47 | hansmoleman | to enable the code in functional tests even though the API doesn't allow the new stuff | |
| 17:05:10 | dansmith | hansmoleman: I think that grenade patch makes sense at first glance | |
| 17:08:39 | cdent | gerrit being restarted? | |
| 17:08:51 | cdent | guess so, better now | |
| 17:08:55 | fried_rice | They did threaten that that was going to happen about now. | |
| 17:09:00 | fried_rice | upgrading | |
| 17:09:27 | fried_rice | cdent: http://lists.openstack.org/pipermail/openstack-discuss/2019-January/001833.html | |
| 17:09:33 | cdent | my ability to keep track of things is broken | |
| 17:09:46 | cdent | thanks | |
| 17:10:00 | fried_rice | Crowdsourced thing tracking --^ | |
| 17:25:31 | openstackgerrit | Paul-Emile Element proposed openstack/nova master: Add emulated TPM support to Nova https://review.openstack.org/631363 | |
| 17:30:02 | openstackgerrit | Elod Illes proposed openstack/nova stable/ocata: Make supports_direct_io work on 4096b sector size https://review.openstack.org/631843 | |
| 17:36:22 | leakypipes | mlavalle: mind having a look at my comment on https://review.openstack.org/#/c/631684/1/nova/network/neutronv2/api.py? | |
| 17:36:47 | mlavalle | leakypipes: sure, I'll look at it | |
| 17:38:52 | leakypipes | mlavalle: gracias | |
| 17:39:07 | mlavalle | de nada | |
| 17:47:25 | openstackgerrit | sean mooney proposed openstack/os-vif master: do not always plug ovs ports. https://review.openstack.org/631829 | |
| 17:56:11 | openstackgerrit | sean mooney proposed openstack/os-vif master: Cleanup device at the end of 'test_iproute_object_closes_correctly' test https://review.openstack.org/629112 | |