| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-01-17 | |||
| 22:01:55 | dansmith | mriedem: nah, mine was after | |
| 22:18:24 | openstackgerrit | Dan Smith proposed openstack/nova master: Fix using template cell urls with nova-manage https://review.openstack.org/631649 | |
| 22:20:06 | mriedem | e-r uncategorized should be fixed, will take time to regen the page | |
| 22:20:09 | mriedem | https://review.openstack.org/#/c/631653/1 | |
| 22:41:23 | mriedem | dansmith: +2 | |
| 22:42:20 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/rocky: Send context.global_id on neutron calls https://review.openstack.org/627603 | |
| 23:10:14 | melwitt | mriedem: looks like we need to be the T specs directory created https://review.openstack.org/630037 (based on seeing someone propose https://review.openstack.org/630817 earlier) | |
| 23:11:32 | mriedem | done | |
| 23:11:58 | melwitt | ty | |
| 23:23:42 | openstackgerrit | Merged openstack/nova-specs master: Create specs directory for Train https://review.openstack.org/630037 | |
| #openstack-nova - 2019-01-18 | |||
| 00:46:14 | openstackgerrit | Merged openstack/nova master: Fix incompatible version handling in BuildRequest https://review.openstack.org/631179 | |
| 01:00:49 | openstackgerrit | Hang Yang proposed openstack/nova master: Fix port dns_name reset https://review.openstack.org/631684 | |
| 01:19:05 | takashin | oomichi: Would you check my comment in https://review.openstack.org/#/c/627282/ ? | |
| 01:39:20 | openstackgerrit | Jack Ding proposed openstack/nova master: Flavor extra spec and image properties validation https://review.openstack.org/620706 | |
| 01:40:12 | openstackgerrit | Jack Ding proposed openstack/nova master: Correct instance port binding for rebuilds https://review.openstack.org/603844 | |
| 01:40:35 | openstackgerrit | Jack Ding proposed openstack/nova master: Preserve UEFI NVRAM variable store https://review.openstack.org/621646 | |
| 01:41:01 | openstackgerrit | Jack Ding proposed openstack/nova master: Improve libvirt image and snapshot handling https://review.openstack.org/616692 | |
| 02:32:35 | fanzhang | Hi edleafe, sorry to borther you, I notice that you have some commits to keystoneauth, I'm wondering that do you have any idea to config 'connect_retries' of Adapter in Nova or in Placement? We've met some ('Connection aborted.', BadStatusLine("''",) errors while trying to get allocation candidates, I am not sure adding retries would help. But it seems https://github.com/openstack/keystoneauth/blob/master/keystoneauth1/adapter.py#L46 here | |
| 02:32:35 | fanzhang | we can pass the connect_reties args, but in https://github.com/openstack/keystoneauth/blob/master/keystoneauth1/loading/adapter.py#L205 there are only few args. | |
| 09:00:13 | openstackgerrit | Merged openstack/nova master: Fix overcommit for NUMA-based instances https://review.openstack.org/629281 | |
| 09:00:54 | jangutter | :-O finally! | |
| 09:08:22 | openstackgerrit | Bhagyashri Shewale proposed openstack/os-resource-classes master: Add PCPU standard resource class https://review.openstack.org/631711 | |
| 09:10:51 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/queens: libvirt: Add workaround to cleanup instance dir when using rbd https://review.openstack.org/628726 | |
| 09:12:10 | openstackgerrit | Elod Illes proposed openstack/nova stable/rocky: Fix incompatible version handling in BuildRequest https://review.openstack.org/631731 | |
| 11:04:15 | openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: Import IP implementation modules outside privsep context https://review.openstack.org/629025 | |
| 11:49:52 | openstackgerrit | Daniel Alvarez proposed openstack/os-vif master: Don't set iface-id when creating an OVS port https://review.openstack.org/631782 | |
| 11:52:08 | openstackgerrit | Daniel Alvarez proposed openstack/os-vif master: Don't set iface-id when creating an OVS port https://review.openstack.org/631782 | |
| 12:15:27 | openstackgerrit | Daniel Alvarez proposed openstack/os-vif master: Don't set iface-id when creating an OVS port https://review.openstack.org/631782 | |
| 14:15:55 | edleafe | fanzhang: Sorry, but I haven't worked with keystone in many years. Perhaps someone else here might have more insight into how to debug the BadStatusLine errors. | |
| 14:18:14 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/queens: Send context.global_id on neutron calls https://review.openstack.org/627604 | |
| 14:34:55 | mriedem | i've been seeing this traceback in n-cpu logs in the gate, it seems harmless but is ugly, and i haven't dug into what introduced it http://logs.openstack.org/80/630980/5/check/grenade-py3/49818d8/logs/screen-n-cpu.txt.gz#_Jan_17_08_04_31_907868 | |
| 14:35:01 | mriedem | something trying to hit the db from nova-compute | |
| 14:35:10 | mriedem | w/o going through conductor | |
| 14:36:20 | cdent | ah, interesting, I saw that in the vmware ci logs and assumed it was the vmware ci being set up incorrectly (it is, but apparently not because of that) | |
| 14:39:30 | mriedem | kashyap: https://review.openstack.org/#/q/topic:bp/support-qemu-native-tls-for-live-migration+status:open would be OK except for you have libvirt 4.0.0 as a minimum requirement in a couple of places | |
| 14:39:34 | mriedem | which i'm guessing is a typo | |
| 14:40:15 | kashyap | Meeting hell, will check back shortly here; sorry. | |
| 14:41:11 | mriedem | cdent: looks like it's actually in rocky too... | |
| 14:41:33 | mriedem | i think i know what it is | |
| 14:42:46 | kashyap | mriedem: Damn, indeed :-( it is 4.4.0 | |
| 14:42:58 | mriedem | https://review.openstack.org/#/q/Icddbe4760eaff30e4e13c1e8d3d5d3f489dac3c4 | |
| 14:43:10 | mriedem | dansmith: i think ^ is causing the tracebacks in the n-cpu logs on startup | |
| 14:43:13 | kashyap | Eagle eyes. /me curses himself for missing that detail | |
| 14:44:03 | mriedem | well, maybe not | |
| 14:44:43 | mriedem | https://bugs.launchpad.net/nova/+bug/1812398 | |
| 14:44:44 | openstack | Launchpad bug 1812398 in OpenStack Compute (nova) "DBNotAllowed tracebacks in nova-compute logs" [High,Confirmed] | |
| 14:44:45 | dansmith | hmm | |
| 14:45:06 | cdent | mriedem: that conditional seems a bit weird anyway: having a configuration for the api database doesn't mean you have a real connection does it? | |
| 14:45:14 | cdent | (in that process) | |
| 14:45:39 | mriedem | it means compute is configured to be able to reach the api db | |
| 14:45:42 | mriedem | up-calls | |
| 14:47:19 | cdent | that's all it takes? So (accidentally?) reusing conf between a controller node and compute node is bad? | |
| 14:47:41 | cdent | or even between a nova-compute process on a controller node and the rest of the nova processes | |
| 14:48:00 | mriedem | there are some cases where people have to allow nova-compute to hit the api db | |
| 14:48:04 | mriedem | for things that aren't properly isolated yet | |
| 14:48:27 | dansmith | hang on, | |
| 14:48:31 | mriedem | docshttps://docs.openstack.org/nova/latest/user/cellsv2-layout.html#operations-requiring-upcalls | |
| 14:48:49 | cdent | thanks mriedem | |
| 14:48:50 | mriedem | this traceback isn't giving me much | |
| 14:48:57 | dansmith | this traceback would be for the non-api db not api | |
| 14:49:03 | dansmith | yeah, it's confusingly ambiguous | |
| 14:49:24 | mriedem | Jan 17 08:04:31.900276 ubuntu-xenial-inap-mtl01-0001764122 nova-compute[29129]: DEBUG nova.context [None req-6462a6fa-ac8b-4802-bed8-18c335fc623f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d97f3c8-5ea1-41e1-b849-6cfbf74eefec(cell1) {{(pid=29129) load_cells /opt/stack/old/nova/nova/context.py:479}} | |
| 14:49:32 | mriedem | something is hitting the api db here... | |
| 14:51:00 | dansmith | yeah, so maybe the deal is, | |
| 14:51:09 | dansmith | it hit the api database to get the cell mappings (which it seems to have), | |
| 14:51:24 | dansmith | but then is hitting the db prohibition for compute while trying to get service | |
| 14:51:51 | mriedem | well this taint right | |
| 14:51:51 | mriedem | http://logs.openstack.org/80/630980/5/check/grenade-py3/49818d8/logs/screen-n-cpu.txt.gz#_Jan_17_08_04_32_547867 | |
| 14:51:56 | mriedem | Jan 17 08:04:32.547867 ubuntu-xenial-inap-mtl01-0001764122 nova-compute[29129]: DEBUG oslo_service.service [None req-6462a6fa-ac8b-4802-bed8-18c335fc623f None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=29129) log_opt_values /usr/local/lib/python3.5/dist-packages/oslo_config/cfg.py:3008}} | |
| 14:52:09 | mriedem | that's why it's hitting the api db | |
| 14:52:21 | openstackgerrit | Maciej Kucia proposed openstack/nova master: SR-IOV passthrough: Check PF only if VF is enabled https://review.openstack.org/476642 | |
| 14:52:28 | dansmith | hrm | |
| 14:52:30 | dansmith | yeah | |
| 14:53:53 | mriedem | oh... | |
| 14:53:55 | mriedem | https://github.com/openstack-dev/devstack/commit/f165ad49206f520e8fc3aac535e77f82ea410ea4 | |
| 14:54:04 | mriedem | but i think grenade runs in singleconductor mode | |
| 14:57:00 | dansmith | well, that means we probably need to tweak it so it gets a neutered config like in devstack | |
| 14:57:21 | mriedem | that is devstack, but yes on the neutering | |
| 14:57:45 | dansmith | I mean a devstack job | |
| 15:09:20 | mriedem | checking logstash yeah it's all grenade jobs | |
| 15:25:34 | kashyap | What is this "badge" thing you speak of? Fedora project does these "badges" for fun (e.g. if your build failed 20 times, you get a badge; you write a doc, you get a "Junior Editor" badge, etc.) | |
| 15:25:45 | kashyap | So recently I got an "adult frog" badge :D -- https://badges.fedoraproject.org/badge/adult-frog | |
| 15:26:20 | kashyap | Anyway. Enough with the diggression. | |
| 15:27:07 | mriedem | so if someone licks your back now they hallucinate? | |
| 15:27:45 | kashyap | Heh, just learnt about "licking toads" | |
| 15:28:19 | kashyap | Here are all the "fun" badges I accumulated :D: https://badges.fedoraproject.org/user/kashyapc | |
| 15:28:35 | kashyap | mriedem: On that review; just saw your remarks, will address the nits. | |
| 15:44:31 | mriedem | will see if this cleans up the logs in grenade runs https://review.openstack.org/631811 | |
| 15:50:14 | melwitt | ||
| 16:22:13 | openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: Import IP implementation modules outside privsep context https://review.openstack.org/629025 | |
| 16:43:04 | jroll | mriedem | jroll: ironic has a task engine thing right? does that use taskflow? <- yes, no | |
| 16:45:42 | openstackgerrit | sean mooney proposed openstack/os-vif master: do not always plug ovs ports. https://review.openstack.org/631829 | |
| 16:52:46 | openstackgerrit | sean mooney proposed openstack/os-vif master: Cleanup device at the end of 'test_iproute_object_closes_correctly' test https://review.openstack.org/629112 | |
| 16:52:47 | openstackgerrit | sean mooney proposed openstack/os-vif master: Import IP implementation modules outside privsep context https://review.openstack.org/629025 | |
| 16:55:49 | mriedem | jaypipes: are you going to be able to jump on this qos minimum bandwidth call in 5 minutes? | |
| 16:55:58 | mriedem | also, isn't it friday? | |
| 16:56:01 | mriedem | no superdan | |
| 16:56:03 | mriedem | no leakypipes | |
| 16:56:10 | mriedem | no fried_rice | |
| 16:57:09 | lbragstad | but where's hans_moleman? | |