| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-02-16 | |||
| 23:08:07 | mriedem | http://logs.openstack.org/50/435050/1/check/gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial/49adcde/logs/subnode-2/libvirt/qemu/instance-00000001.txt.gz | |
| 23:08:44 | mriedem | what does this mean? "KVM: entry failed, hardware error 0x0" | |
| 23:13:07 | openstackgerrit | Sujitha proposed openstack/nova master: This patch is followup for https://review.openstack.org/#/c/415298/. https://review.openstack.org/435146 | |
| 23:15:45 | cdent | mriedem: casual googling suggests problems with nested virtualization | |
| 23:16:56 | mriedem | i'm crawling through the libvirtd logs | |
| 23:18:21 | openstackgerrit | Sujitha proposed openstack/nova master: Change tags to default field in Instance object. https://review.openstack.org/415298 | |
| 23:19:22 | openstackgerrit | Sujitha proposed openstack/nova master: This patch is followup for https://review.openstack.org/#/c/415298/. https://review.openstack.org/435146 | |
| 23:19:26 | mriedem | i see this start to go crazy | |
| 23:19:27 | mriedem | debug : qemuMonitorJSONIOProcess:255 : Total used 0 bytes out of 1023 available in buffer | |
| 23:19:31 | mriedem | debug : qemuMonitorJSONIOProcess:255 : Total used 0 bytes out of 2047 available in buffer | |
| 23:19:37 | mriedem | debug : qemuMonitorJSONIOProcess:255 : Total used 0 bytes out of 3071 available in buffer | |
| 23:19:44 | mriedem | debug : qemuMonitorJSONIOProcess:255 : Total used 0 bytes out of 4095 available in buffer | |
| 23:20:05 | mriedem | debug : qemuMonitorJSONIOProcess:255 : Total used 6689 bytes out of 6689 available in buffer | |
| 23:20:05 | mriedem | ... | |
| 23:20:50 | mriedem | maybe that's normal | |
| 23:21:51 | mriedem | 2017-02-16 22:22:11.139+0000: 8968: debug : qemuProcessHandleResume:765 : Transitioned guest instance-00000001 out of paused into resumed state | |
| 23:22:50 | mriedem | 2017-02-16 22:22:11.140+0000: 8968: debug : qemuProcessHandleStop:716 : Transitioned guest instance-00000001 to paused state | |
| 23:22:55 | openstackgerrit | Eric Fried proposed openstack/nova master: PowerVM Driver: config drive https://review.openstack.org/409404 | |
| 23:23:04 | openstackgerrit | Sujitha proposed openstack/nova master: [WIP] Reduce calls to load_tags() to 0 https://review.openstack.org/435146 | |
| 23:23:43 | mriedem | no errors in the libvirt logs | |
| 23:25:53 | mriedem | aha | |
| 23:25:57 | mriedem | right around that time in the syslog | |
| 23:25:58 | mriedem | http://logs.openstack.org/50/435050/1/check/gate-tempest-dsvm-multinode-live-migration-ubuntu-xenial/49adcde/logs/subnode-2/syslog.txt.gz#_Feb_16_22_22_11 | |
| 23:26:02 | mriedem | End of file while reading data: Input/output error | |
| 23:27:42 | mriedem | we shouldn't even be using virtlogd | |
| 23:27:51 | mriedem | dansmith: you ever seen anything like this? ^ | |
| 23:27:55 | mriedem | channel your inner berrange | |
| 23:28:58 | mriedem | maybe the i/o error with virtlogd is a result of the guest hw error? | |
| 23:29:49 | mriedem | i guess that's really normal | |
| 23:29:53 | mriedem | it's all over syslog in our ci runs | |
| 23:30:09 | cdent | that's an unfortunate way to spell normal | |
| 23:34:11 | mriedem | virt_type = kvm in nova.conf | |
| 23:34:13 | mriedem | that should be qemu | |
| 23:34:22 | mriedem | we don't support that in the gate with nested virt, how the hell was this even running | |
| 23:35:20 | mriedem | so yeah, that's the issue | |
| 23:36:52 | cdent | mriedem: how/where/why? | |
| 23:37:01 | cdent | as in wat? | |
| 23:37:05 | cdent | and wtf | |
| 23:37:14 | mriedem | it's qemu on the primary node, but kvm on the subnode | |
| 23:37:15 | mriedem | that's the bug | |
| 23:38:13 | cfriesen | anyone got a suggestion on the best way to deal with this? http://paste.openstack.org/show/599318/ I'm adding a check against cs.api_version in v2.shell.do_list() and it's failing a bunch of tests with that error | |
| 23:38:30 | cdent | mriedem: ah, and somehow this only showed up as a problem now? | |
| 23:39:32 | mriedem | cdent: i've been seeing it off and on | |
| 23:39:39 | mriedem | i just haven't taken the 2 hours to investigate :) | |
| 23:39:49 | cdent | ow | |
| 23:40:38 | cdent | do you ever sleep or eat or recreate in some fashion (please don't tell me this is your recreation)? | |
| 23:41:14 | mriedem | when my wife forces me, yes | |
| 23:41:31 | mriedem | i only care about this since it kicked the last change for ocata ga out of the gagte | |
| 23:41:32 | mriedem | *Gate | |
| 23:42:56 | mriedem | she gets up at 4am and goes to bed at 7pm though so i will start getting texts here pretty quick to get my ass home and take over parenting duties | |
| 23:47:35 | cdent | g'night | |
| 23:47:59 | openstackgerrit | Sujitha proposed openstack/nova master: Adding auto_disk_config field to InstancePayload https://review.openstack.org/419185 | |
| 23:51:28 | mriedem | https://review.openstack.org/#/c/435154/1 | |
| 23:51:30 | mriedem | YES! | |
| 23:51:33 | mriedem | sdague: ^^^^ | |
| 23:51:39 | mriedem | jogo: even you ^ | |
| 23:51:42 | mriedem | mtreinish: ^ | |
| 23:52:56 | mtreinish | mriedem: hah, nice | |
| 23:54:09 | mriedem | ok i'm tapping out, back online later | |
| 23:55:25 | jogo | mriedem: done | |
| 23:55:46 | mriedem | ha | |
| 23:55:47 | mriedem | o/ | |
| #openstack-nova - 2017-02-17 | |||
| 00:26:16 | cburgess | mrodden So... food update... | |
| 00:26:20 | cburgess | Opps | |
| 00:26:29 | cburgess | Wrong person. | |
| 00:26:47 | cburgess | mriedem You still around? | |
| 00:27:10 | melwitt | cburgess: he's heading home right now, said he'll be back online later | |
| 00:27:23 | cburgess | melwitt Thanks... have a food update for him and wanted his opinion | |
| 00:27:34 | melwitt | :) | |
| 00:28:14 | edleafe | cburgess: if possible, please keep in mind those of us who are not meat eaters | |
| 00:28:29 | cburgess | Well thats a problem since he asked me about BBQ... ummm ok. | |
| 00:28:39 | cburgess | I'll... see what we can do. | |
| 00:28:47 | cburgess | bbq and not meat don't usually go well together... | |
| 00:38:41 | edleafe | cburgess: understood. I live in Texas, after all :) | |
| 00:39:06 | edleafe | cburgess: As long as there will be beer, I'll survive | |
| 00:40:13 | cburgess | edleafe No worries | |
| 00:45:15 | openstackgerrit | melanie witt proposed openstack/nova master: Count resources to check quota for cells https://review.openstack.org/416521 | |
| 00:45:16 | openstackgerrit | melanie witt proposed openstack/nova master: Add online migration to move quotas to API database https://review.openstack.org/410946 | |
| 00:45:16 | openstackgerrit | melanie witt proposed openstack/nova master: Make Quotas object favor the API database https://review.openstack.org/410945 | |
| 01:47:11 | xiaoyang | hi, everyone. Why instance live migration after success doesn't change the availability zone? | |
| 03:18:21 | Jeffrey4l | can i say, introducing nova_api database is only(or mainly?) used for nova cell v2? | |
| 03:18:28 | Jeffrey4l | alex_xu, ^^ ;) | |
| 03:24:44 | cku | We recently submitted a blueprint and spec for adding a Nova volume driver for Veritas HyperScale storage (https://review.openstack.org/#/c/430488/). | |
| 03:24:52 | cku | I'm uncertain about the process to take this forward. | |
| 03:25:02 | cku | 1. Should we submit a separate blueprint and spec to the Cinder project for the Nova volume driver's os-brick connector? | |
| 03:25:10 | cku | 2. Do we need to set up CI for the volume driver, the os-brick connector, or both? | |
| 03:25:19 | cku | 3. Which existing volume driver should I use as a model for the proper specs, architecture, and CI setup? | |
| 03:25:28 | cku | Thanks (eom) | |
| 03:26:01 | smcginnis | cku: I believe there is already a Cinder blueprint for HyperScale. | |
| 03:26:28 | smcginnis | cku: If you need an os-brick connector, you can associate that change in os-brick to the same blueprint. | |
| 03:26:48 | smcginnis | cku: The Cinder repo needs CI reporting. | |
| 03:27:06 | smcginnis | cku: We encourage also reporting on os-brick changes, but we haven't made that a requirement. (yet) | |
| 03:27:12 | cku | Yes, a Cinder volume driver, but that is different from the os-brick connector component of the Nova volume driver. | |
| 03:27:28 | smcginnis | os-brick is a shared library by Nova and Cinder. | |
| 03:28:28 | cku | Ah, so the blueprint and spec we submitted in the Nova project should suffice? | |
| 03:42:37 | smcginnis | cku: No, I mean the Cinder spec. os-brick is part of the Cinder umbrella. | |
| 03:42:53 | openstackgerrit | ChangBo Guo(gcb) proposed openstack/nova master: Use check_string_length from oslo_utils https://review.openstack.org/286390 | |
| 03:59:46 | mriedem | cku: i've already replied about this in the nova spec, and linked the nova blueprint to the cinder blueprint | |
| 03:59:54 | mriedem | but smcginnis has already answered most of this | |
| 04:00:12 | mriedem | Jeffrey4l: the nova_api database has gone back a few releases and mostly predates the majority of the cells v2 work | |