| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-06-14 | |||
| 14:37:23 | mriedem | yes | |
| 14:37:29 | mriedem | i want to be consistent when we rename payloads | |
| 14:37:36 | mriedem | consistent in what we do about the version i mean | |
| 14:37:40 | mriedem | does it stay the same or increment | |
| 14:37:51 | openstackgerrit | Maciej Kucia proposed openstack/nova-specs master: WIP Extended PCI alias https://review.openstack.org/474218 | |
| 14:38:03 | mriedem | gibi: looks like it's being consistent and not incrementing the version https://review.openstack.org/#/c/453077/9/doc/notification_samples/instance-snapshot-end.json | |
| 14:38:37 | gibi | mriedem: in case of snapshot_id we did increase as not just renamed the class but added the new field | |
| 14:38:42 | Kevin_Zheng | mriedem gibi I will ask for detailed usecase and see if it is persuasive enough | |
| 14:38:48 | gibi | mriedem: but in the create case we had a separate patch to rename | |
| 14:39:01 | gibi | mriedem: so there we kept the version | |
| 14:39:02 | mriedem | gibi: then isn't this wrong? https://review.openstack.org/#/c/453077/9/doc/notification_samples/instance-snapshot-start.json@72 | |
| 14:39:06 | openstackgerrit | Maciej Kucia proposed openstack/nova-specs master: WIP Extended PCI alias https://review.openstack.org/474218 | |
| 14:39:06 | mriedem | shouldn't that be 1.3? | |
| 14:39:28 | gibi | mriedem: yes, that is wrong | |
| 14:39:39 | mriedem | cool :) | |
| 14:39:41 | mriedem | -1! | |
| 14:39:54 | mriedem | Kevin_Zheng: thanks | |
| 14:39:54 | gibi | mriedem: thanks for founding it :) | |
| 14:41:09 | mriedem | sdatko: is this for something you're planning on contributing to nova in the community? or just working on separately downstream? because if it's the latter, i don't really have time to help with forking nova. | |
| 14:41:39 | gibi | mriedem: I will be more explicit in the https://review.openstack.org/#/c/453667/ as well about keeping the same version in case of pure rename and bumping it if also content is changed in the same step | |
| 14:42:08 | mriedem | gibi: ok i was going to ask that we document this in the devref | |
| 14:42:56 | sdatko | mriedem: nothing very important, i am just trying to get into Nova | |
| 14:44:07 | sdatko | playing on DevStack :-) Ok, maybe some other time | |
| 14:44:15 | sdatko | thanks! | |
| 14:44:45 | mriedem | sdatko: ok, i figured with the types of questions you're asking you are trying to implement some out of tree feature | |
| 14:45:20 | mriedem | sdatko: ultimately it depends on your use case, but i think if you're just trying to figure out which flavors are being used on which hosts, that can all be done via the REST API / client side tools | |
| 14:45:40 | mriedem | if you're working on a scheduler filter or something like that, then it's a different story | |
| 14:49:53 | kashyap | mriedem: Forgot to respond here, as I was asleep - about your persistent domain question | |
| 14:50:02 | kashyap | mriedem: But you answered yourself, and you were right | |
| 14:50:58 | mriedem | kashyap: yeah now just need to know why it takes 5 minutes to remove an ethernet interface device from a guest | |
| 14:51:12 | mriedem | was hoping danpb could help with some of that | |
| 14:51:17 | kashyap | mriedem: That sounds like an awful lot of time | |
| 14:54:13 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: explain payload inheritance in notification devref https://review.openstack.org/453667 | |
| 14:54:13 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add snapshot id to the snapshot notifications https://review.openstack.org/453077 | |
| 14:54:31 | gibi | mriedem: Fixed the versioning problem in the snapshot_id patch ^^ | |
| 14:54:45 | mriedem | kashyap: cool, comments 14 and on are the details https://bugs.launchpad.net/nova/+bug/1696125 | |
| 14:54:45 | openstack | Launchpad bug 1696125 in OpenStack Compute (nova) "Detach interface failed - timeout waiting to detach tap device in linuxbridge job (pike)" [High,Confirmed] - Assigned to Matt Riedemann (mriedem) | |
| 14:54:56 | mriedem | gibi: cool | |
| 14:58:26 | mriedem | gibi: ok +2 on the instance create payload change https://review.openstack.org/#/c/463001/ now | |
| 14:58:44 | gibi | mriedem: thanks for the review! | |
| 14:59:42 | gibi | mriedem: and thanks for the feedback on the doc. I will fix it soon | |
| 15:03:35 | openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Support tag instances when boot(4/4) https://review.openstack.org/469800 | |
| 15:03:43 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: explain payload inheritance in notification devref https://review.openstack.org/453667 | |
| 15:03:48 | mriedem | gibi: ok also some issues in https://review.openstack.org/#/c/453077/ | |
| 15:03:53 | mriedem | d'oh | |
| 15:04:08 | dansmith | dtantsur: is there an easy way to detect that I'm on the primary node or not? | |
| 15:04:16 | dansmith | actually | |
| 15:04:33 | dansmith | we should probably only run this if we're on a node where there is something like nova-api configured, so I'll do that | |
| 15:05:15 | mriedem | dansmith: that's what devstack/stack.sh checks for | |
| 15:05:17 | mriedem | so yeah | |
| 15:05:26 | dansmith | yeah | |
| 15:05:54 | gibi | mriedem: I have to run now, but will get back to the snapshot patch tomorrow morning. thanks again for the review! | |
| 15:06:18 | mriedem | yw | |
| 15:07:40 | mriedem | man we don't even go over conductor for compute_node_statistics | |
| 15:08:22 | dansmith | mriedem: well, it's api only, so we wouldn't | |
| 15:08:24 | dansmith | but no objects yeah | |
| 15:08:52 | dtantsur | dansmith: seems so: https://github.com/openstack/ironic/blob/870d909cc7e0c6118a174d412ae814953bb805e1/devstack/lib/ironic#L377-L384 | |
| 15:09:16 | dansmith | dtantsur: I think checking for n-api is the devstacky way | |
| 15:09:24 | dansmith | dtantsur: just pushed a rev for that | |
| 15:09:40 | dtantsur | thanks, I'll check after a meeting (and probably after Jenkins agrees with it) | |
| 15:09:44 | dansmith | cool, thanks | |
| 15:09:56 | dansmith | I'll be keeping an eye on it too of course :) | |
| 15:10:12 | dansmith | glad we (mriedem) caught this before we landed it and broke ironic this time :) | |
| 15:10:29 | mriedem | \o/ | |
| 15:10:32 | dansmith | heh | |
| 15:17:49 | kashyap | mriedem: Nice sleuthing on comment#16 | |
| 15:18:03 | kashyap | How did you guess it could be related to AppArmour? | |
| 15:18:11 | mriedem | kashyap: i'm not sure that it is, | |
| 15:18:31 | mriedem | kashyap: but we've had those previous bugs where based on the version of libvirt, the script path in the interface xml has to be None or '' | |
| 15:18:44 | mriedem | to tell qemu use the default, which is /etc/qemu-ifup | |
| 15:18:51 | mriedem | and apparmor could be blocking that script | |
| 15:19:03 | kashyap | mriedem: Yeah, just checking with Laine Stump on OFTC network, who mediatates on libvirt networking | |
| 15:20:41 | kashyap | mriedem: Yeah, I recall the script path thing, that's fixed, no | |
| 15:20:42 | kashyap | ? | |
| 15:21:23 | mriedem | it is | |
| 15:21:47 | mriedem | kashyap: https://github.com/openstack/nova/blob/master/nova/virt/libvirt/designer.py#L62 | |
| 15:24:24 | mriedem | jaypipes: are you able to pull out of your bag of lore what the simple difference between disk_available_least and free_disk_gb is? | |
| 15:24:40 | mriedem | because the descriptions on those response parameters in https://developer.openstack.org/api-ref/compute/?expanded=show-hypervisor-statistics-detail#show-hypervisor-statistics is not clear | |
| 15:25:13 | kashyap | mriedem: Laine & DanPB said: Without looking at data from the guest, it's hard to say *where* precisely is the delay lurking | |
| 15:25:13 | jaypipes | mriedem: it's not clear because the implementation/design of it all is unclear... | |
| 15:25:25 | mriedem | jaypipes: plus it depends on backend storage doesn't it? | |
| 15:25:31 | mriedem | e.g. ceph vs others | |
| 15:26:01 | jaypipes | mriedem: disk_available_least is essentially the worst-case scenario whereas free_disk_gb considers sparse disks as not consuming their entire mapping file | |
| 15:26:21 | kashyap | mriedem: Are you able to reproduce this issue? You note a hit in the bug | |
| 15:26:22 | jaypipes | s/mapping/backing | |
| 15:26:34 | mriedem | kashyap: reproduce locally? i haven't tried. | |
| 15:26:43 | kashyap | mriedem: Okay, here's what the folks from #virt say: | |
| 15:26:46 | mriedem | kashyap: we had a recreate in upstream ci which is where i pulled and dug through those libvirtd logs | |
| 15:26:59 | kashyap | 17:19 < danpb> kashyap: suggests the guest OS is not honouring the unplug event promtly | |
| 15:27:02 | kashyap | 17:20 < danpb> kashyap: or perhaps it is honouring it, but something in the guest is waiting 5 minutes for something to happen before offlineing the nic | |
| 15:27:05 | kashyap | 17:20 < danpb> its hard to say for sure without getting data from the guest os really | |
| 15:27:08 | kashyap | 17:24 <@laine> kashyap: I was going to suggest what danpb suggested - the delay could be on the guest. | |
| 15:27:35 | kashyap | 17:25 < danpb> i'm not even sure how to get any data from the guest | |
| 15:27:35 | kashyap | 17:26 < danpb> might need udev event logs for example | |
| 15:27:52 | kashyap | mriedem: Does DevStack log 'udev' events? /me thinks no | |
| 15:28:05 | mriedem | kashyap: hmm, ok - is there some way to get information out of the guest, like the qemu guest agent? or should we dump the console when this times out? | |
| 15:28:14 | mriedem | kashyap: don't know | |
| 15:28:34 | kashyap | mriedem: Guest Agent is a good idea, but I'm not sure if it gives us what we need here. /me taps on the table and thinks | |
| 15:29:12 | kashyap | And looks at the man pages | |
| 15:30:43 | openstackgerrit | Matt Riedemann proposed openstack/nova master: api-ref: cleanup PUT /os-hypervisors/statistics docs https://review.openstack.org/474250 | |