| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-05-08 | |||
| 17:38:22 | sean-k-mooney | that cause some vms in the active state to be deleted if operators incorrectly started an evacuation which failed and then reset the vm state. | |
| 17:38:57 | sean-k-mooney | ygk_12345: in this case im not aware of a bug that would result in the domains being deleted as part of a upgrade | |
| 17:39:43 | ygk_12345 | we did not evacuate. just upgraded from stein to train. one of the four computes is fine | |
| 17:40:09 | ygk_12345 | only virsh domains on these three computes vanished | |
| 17:40:14 | ygk_12345 | but the disk files are there | |
| 17:41:52 | artom | ygk_12345, so `virsh list` is empty? What about `virsh list --all`? | |
| 18:33:21 | sean-k-mooney | artom: it only has 2 domains out of like 30 | |
| 18:33:30 | sean-k-mooney | so something undefiend all the domains | |
| 18:33:59 | sean-k-mooney | and since the log message for the only code that i know of in nova that will do that is not present i dont really know why that happened | |
| 18:34:25 | sean-k-mooney | e.g. it was not the evac cleanup code or the preiodic take for deleted instances | |
| 18:35:02 | sean-k-mooney | so something undefiend the domains | |
| 18:39:08 | artom | sean-k-mooney, and since ygk are gone, we'll never know what happened :P | |
| 18:39:45 | sean-k-mooney | ya i dont really know how you woudl fix this either | |
| 18:40:03 | sean-k-mooney | i think the root disk files are already deleted | |
| 18:40:21 | sean-k-mooney | so im not sure there is much you can do at this point | |
| 21:59:15 | jharris | hey, I am trying to get a nova profile working, and having trouble with blockmapping | |
| 21:59:18 | jharris | do I need to put the image in the block mapping as well as the volume I want to mount? | |
| 22:07:36 | openstackgerrit | Merged openstack/os-vif master: Remove translation sections from setup.cfg https://review.opendev.org/724974 | |
| #openstack-nova - 2020-05-09 | |||
| 01:35:24 | openstackgerrit | xuyuanhao proposed openstack/nova master: the vms can not be force deleted when vm_status is soft-delete and task-state=deleting https://review.opendev.org/724260 | |
| 06:30:15 | openstackgerrit | Takashi Natsume proposed openstack/os-vif master: Use unittest.mock instead of third party mock https://review.opendev.org/724965 | |
| 09:14:47 | openstackgerrit | Vlad Gusev proposed openstack/nova stable/queens: Add retry to cinder API calls related to volume detach https://review.opendev.org/726508 | |
| 09:54:42 | openstackgerrit | Takashi Natsume proposed openstack/nova master: Remove six.PY2 and six.PY3 https://review.opendev.org/726512 | |
| 14:15:16 | openstackgerrit | Takashi Natsume proposed openstack/nova master: Remove six.PY2 and six.PY3 https://review.opendev.org/726512 | |
| #openstack-nova - 2020-05-10 | |||
| 01:19:47 | openstackgerrit | Brin Zhang proposed openstack/nova master: Optimize _create_and_bind_arqs logic in conducor https://review.opendev.org/726564 | |
| 03:10:53 | openstackgerrit | Takashi Natsume proposed openstack/nova master: Remove six.add_metaclass https://review.opendev.org/726565 | |
| #openstack-nova - 2020-05-11 | |||
| 04:44:14 | openstackgerrit | Elod Illes proposed openstack/nova stable/rocky: libvirt: check job status for VIR_DOMAIN_EVENT_SUSPENDED_MIGRATED event https://review.opendev.org/711233 | |
| 06:40:31 | openstackgerrit | Xinran WANG proposed openstack/os-resource-classes master: Add new resource class for QAT card. https://review.opendev.org/726314 | |
| 08:05:23 | gibi | good morning Nova | |
| 08:07:31 | lyarwood | Morning \o | |
| 08:12:03 | openstackgerrit | Kevin Zhao proposed openstack/nova master: [WIP] CI: add tempest-integrated-compute-aarch64 job https://review.opendev.org/714439 | |
| 08:24:09 | openstackgerrit | Kevin Zhao proposed openstack/nova master: [WIP] CI: add tempest-integrated-compute-aarch64 job https://review.opendev.org/714439 | |
| 08:37:13 | openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: Remove 'NovaObjectDictCompat' from 'Migration' https://review.opendev.org/723572 | |
| 08:37:14 | openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: Remove 'NovaObjectDictCompat' from 'InstancePCIRequest' https://review.opendev.org/723573 | |
| 09:07:44 | brinzhang | gibi, bauzas: When I researching the define nova cyborg interaction notification, I found some code logical not suitable, so I | |
| 09:07:44 | brinzhang | submmit a patch to optimize it, would you like to review https://review.opendev.org/#/c/726564/ | |
| 09:21:18 | openstackgerrit | Liang Fang proposed openstack/nova master: [WIP] rbd patch for volume local cache https://review.opendev.org/726762 | |
| 09:38:33 | bauzas | good morning Nova | |
| 10:33:42 | stephenfin | lyarwood, bauzas: would you do me the honours? https://review.opendev.org/#/c/710238/ | |
| 10:34:12 | stephenfin | hahaha | |
| 10:34:18 | bauzas | "would you do me the homous" ? | |
| 10:36:45 | gibi | I got an interesting support case downstream. Does nova calculate the disk usage of its own image cache on the compute? | |
| 10:37:20 | stephenfin | gibi: I don't think nova includes anything except instances in those calculation | |
| 10:37:21 | stephenfin | *s | |
| 10:37:33 | gibi | all the non-nova disk usage should be configured in reserved_host_disk_mb | |
| 10:37:44 | stephenfin | I'd expect image cache to be included in the reserved host config | |
| 10:37:48 | stephenfin | yeah | |
| 10:38:00 | gibi | for that I would need to know the maximum size of the image cache | |
| 10:38:02 | bauzas | stephenfin: I'm not a multi-attach specialist | |
| 10:38:16 | bauzas | but I wonder why we were avoiding QEMU>2.10 | |
| 10:38:26 | gibi | do we have a way to maximize the size of the nova image cache? | |
| 10:38:38 | gibi | I mean limit | |
| 10:38:52 | stephenfin | bauzas: I think kashyap explained that to me at some point. Let me look | |
| 10:38:57 | stephenfin | it's a weird conditional, for sure | |
| 10:39:11 | stephenfin | gibi: I'm not aware of any, but I suspect there must be something. /me looks | |
| 10:39:48 | gibi | I tried to find it but I failed | |
| 10:39:57 | bauzas | stephenfin: yeah I suspect something was borked | |
| 10:40:12 | bauzas | but this whole comment is confusing | |
| 10:40:20 | bauzas | it's an "or" clause | |
| 10:40:36 | bauzas | so in theory, we should only support multiattach if QEMU<2.10 | |
| 10:40:51 | bauzas | but I suspect the wording being incorrect, hence the confusion | |
| 10:42:39 | stephenfin | gibi: Yeah, I can't see anything either. Sounds like a gap :-\ | |
| 10:45:10 | stephenfin | bauzas: okay, the context in in https://bugzilla.redhat.com/show_bug.cgi?id=1378242 | |
| 10:45:10 | openstack | bugzilla.redhat.com bug 1378242 in libvirt "QEMU image file locking (libvirt)" [Unspecified,Closed: errata] - Assigned to pkrempa | |
| 10:45:52 | gibi | stephenfin: thanks for confirming. I will do a problem reproduction and file a bug but I feel this will be considered as a feautre request | |
| 10:45:56 | stephenfin | tl;dr: QEMU added a feature that broke multi-attach, which necessitated a new libvirt feature to fix it again | |
| 10:45:58 | gibi | from upstream perspective | |
| 10:46:33 | bauzas | stephenfin: cool, and the bug is readable without being internal | |
| 10:47:34 | bauzas | stephenfin: okay, so the libvirt version is superseding the QEMU one | |
| 10:47:40 | stephenfin | gibi: Perhaps. A quick look suggests we have documented multiple error codes for the API though, so if it was classified as a bug, it should be a backportable one | |
| 10:48:04 | gibi | stephenfin: which API you are referring to? | |
| 10:48:14 | bauzas | stephenfin: worth respinning a better commit msg explaining this ? | |
| 10:48:21 | stephenfin | bauzas: Yup. You either need to use an older version of QEMU, or you need a newer version of libvirt to workaround the changes in newer QEMU | |
| 10:48:34 | stephenfin | bauzas: Good call. Let me do that | |
| 10:48:45 | bauzas | and the fact we have a recent QEMU isn't a problem since libvirt fixes this | |
| 10:49:00 | bauzas | stephenfin: thanks | |
| 10:49:16 | stephenfin | gibi: The host aggregate image caching API. Commit 339129870692467b703220dbc3905fd8bffe6a83 | |
| 10:50:59 | gibi | stephenfin: ohh. This goes way beyond that. As nova cached images before that API was added. | |
| 10:51:37 | gibi | based on images download for new instance boots | |
| 10:51:43 | stephenfin | Ah, the old just-in-time caching behavior? | |
| 10:51:47 | gibi | jepp | |
| 10:51:55 | gibi | as far as I see that is also not limited in size | |
| 10:52:21 | lyarwood | gibi: is this with the libvirt virt driver? | |
| 10:52:27 | gibi | lyarwood: yes libvirt | |
| 10:52:37 | gibi | lyarwood: the instances dir is on local file system | |
| 10:52:47 | lyarwood | gibi: right then you're correct that isn't limited AFAIK | |
| 10:53:43 | gibi | isn't it even a security concern? Can I will the disk via the cache to prevent nova-compute for booting VMs? | |
| 10:53:56 | gibi | s/will/fill/ | |
| 10:54:19 | lyarwood | gibi: that should be taken into consideration when attempting to schedule instances to the node | |
| 10:54:31 | lyarwood | gibi: the cache is just a way of sharing the base image between instances | |
| 10:54:32 | gibi | lyarwood: but it doesn't as far as I see | |
| 10:55:19 | lyarwood | gibi: are you providing a unique image with every request? | |
| 10:56:11 | gibi | lyarwood: if I have a raw base image and two qcow2 guest image then I potentially use original image.size + instance 1 flavor.disk + instance 2 flavor.disk, but nova only calculate the instance 1 flavor.disk + instance 2 flavor.disk as used | |
| 10:57:25 | openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: Remove MIN_LIBVIRT_MULTIATTACH https://review.opendev.org/710238 | |
| 10:57:28 | stephenfin | bauzas: ^ | |
| 10:57:29 | gibi | (I ignore disk_available_least as placement does not use that just he old removed DiskFilter used that) | |
| 10:58:07 | lyarwood | gibi: don't we report the adjusted available space to placement taking that into account? | |
| 10:58:15 | lyarwood | gibi: the size of the RAW base file that is | |
| 10:58:27 | lyarwood | gibi: and the potential size of the two qcow2 instance disks? | |
| 10:59:42 | lyarwood | _get_disk_over_committed_size_total ? | |
| 11:00:15 | lyarwood | ah right | |