| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2024-02-02 | |||
| 18:44:35 | sean-k-mooney | ok the ci escalation project must be private... | |
| 18:45:16 | sean-k-mooney | the cijob is runign in rdo based on github patches https://review.rdoproject.org/zuul/build/5cf66b0bd0b6402faaa3306d3b193f81 | |
| 18:47:01 | bauzas | the RHEL bug is telling about the VDP issue, but I don't have this hardware | |
| 18:47:20 | sean-k-mooney | https://logserver.rdoproject.org/27/127/e7992da92f6f67327ffbf593a64b712e36b04cc6/github-check/tcib-podified-multinode-edpm-deployment-crc/5cf66b0/controller/ci-framework-data/logs/192.168.122.100/log/containers/nova/nova-compute.log | |
| 18:47:36 | sean-k-mooney | i commented that is looks like the same vpd parsing issue | |
| 18:47:45 | sean-k-mooney | but it might now be | |
| 18:48:04 | sean-k-mooney | basiclaly the libvirt api is returning non unicode bytes | |
| 18:48:16 | sean-k-mooney | so we can decode them into a strign properly | |
| 18:48:54 | sean-k-mooney | we are calling self.get_connection().getType() | |
| 18:49:10 | sean-k-mooney | which is exploding in the libvirt python module | |
| 18:49:15 | sean-k-mooney | when it calls libvirtmod.virConnectGetType(self._o) | |
| 18:49:46 | sean-k-mooney | so that a libvirt or libvirt python bug | |
| 18:49:51 | bauzas | that said I had no problem with the other compute | |
| 18:50:03 | bauzas | lemme look if I use the same version between the two computes | |
| 18:50:27 | sean-k-mooney | if your not can you record which one works | |
| 18:51:16 | bauzas | nope, I use the same version :( | |
| 18:51:26 | bauzas | that's bizarre | |
| 18:52:46 | sean-k-mooney | bauzas: can you commet on the downstream bug tracker | |
| 18:53:21 | sean-k-mooney | lets see if we can get some of our virt team folks to have a look on monday before it starts impacting the upstream gate | |
| 18:53:23 | bauzas | the CIX one ? | |
| 18:53:26 | sean-k-mooney | ya | |
| 18:53:30 | bauzas | cool | |
| 18:53:42 | sean-k-mooney | so it sound like it something works and somethime does not | |
| 18:59:37 | bauzas | actually, I can confirm that the other compute got the same exception, hence why I had no compute node | |
| 18:59:55 | sean-k-mooney | oh ok so both failed | |
| 19:00:53 | sean-k-mooney | melwitt: i fixed the missing fucntion but then it failed elsewher eon the comptue with AttributeError: 'Qcow2' object has no attribute 'disk_encryption' | |
| 19:01:35 | sean-k-mooney | in disk.libvirt_info() | |
| 19:01:40 | bauzas | apparently, now the call works for the first node | |
| 19:02:28 | sean-k-mooney | melwitt: ill try and take a look at your code again on monday if you can fix the rebase issues | |
| 19:02:36 | sean-k-mooney | bauzas: so its flaky? | |
| 19:02:51 | sean-k-mooney | i.e. on the same node it sometiems works and somethimes does not | |
| 19:03:26 | bauzas | actually, when directly calling libvirt with the python binding, I have the problem | |
| 19:03:35 | bauzas | (for the host that now works) | |
| 19:03:51 | bauzas | https://paste.opendev.org/show/blEFSbHapI8eCPEMRgyY/ | |
| 19:05:03 | sean-k-mooney | if you had a standalone repoducer that would proably help | |
| 19:05:25 | sean-k-mooney | i.e. just a python script that import libvirtmod and calls virtConnectGetType | |
| 19:05:44 | bauzas | that's what I did | |
| 19:05:57 | sean-k-mooney | oh you didnt use the nova code | |
| 19:06:19 | sean-k-mooney | ok well if you can repoduce jsut with the libvirt module in a short script | |
| 19:06:28 | sean-k-mooney | it will be a lot simpler to report this to the libvirt folks | |
| 19:06:44 | sean-k-mooney | we dont have a libvirt bug for this yet | |
| 19:07:54 | bauzas | just added a comment | |
| 19:08:01 | bauzas | lemme see if virsh gets that too | |
| 19:08:20 | sean-k-mooney | im not sure what the virsh equivlent command would be | |
| 19:17:34 | bauzas | at least domcapabilities doesn't say anything | |
| 19:18:13 | melwitt | sean-k-mooney: ugh, ok, sorry about that :( | |
| 19:19:47 | bauzas | ok I need to leave | |
| 19:20:37 | bauzas | eventually I was able to start both of the services | |
| 19:20:50 | bauzas | but we still have the bug | |
| 19:20:51 | melwitt | sean-k-mooney: every time I splice commits apart I manage to f something up 🙄 I'll get it fixed. thanks for trying it out | |
| 19:20:57 | sean-k-mooney | bauzas: i filed a bug with the libvirt folks | |
| 19:21:05 | bauzas | cool | |
| 19:24:21 | sean-k-mooney | melwitt: its fine that happens to me too | |
| 19:24:49 | artom | dansmith, I think with your stable node UUID series https://bugs.launchpad.net/nova/+bug/1817833 is fixed, no? | |
| 19:25:00 | sean-k-mooney | melwitt: i usuallly end up going commit by commmint and running a subset of tox -e py3,functional,pep8 | |
| 19:25:02 | artom | I happened upon its functional reproducer doing the downstream backport... | |
| 19:28:17 | melwitt | sean-k-mooney: yeah. I do that too ... most of the time 😒 | |
| 19:29:34 | dansmith | artom: um, not sure | |
| 19:30:19 | dansmith | artom: they seem to be complaining that they can't delete the compute to get it to have a new identity and my thing doesn't really fix that, it just means nova-compute will fail to start | |
| 19:30:28 | sean-k-mooney | artom: dansmith my readin was maybe in some specifica casses as a side effect | |
| 19:30:38 | dansmith | if you reset the uuid it will probably be right back to this problem when the name on the RP conflicts | |
| 19:31:23 | sean-k-mooney | so in the fucntionl tests the repoduce might be impacted becasue the agent will fail to start or simialr | |
| 19:31:54 | dansmith | right, it doesn't solve the problem (if you agree it's a problem) it just refuses to fail at the place it did before, and does so earlier (at start) | |
| 19:32:30 | sean-k-mooney | ya that was my feeling but i didnt fully parse the bug details | |
| 19:33:07 | artom | I wasn't really pushing one way or another, just wanted to check that we don't have stable bug reports laying around | |
| 19:33:19 | artom | (I mean, I'm sure we do, but if we can close _one_... ;) | |
| 19:34:50 | opendevreview | Merged openstack/nova stable/2023.1: Revert "[pwmgmt]ignore missin governor when cpu_state used" https://review.opendev.org/c/openstack/nova/+/905674 | |
| #openstack-nova - 2024-02-03 | |||
| 04:44:25 | opendevreview | zhouzhong proposed openstack/nova master: Validate flavor image min ram when resizing a volume-backend instance https://review.opendev.org/c/openstack/nova/+/906813 | |
| 04:57:50 | opendevreview | zhouzhong proposed openstack/nova master: Regression test for bug 2007968 https://review.opendev.org/c/openstack/nova/+/907642 | |
| 10:24:57 | opendevreview | zhouzhong proposed openstack/nova master: Validate flavor image min ram when resizing a volume-backend instance https://review.opendev.org/c/openstack/nova/+/906813 | |
| 10:24:57 | opendevreview | zhouzhong proposed openstack/nova master: Regression test for bug 2007968 https://review.opendev.org/c/openstack/nova/+/907642 | |
| 10:28:24 | opendevreview | zhouzhong proposed openstack/nova master: Regression test for bug 2007968 https://review.opendev.org/c/openstack/nova/+/907642 | |
| 10:28:41 | opendevreview | zhouzhong proposed openstack/nova master: Regression test for bug 2007968 https://review.opendev.org/c/openstack/nova/+/907642 | |
| 11:09:18 | opendevreview | zhouzhong proposed openstack/nova master: Regression test for bug 2007968 https://review.opendev.org/c/openstack/nova/+/907642 | |
| 14:15:05 | opendevreview | zhouzhong proposed openstack/nova master: Regression test for bug 2007968 https://review.opendev.org/c/openstack/nova/+/907642 | |
| 15:19:47 | opendevreview | zhouzhong proposed openstack/nova master: Regression test for bug 2007968 https://review.opendev.org/c/openstack/nova/+/907642 | |
| 16:01:50 | opendevreview | zhouzhong proposed openstack/nova master: Validate flavor image min ram when resize volume-backed instance https://review.opendev.org/c/openstack/nova/+/906813 | |
| 21:14:23 | opendevreview | melanie witt proposed openstack/nova-specs master: Amend spec to use regular rst table instead of code block https://review.opendev.org/c/openstack/nova-specs/+/907654 | |
| 21:49:06 | opendevreview | melanie witt proposed openstack/nova-specs master: Amend spec to use regular rst table instead of code block https://review.opendev.org/c/openstack/nova-specs/+/907654 | |
| #openstack-nova - 2024-02-04 | |||
| 06:08:31 | opendevreview | zhouzhong proposed openstack/nova master: Validate flavor image min ram when resize volume-backed instance https://review.opendev.org/c/openstack/nova/+/906813 | |
| #openstack-nova - 2024-02-05 | |||
| 02:58:18 | opendevreview | zhouzhong proposed openstack/nova master: Validate flavor image min ram when resize volume-backed instance https://review.opendev.org/c/openstack/nova/+/906813 | |
| 05:43:48 | opendevreview | Takashi Kajinami proposed openstack/nova-specs master: libvirt: AMD SEV-ES support https://review.opendev.org/c/openstack/nova-specs/+/907702 | |
| 05:46:24 | opendevreview | Takashi Kajinami proposed openstack/nova-specs master: libvirt: AMD SEV-ES support https://review.opendev.org/c/openstack/nova-specs/+/907702 | |
| 05:47:10 | opendevreview | zhouzhong proposed openstack/nova master: Validate flavor image min ram when resize volume-backed instance https://review.opendev.org/c/openstack/nova/+/906813 | |
| 05:48:29 | opendevreview | zhouzhong proposed openstack/nova master: Validate flavor image min ram when resize volume-backed instance https://review.opendev.org/c/openstack/nova/+/906813 | |
| 05:48:52 | opendevreview | Takashi Kajinami proposed openstack/nova-specs master: libvirt: AMD SEV-ES support https://review.opendev.org/c/openstack/nova-specs/+/907702 | |
| 06:07:29 | opendevreview | Takashi Kajinami proposed openstack/nova-specs master: libvirt: AMD SEV-ES support https://review.opendev.org/c/openstack/nova-specs/+/907702 | |
| 06:08:58 | opendevreview | Takashi Kajinami proposed openstack/nova-specs master: libvirt: AMD SEV-ES support https://review.opendev.org/c/openstack/nova-specs/+/907702 | |
| 08:49:42 | opendevreview | zhouzhong proposed openstack/nova master: Validate flavor image min ram when resize volume-backed instance https://review.opendev.org/c/openstack/nova/+/906813 | |
| 10:40:09 | sahid | o/ quick question as I'm not able to remember that... when we are using cpu pinning, the vcpu is pinned on a pu and the memory cannot move from it, do we ensure that during scheduling there is a that given node some memory allocated? | |
| 10:40:22 | sahid | or does the scheduler still consider memeory from all the nodes | |
| 10:40:47 | sahid | i think we have work on something realted in the past bu I can't rememebr | |
| 10:55:18 | opendevreview | Arnaud Morin proposed openstack/nova master: Clean state image_backup during nova-compute init https://review.opendev.org/c/openstack/nova/+/907719 | |
| 11:17:29 | opendevreview | Arnaud Morin proposed openstack/nova master: libvirt: Log exception if failure checking block job https://review.opendev.org/c/openstack/nova/+/907720 | |
| 13:09:25 | opendevreview | Arnaud Morin proposed openstack/nova master: libvirt: Add retry on device job operation timeout https://review.opendev.org/c/openstack/nova/+/907730 | |
| 13:16:02 | bauzas | hmmmm, can't login again in Gerrit | |
| 13:16:08 | bauzas | wtf | |
| 13:17:26 | bauzas | is it me or do we have a problem ? | |
| 13:21:05 | opendevreview | Arnaud Morin proposed openstack/nova master: Clean state shelving* during nova-compute init https://review.opendev.org/c/openstack/nova/+/907731 | |
| 13:27:18 | gibi | bauzas: I can log out and log in again without issue | |