| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-12-07 | |||
| 13:53:14 | sean-k-mooney | we deprecated them in train | |
| 13:53:31 | sean-k-mooney | just trying to figure out if they will be present in 17 or not | |
| 13:54:18 | lyarwood | gibi / sean-k-mooney ; yeah I've asked in #openstack-infra, I assume 20.6 being yanked has caused this | |
| 13:54:22 | sean-k-mooney | we already dont support the deprecated option for new deployments downstream just for upgrades | |
| 13:54:27 | lyarwood | as in we haven't sync'd the newer version yet | |
| 13:54:51 | sean-k-mooney | lyarwood: well 20.5 and 20.7 should be valid | |
| 13:55:12 | sean-k-mooney | lyarwood: they are not public mirrors as far as i know | |
| 13:55:34 | sean-k-mooney | they are limited to the the ci vms | |
| 13:55:46 | lyarwood | sean-k-mooney: yeah I assume we had 20.6 cached in the mirror | |
| 13:55:50 | lyarwood | sean-k-mooney: that was then yanked | |
| 13:56:02 | lyarwood | sean-k-mooney: and for some reason we don't have 20.5 or 20.7 now | |
| 13:58:11 | sean-k-mooney | yep so normally we would jsut hop on the infra channel and ask the ci provier to check | |
| 13:58:47 | sean-k-mooney | infra can also hold a vm and ssh in if needed i guess | |
| 14:00:21 | lyarwood | cool cool | |
| 14:00:25 | lyarwood | lets see what they say | |
| 14:05:44 | gibi | teoobo_: when you say that you cannot reproduce what do you really mean? For me the bug is pretty generic: "This filter is difficult to troubleshoot because there are not much LOG.debug functions in nova.virt.hardware" | |
| 14:06:33 | gibi | teoobo_: do you mean that since then we added plenty of debug logs and now it is clear why the NUMATopologyFilter fails when it fails? | |
| 14:09:51 | teoobo_ | gibi: Yes, I mean that, but since I'm not a nova expert I'm not sure if my judgment is valid | |
| 14:11:40 | gibi | teoobo_: it is nice to here that the filter is now better about logging. I think it would be nice to summarize your experience in the bug. Maybe an example about the logs now emitted helping the troubleshooting | |
| 14:11:44 | openstackgerrit | Lee Yarwood proposed openstack/nova-specs master: Image and flavor defined ephemeral storage encryption https://review.opendev.org/c/openstack/nova-specs/+/752284 | |
| 14:14:18 | teoobo_ | gibi: thanks for the advice | |
| 14:15:45 | gibi | teoobo_: we could even close the bug with your comment and realy on other users still feeling bad about the logging to open a new one with a specific case when the logging is not enough | |
| 14:17:01 | stephenfin | sean-k-mooney: I have draft patches written but I haven't decided what to do with the reshaper yet | |
| 14:21:06 | mgariepy | lyarwood, do you have a few minutes to review the ussuri cpu feature backport please ? https://review.opendev.org/c/openstack/nova/+/758761 | |
| 14:21:21 | lyarwood | mgariepy: yeah I can take a look now | |
| 14:21:29 | mgariepy | thanks | |
| 14:24:46 | lyarwood | mgariepy: done, LGTM. | |
| 14:25:00 | mgariepy | Thanks a lot :D | |
| 14:27:20 | gibi | teoobo_: do you need some low hanging improvement that could be worked on? | |
| 14:27:50 | gibi | teoobo_: I think there is a list of functional test improvement like this https://review.opendev.org/c/openstack/nova/+/758210 to be done | |
| 14:28:32 | gibi | teoobo_: let me know if you are interested | |
| 14:40:15 | gibi | lyarwood: tempest fix for the racy detach https://review.opendev.org/c/openstack/tempest/+/765814 | |
| 14:50:08 | sean-k-mooney | stephenfin: ah ok ya makes sense | |
| 15:02:09 | lyarwood | gibi: ack LGTM, quick naming nit and we will need some tests but this should be good | |
| 15:02:23 | gibi | we need test for tempest tests? whaaat :D | |
| 15:02:29 | gibi | looking ... | |
| 15:02:46 | lyarwood | gibi: but who is going to test the test that tests the test?!! | |
| 15:02:48 | lyarwood | gibi: /s | |
| 15:02:58 | lyarwood | gibi: yeah just basic unit tests for the waiter | |
| 15:03:10 | lyarwood | gibi: I was asked to do it before so I'm assuming someone will ask for them here | |
| 15:03:10 | gibi | yeah, I need self testing tests in a recursive way... :D | |
| 15:03:24 | gibi | lyarwood: sure, thanks. I will fix the patch up | |
| 15:10:37 | openstackgerrit | Lee Yarwood proposed openstack/nova-specs master: Image and flavor defined ephemeral storage encryption https://review.opendev.org/c/openstack/nova-specs/+/752284 | |
| 15:36:53 | teoobo_ | gibi: I am interested in helping out! | |
| 15:38:55 | kashyap | lyarwood: A stupid question - upstream CI runs instance deletion (functional) tests, right? Got a pointer to a latest run for it? | |
| 15:39:06 | kashyap | I think in any CI run I should be able to find it | |
| 15:40:38 | gibi | teoobo_: so there are those nice helpers for the functional test but they are not always used in the tests, so the work would be to find where direct api calls are used for those server actions and replace it with the call to the helper | |
| 15:40:44 | lyarwood | kashyap: remember that we change the real meaning of functional tests in Nova | |
| 15:41:03 | lyarwood | kashyap: do you mean actual instance deletion including the removal of a libvirt domain etc? | |
| 15:41:19 | lyarwood | kashyap: if so that's actually under integration testing with tempest and yeah there should be loads of examples | |
| 15:41:35 | lyarwood | kashyap: each time we create and instance we should eventually clean it up | |
| 15:41:40 | lyarwood | create an* | |
| 15:41:48 | kashyap | lyarwood: Yeah, indeed - actual instance deletion including the removal | |
| 15:41:52 | kashyap | ... of libvirt domain | |
| 15:41:57 | kashyap | lyarwood: The reason why I ask is, | |
| 15:42:04 | lyarwood | kashyap: kk, should be loads of examples in any tempest run | |
| 15:42:21 | kashyap | I was debugging an NVDIMM issue with OSP QE; and Nova (upstream) code currently assumes you have 'daxio' tool installed | |
| 15:42:38 | kashyap | But ... some enterprise distros don't have it installed in their containers :-) | |
| 15:42:43 | kashyap | And it's causing a mess | |
| 15:42:48 | kashyap | lyarwood: Okay; thanks! | |
| 15:43:16 | sean-k-mooney | https://specs.openstack.org/openstack/nova-specs/specs/train/implemented/virtual-persistent-memory.html#virtual-persistent-memory-disposal | |
| 15:43:22 | sean-k-mooney | its called out in the sepc that its requried | |
| 15:43:32 | sean-k-mooney | The nova compute libvirt driver uses daxio utility (wrapped by privsep library functions) for this purpose. | |
| 15:44:05 | sean-k-mooney | so just like ndctl it was missed in the deployment update in ooo/kolla | |
| 15:44:09 | kashyap | I'm aware; that's what I pointed out earlier | |
| 15:44:32 | kashyap | Yeah, they need to re-update the containers (Kolla, I guess) like they had to do for 'virt-admin' package | |
| 15:44:50 | lyarwood | yup | |
| 15:44:57 | lyarwood | it's an optional dep in Nova itself | |
| 15:45:07 | lyarwood | so we don't enforce it to be installed in code | |
| 15:46:20 | sean-k-mooney | https://github.com/openstack/kolla/commit/f9ea23d940ec4ce35d503ac62f202daaa9db502d only added ndctl | |
| 15:46:44 | sean-k-mooney | it need to be in nova_compute not nova_libvirt by the way | |
| 15:47:41 | kashyap | They also need ndctl-libs; without which 'daxio' doesn't work | |
| 15:47:58 | sean-k-mooney | ndctl should pull that in | |
| 15:48:03 | kashyap | (Yeah) | |
| 15:48:23 | openstackgerrit | Balazs Gibizer proposed openstack/nova stable/ussuri: Use cell targeted context to query BDMs for metadata https://review.opendev.org/c/openstack/nova/+/765748 | |
| 15:48:28 | kashyap | I'm hoping; but better be explicit than implicit | |
| 15:48:47 | kashyap | sean-k-mooney: Also what's the rationale for installing it in 'nova_compute' vs. 'nova_libvirt' container? | |
| 15:48:56 | kashyap | Just a bit ago I thought it should be in the latter | |
| 15:48:58 | kashyap | Container hell for the win | |
| 15:49:37 | sean-k-mooney | nova_libvirt just runs libvirtd | |
| 15:49:45 | sean-k-mooney | the compute agent that uses it is in nova_compute | |
| 15:51:00 | sean-k-mooney | https://rpmfind.net/linux/RPM/centos/8.3.2011/baseos/x86_64/Packages/ndctl-67-2.el8.x86_64.html | |
| 15:51:11 | sean-k-mooney | so it required ndctl-libs and daxctl-libs | |
| 15:51:27 | sean-k-mooney | but not the daxio cli im guessiing | |
| 15:51:51 | kashyap | (I know the container's purpose of course; but which container requires which deps to be installed isn't always apparent.) | |
| 15:51:58 | sean-k-mooney | ya its a seperate package https://centos.pkgs.org/8/centos-appstream-x86_64/daxio-1.6.1-1.el8.x86_64.rpm.html | |
| 15:52:02 | kashyap | It is | |
| 15:52:32 | sean-k-mooney | daxio does not depend on ndctl-libs by the way so that looks like a bug unless its an optional dep | |
| 15:52:44 | kashyap | It won't; daxio needs to be separately installed. | |
| 15:52:57 | kashyap | Either way; I'll file a tracker for TripleO to get this going | |
| 15:54:03 | sean-k-mooney | well we coudl reopen the bz. from an upstream ppoint of view this need 2 bugs or 1 but against 2 compnetnts | |
| 15:54:13 | sean-k-mooney | we need to update kolla and ooo | |
| 15:54:26 | sean-k-mooney | sicne we need the dep to be added to both image build systems | |
| 15:54:34 | sean-k-mooney | e.g. kolla and the new ooo one | |
| 15:54:58 | teoobo_ | gibi: do i have to open a bug on launchpad before working on it? | |
| 15:54:59 | sean-k-mooney | kolla for 16.1 and ooo for 16.2 | |
| 15:58:29 | gibi | teoobo_: no need for a bug, just add me and stephenfin to the patch as reviewer | |
| 15:59:20 | gibi | teoobo_: I suggest to propose one patch per helper if possible, and add the same gerrit topic to each patch | |
| 16:00:02 | teoobo_ | gibi: thanks again for the help | |
| 16:00:15 | gibi | teoobo_: I'm happy to help :) | |