| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2022-04-26 | |||
| 03:28:53 | fzzf[m] | * hi folks. I use nodepool connect openstack provider. in openstack, nova build instance failed. and nova list show instance is in BUILD state. and I can't delete it.... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/nhRIVjZthAjNvxgkNkdUczzV) | |
| 07:18:08 | Uggla | Good morning. o/ | |
| 07:37:56 | bauzas | Uggla: good morning | |
| 08:31:04 | gibi | o/ | |
| 08:56:04 | sean-k-mooney | gmann: dansmith care to readd your +w for moving the fips job to c9s https://review.opendev.org/c/openstack/nova/+/831844/7 | |
| 09:30:24 | fzzf[m] | hi folks. I use nodepool connect openstack provider. nova build instance failed. and nova list show instance is in BUILD state like follow. I delete it prompt No server with a name or ID. and in dashboard show have use these two instance, 8 vcpu, 16g memory, openstack is packstack train ,nova is 15.1.1... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/cXVvKGZbhOphiZZcinYshnCe) | |
| 10:30:31 | opendevreview | Balazs Gibizer proposed openstack/nova stable/train: Reproduce bug 1953359 https://review.opendev.org/c/openstack/nova/+/839353 | |
| 10:30:32 | opendevreview | Balazs Gibizer proposed openstack/nova stable/train: Extend the reproducer for 1953359 and 1952915 https://review.opendev.org/c/openstack/nova/+/839354 | |
| 10:30:33 | opendevreview | Balazs Gibizer proposed openstack/nova stable/train: [rt] Apply migration context for incoming migrations https://review.opendev.org/c/openstack/nova/+/839355 | |
| 11:03:07 | gibi | bauzas: I'm not when you clean up the nova meeting agenda but I now added a topic for Open Discussion for this week's meeting | |
| 11:03:14 | gibi | * I'm not sure | |
| 11:10:46 | sean-k-mooney | artom: by the way while you are fixing revert if you feel like updating https://review.opendev.org/c/openstack/nova/+/750217/2 i would not object. i should really get back to that but have not had the time | |
| 11:22:41 | opendevreview | Andrew Bonney proposed openstack/nova master: Fix segment-aware scheduling permissions error https://review.opendev.org/c/openstack/nova/+/839361 | |
| 11:57:36 | sean-k-mooney | woot! just tested cold migration with vdpa on real hardware with my WIP patch and it indeed worked as the func tests said it should | |
| 11:58:15 | sean-k-mooney | i need to test every thing else and then reivew the logs but this is a good sign | |
| 12:01:23 | sean-k-mooney | shelve and resize work too | |
| 12:09:39 | sean-k-mooney | evacuate works too and the device is correctly released if/when the source host is started after the evac | |
| 12:10:11 | sean-k-mooney | so that is all the move ops that should work exluding live-migration which qemu does not support | |
| 12:12:36 | sean-k-mooney | ok suspend is broken but that fine that is going to be split into another patch anyway and i am pretty sure i know why that is broken anyway. im using the generic pci device detach function and i shoudl be using the interface detach version since vdpa devices ues the interface not host dev elements like normal sriov vfs | |
| 12:14:14 | gibi | sean-k-mooney: nice! | |
| 12:16:14 | sean-k-mooney | im really happy i was able to more or less prove this out with the functional tests ahead of time | |
| 12:16:34 | sean-k-mooney | i kindof expected suspend to fail too which is why i wanted to test this on real hardware | |
| 12:25:11 | Uggla | sean-k-mooney, I guess you manage to install ceph on top of Centos Stream. Any hints to fix that: nothing provides "libpython3.6m.so.1.0()(64bit) needed by ceph-mgr-2:16.2.7-0.el8.x86_64" | |
| 12:32:30 | sean-k-mooney | Uggla: how are you isntalling ceph? with the devstack plugin or by hand? | |
| 12:33:31 | sean-k-mooney | by the way that looks like you are just missin python3-devel | |
| 12:34:02 | sean-k-mooney | also are you using centos stream 8 | |
| 12:34:07 | sean-k-mooney | that is not supported anymore | |
| 12:34:15 | Uggla | sean-k-mooney, devstack plugin (from manila local.conf example : https://docs.openstack.org/manila/latest/_downloads/e31f39ce83daac60c4348fde522cee1e/cephfs_local.conf) | |
| 12:34:18 | sean-k-mooney | you should be using centos stream 9 | |
| 12:34:35 | sean-k-mooney | openstack nolonger support python 3.6 | |
| 12:34:35 | Uggla | sean-k-mooney, it is a stream9 | |
| 12:34:54 | sean-k-mooney | libpython3.6 is python 3.6 | |
| 12:35:01 | sean-k-mooney | centos stream 9 uses 3.9 | |
| 12:35:21 | Uggla | for anyreason it seems the plugin is trying to install a pkg from centos 8 | |
| 12:37:25 | Uggla | Problem: package ceph-2:16.2.7-0.el8.x86_64 requires ceph-mgr = 2:16.2.7-0.el8 but it is clearly a stream 9. I'm gonna have a look where the ceph package comes from. | |
| 12:38:18 | sean-k-mooney | i dont think they have added centos stream 9 support to the devstack plugin yet | |
| 12:38:25 | sean-k-mooney | just looking at the code | |
| 12:38:43 | sean-k-mooney | i was using ubutnu 20.04 for my ceph testing | |
| 12:39:27 | sean-k-mooney | you can set CEPH_CONTAINERIZED=True in your local.conf | |
| 12:39:31 | sean-k-mooney | that might fix the issue for you | |
| 12:39:51 | Uggla | sean-k-mooney, it install this repo : https://download.ceph.com/rpm-pacific/el8/$basearch | |
| 12:40:08 | sean-k-mooney | yes | |
| 12:40:19 | sean-k-mooney | https://opendev.org/openstack/devstack-plugin-ceph/src/branch/master/devstack/lib/ceph#L31 | |
| 12:40:27 | sean-k-mooney | that is contolled by that ^ | |
| 12:41:48 | sean-k-mooney | Uggla: you should have hit this check https://opendev.org/openstack/devstack-plugin-ceph/src/branch/master/devstack/lib/ceph#L271-L28 | |
| 12:41:55 | sean-k-mooney | you ar enot running a supported os | |
| 12:43:00 | Uggla | sean-k-mooney, yep I had to add FORCE_CEPH_INSTALL=yes | |
| 12:43:16 | sean-k-mooney | ya that is why this is failing | |
| 12:43:23 | sean-k-mooney | so the repo config is contoled by https://opendev.org/openstack/devstack-plugin-ceph/src/branch/master/devstack/lib/ceph#L913-L943 | |
| 12:43:47 | bauzas | gibi: ack, thanks | |
| 12:44:14 | sean-k-mooney | Uggla: that is currently hardcoded to el8 | |
| 12:44:17 | sean-k-mooney | https://opendev.org/openstack/devstack-plugin-ceph/src/branch/master/devstack/lib/ceph#L1144 | |
| 12:44:18 | Uggla | sean-k-mooney, yep but in the repo there is no el9. | |
| 12:45:50 | sean-k-mooney | ya i see that | |
| 12:46:26 | Uggla | sean-k-mooney, CEPH_CONTAINERIZED=True, will install ceph in a container ? | |
| 12:46:32 | sean-k-mooney | yep | |
| 12:46:44 | sean-k-mooney | https://opendev.org/openstack/devstack-plugin-ceph/src/branch/master/devstack/lib/ceph#L157-L174 | |
| 12:47:02 | Uggla | sean-k-mooney, do you think it will work ? | |
| 12:47:05 | sean-k-mooney | so it will install ceph in a container and dinstall just the ceph client on the host form ceph_common | |
| 12:47:28 | Uggla | sean-k-mooney, I'm going to try... | |
| 12:47:34 | sean-k-mooney | i think it will be the only way to install ceph currently on centos 9 stream | |
| 12:48:17 | sean-k-mooney | Uggla: they are currently in the process or rewriting this plugin to use cephadm by the way | |
| 12:48:26 | sean-k-mooney | that might add centos 9 support as a result | |
| 12:49:00 | Uggla | sean-k-mooney, centos stream9 is currently a bit too more bleeding edge. :) | |
| 12:49:23 | sean-k-mooney | that is generally not a good thing | |
| 12:49:47 | sean-k-mooney | am so the way to work around this for centos 9 stream would be to use ceph form disto packages instead fo from upstream ceph | |
| 12:49:57 | sean-k-mooney | https://buildlogs.centos.org/centos/9-stream/storage/x86_64/ceph-quincy/ | |
| 12:50:40 | Uggla | sean-k-mooney, require docker of course any preference in between docker or podman ? | |
| 12:51:59 | sean-k-mooney | it will install it | |
| 12:52:10 | sean-k-mooney | it will use docker | |
| 12:52:42 | sean-k-mooney | the simplest thing to do might be to implemtn centos 9 stream support int he plugin | |
| 12:53:43 | Uggla | sean-k-mooney, I don't really like your "simplest" solution. :D | |
| 12:55:27 | sean-k-mooney | Uggla: well we all maintian devstack together :) but ill talk to the devstack/qa folk and see if i can find time to add centos 9 support | |
| 12:55:41 | sean-k-mooney | Uggla: must people dont use centos by the way | |
| 12:56:00 | sean-k-mooney | so if a feature does not work on centos it generally falls to use to add it if we want to use it | |
| 12:57:20 | Uggla | sean-k-mooney, I was kidding. That could be an interesting thing to do and learn. But not the simplest I think. | |
| 12:57:35 | Uggla | sean-k-mooney, at least for me. | |
| 12:59:57 | sean-k-mooney | try usign it form contianer for now | |
| 13:00:21 | sean-k-mooney | manilla does not strictly need ceph and you do not need ceph for your manilla share work | |
| 13:00:44 | sean-k-mooney | so you can go back to just using cinder lvm for now until you ahve the basic supprot working | |
| 13:00:49 | sean-k-mooney | and look at using ceph later | |
| 13:01:15 | sean-k-mooney | i.e. deploy manila with cinder lvm and use nfs shares initally | |
| 13:02:46 | sean-k-mooney | then when we figure out how to deploy ceph on centos 9 and add supprot to devstack we can then extend the nova supprot to work with cephfs although that really should not need much code change in nova just mounting the share | |
| 13:03:22 | Uggla | sean-k-mooney, yes and no. So for I focus on NFS. There are still things to fix but it seems I manage to mount the share into the VM using virtiofs + NFS. | |
| 13:03:53 | Uggla | sean-k-mooney, I wanted to do the same for CEPHFS. | |
| 13:04:33 | sean-k-mooney | ack | |
| 13:05:37 | Uggla | sean-k-mooney, and yes from nova perspective, that sounds like not a major change. | |
| 13:06:02 | Uggla | sean-k-mooney, however I'm not blocked. | |
| 13:11:23 | fzzf[m] | > <@fzzfh:matrix.org> hi folks. I use nodepool connect openstack provider. nova build instance failed. and nova list show instance is in BUILD state like follow. I delete it prompt No server with a name or ID. and in dashboard show have use these two instance, 8 vcpu, 16g memory, openstack is packstack train ,nova is 15.1.1... (full message at https://matrix.org/_matrix/media/r0/download/matrix.org/oDINtdoeiJnrakEWVAWwmwho) | |
| 13:39:58 | Uggla | 44bf4c5e-b6ae-463d-9ed2-3d0177c1ee80 on /nene type virtiofs (rw,relatime) \o/ (I still have to fix stuff, but that's a milestone for me) | |
| 13:41:45 | artom | *snerk* /nene | |
| 14:05:13 | bauzas | gibi: good idea of creating an etherpad for https://etherpad.opendev.org/p/nova-bug-triage-20220419 | |
| 14:05:23 | bauzas | gibi: do you want to discuss about this on the meeting ? | |
| 14:44:40 | gibi | bauzas: I planned to link that to on the meeting for reference | |
| 14:44:50 | bauzas | ok | |
| 14:45:05 | gibi | bauzas: and I will ask if we want to make it a mail or keep it an etherpad | |
| 14:45:29 | bauzas | mho is that etherpad is just enough | |
| 14:47:04 | gibi | yeah I'm OK with this being a pads | |
| 15:16:58 | bauzas | gentle reminder : nova meeting in 45 mins by now here at #openstack-nova | |
| 15:30:41 | opendevreview | ribaudr proposed openstack/nova master: [WIP] Attach Manila shares via virtiofs (db) https://review.opendev.org/c/openstack/nova/+/831193 | |