| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2022-01-18 | |||
| 16:27:32 | bauzas | s/whats/wants (gosh) | |
| 16:28:14 | bauzas | if not, let's pretend we're done | |
| 16:28:18 | bauzas | #endmeeting | |
| 16:28:18 | opendevmeet | Meeting ended Tue Jan 18 16:28:18 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | |
| 16:28:18 | opendevmeet | Minutes: https://meetings.opendev.org/meetings/nova/2022/nova.2022-01-18-16.00.html | |
| 16:28:18 | opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/nova/2022/nova.2022-01-18-16.00.txt | |
| 16:28:18 | opendevmeet | Log: https://meetings.opendev.org/meetings/nova/2022/nova.2022-01-18-16.00.log.html | |
| 16:29:29 | gibi | this was faaast | |
| 16:29:36 | clarkb | I didn't mean to interrupt the meeting, just wanted to point out that I don't think anything has been fixed on centos 8 stream yet. At least not if you look at the package git repos | |
| 16:29:45 | clarkb | maybe they can revert packages without going through git | |
| 16:30:09 | sean-k-mooney | clarkb: i think i miss read the mail thread | |
| 16:33:14 | sean-k-mooney | i tought ye had forced the mirror update in http://lists.openstack.org/pipermail/openstack-discuss/2022-January/026687.html | |
| 16:33:36 | sean-k-mooney | https://bugzilla.redhat.com/show_bug.cgi?id=2037807 is currently on qa | |
| 16:33:38 | bauzas | clarkb: oh my bad, missed the context | |
| 16:34:04 | bauzas | clarkb: that's the problems with the meetings in lieu of the regular IRC chan | |
| 16:34:12 | bauzas | we get interruptions often | |
| 16:34:23 | clarkb | sean-k-mooney: I think fungi had the impression that it was fixed upstream when it wasn't. As far as I can tell there has been no fix made upstream yet. | |
| 16:34:26 | bauzas | so I thought your ping was unintentional | |
| 16:34:30 | clarkb | bauzas: ah | |
| 16:34:46 | clarkb | I could've been more specific that I was referring to the centos 8 ping issues :) | |
| 16:34:55 | sean-k-mooney | clarkb: ya its still on qa so it has not been shiped yet in rhel and presumable not yet in centos stream | |
| 16:35:06 | bauzas | clarkb: but yeah, reading at what you wrote, this makes perfect sense this was on purpose :D my bad. | |
| 16:35:33 | sean-k-mooney | clarkb: the plue reuest seams to have been merged here https://github.com/redhat-plumbers/systemd-rhel8/pull/246 | |
| 16:35:44 | clarkb | sean-k-mooney: we want systemd-239-55 or newer or a revert on the iputils package aiui | |
| 16:36:11 | sean-k-mooney | yes http://pkgs.devel.redhat.com/cgit/rpms/systemd/commit/?id=a4b172eaddf0882435fd2eb4d146012db8e5a2f2 | |
| 16:38:05 | sean-k-mooney | https://git.centos.org/rpms/systemd/commits/c8s | |
| 16:38:12 | sean-k-mooney | its still on 239-54 | |
| 16:39:59 | sean-k-mooney | sorry for the confusion ill see if i can find someoen internally | |
| 16:51:11 | fungi | clarkb: sean-k-mooney: the mirror update i forced was for centos stream 9, because the official mirror we'd been copying from started refusing rsync connections on friday | |
| 16:51:27 | fungi | unrelated to the ping behavior | |
| 18:47:13 | opendevreview | Ade Lee proposed openstack/nova master: Add check job for FIPS https://review.opendev.org/c/openstack/nova/+/790519 | |
| 20:03:49 | opendevreview | Merged openstack/nova master: libvirt: Add announce-self post live-migration workaround https://review.opendev.org/c/openstack/nova/+/741529 | |
| 21:26:33 | opendevreview | sean mooney proposed openstack/nova stable/xena: libvirt: Add announce-self post live-migration workaround https://review.opendev.org/c/openstack/nova/+/825064 | |
| 21:32:54 | opendevreview | sean mooney proposed openstack/nova stable/victoria: libvirt: Add announce-self post live-migration workaround https://review.opendev.org/c/openstack/nova/+/825175 | |
| 21:34:32 | opendevreview | sean mooney proposed openstack/nova stable/ussuri: libvirt: Add announce-self post live-migration workaround https://review.opendev.org/c/openstack/nova/+/825176 | |
| 21:37:20 | opendevreview | sean mooney proposed openstack/nova stable/train: libvirt: Add announce-self post live-migration workaround https://review.opendev.org/c/openstack/nova/+/825177 | |
| 21:45:42 | opendevreview | sean mooney proposed openstack/nova stable/wallaby: libvirt: Add announce-self post live-migration workaround https://review.opendev.org/c/openstack/nova/+/825178 | |
| 21:48:10 | opendevreview | sean mooney proposed openstack/nova stable/victoria: libvirt: Add announce-self post live-migration workaround https://review.opendev.org/c/openstack/nova/+/825175 | |
| 21:49:47 | opendevreview | sean mooney proposed openstack/nova stable/ussuri: libvirt: Add announce-self post live-migration workaround https://review.opendev.org/c/openstack/nova/+/825176 | |
| 21:51:29 | opendevreview | sean mooney proposed openstack/nova stable/train: libvirt: Add announce-self post live-migration workaround https://review.opendev.org/c/openstack/nova/+/825177 | |
| 22:46:01 | opendevreview | Merged openstack/nova master: Remove deprecated opts from VNC conf https://review.opendev.org/c/openstack/nova/+/824478 | |
| #openstack-nova - 2022-01-19 | |||
| 16:05:36 | opendevreview | Alexey Stupnikov proposed openstack/nova master: Support use_multipath for NVME driver https://review.opendev.org/c/openstack/nova/+/823941 | |
| 17:37:24 | spatel | Folks, i have glusterfs mounted on /var/lib/nova for my vms shared storage and everything working but when i delete my vm it didn't clean up files. i can still see disk and other file which taking lots of space. is that normal for nova | |
| 17:38:37 | sean-k-mooney | hum technially we dont support moutning /var/lib/nova on glusterfs however the shared file system support we have for mounting it on NFS shoudl work with it | |
| 17:39:10 | sean-k-mooney | the way we detect a shared files system is by touching a file which shoudl just work with any shared file system | |
| 17:39:25 | sean-k-mooney | in terems of deleting files | |
| 17:39:45 | sean-k-mooney | when you delete the vm it should delete the vm disk and other files in general | |
| 17:40:12 | sean-k-mooney | the backing files for hte guest image may stay in the image cache for a peiord of time but it will eventully get cleaned up | |
| 17:40:19 | sean-k-mooney | i wonder if this is liek the ceph issue | |
| 17:40:55 | sean-k-mooney | https://docs.openstack.org/nova/latest/configuration/config.html#workarounds.ensure_libvirt_rbd_instance_dir_cleanup | |
| 17:41:24 | spatel | hmm why did you say don't support glusterfs for /var/lib/nova ? | |
| 17:41:58 | sean-k-mooney | spatel: because we dont offcialy support or test that upstream | |
| 17:42:27 | sean-k-mooney | we test /var/lib/nova on nfs even thouhg we recommend using it | |
| 17:42:34 | spatel | but generally shared storage is storage just create file and delete file.. no matter who is in backend | |
| 17:42:42 | sean-k-mooney | but we have never offcially supprot clusterfs as afar as i recall | |
| 17:43:03 | sean-k-mooney | spatel: there are a buch of issue with locks and move operation that the latency of shared storage can cause | |
| 17:43:12 | sean-k-mooney | so in general we do not support it | |
| 17:43:19 | spatel | we have 800TB of glusterfs and it would be bad if i mount that on foo server and then mount on 50 compute nodes | |
| 17:44:07 | spatel | That is interesting... | |
| 17:44:12 | sean-k-mooney | in generall if you want ot use glusterfs with openstack the only supporte way to do it would via cinder | |
| 17:44:37 | sean-k-mooney | it can work the way you have it deplyed but its not a tested configuration and was never expiclty supported | |
| 17:46:06 | spatel | may be i am the first use case here.. :) i would still like to push it and try out because we already have large storage which i would like to use. | |
| 17:46:33 | spatel | if i see any issue (major issue) then i may switch to NFS | |
| 17:47:20 | spatel | If i go with cinder then its not going to be shared storage correct? does live migration will be supported with cinder base deployment? | |
| 17:48:07 | sean-k-mooney | spatel: well jsut a word of warning if we could remove support for this capablity entirly we would | |
| 17:48:25 | sean-k-mooney | we dont like support nfs backed /var/lib/nova | |
| 17:48:51 | sean-k-mooney | we only maintian supprot becasue we have some old large clouds that use it but this area fo the code is not activly maintained | |
| 17:49:03 | spatel | hmm! so in short no to shared storage except ceph. correct? | |
| 17:49:24 | sean-k-mooney | basically and even for ceph not by using cephfs | |
| 17:49:42 | spatel | ceph rbd | |
| 17:49:49 | sean-k-mooney | the probelm is that when using shared storate like this we are actully using a local storage driver in nova | |
| 17:50:06 | sean-k-mooney | e.g. image_type=qcow | |
| 17:50:07 | spatel | i know what you saying.. mounting nova on shared storage can have all kind of issue | |
| 17:50:31 | sean-k-mooney | and have sprincked some check in random parts of the code to do something else fi we detect its on shared storage | |
| 17:50:59 | sean-k-mooney | the main one come up aroudn move operations and evacuate | |
| 17:51:16 | sean-k-mooney | e.g. we need to make sure we dont overrie the image if we do a cold/live migration | |
| 17:51:36 | sean-k-mooney | and dont recreate it if we evacuate | |
| 17:51:42 | sean-k-mooney | to prevent loosing data | |
| 17:51:56 | spatel | hmm | |
| 17:52:22 | spatel | so what option i have in current design with glusterfs ? | |
| 17:52:36 | spatel | cinder boot volum? | |
| 17:52:43 | sean-k-mooney | if the sync time between writing a file on one host and reading it on another is long enough we might not detect its on shared storage whchi can be bad | |
| 17:52:58 | sean-k-mooney | cinder boot form vomue woudl work yes | |
| 17:53:19 | spatel | does cinder support glusterfs ? | |
| 17:53:23 | sean-k-mooney | what you are doign can work just be aware that there are dragons wehn you do this. | |
| 17:53:26 | sean-k-mooney | am it used too | |
| 17:54:08 | spatel | I understand this cluster not going to hold critical data. this is for crunch some data and give dynamic result | |
| 17:54:37 | sean-k-mooney | am its avaible for cinder backup | |
| 17:54:38 | sean-k-mooney | https://docs.openstack.org/cinder/latest/drivers.html#glusterfsbackupdriver | |
| 17:54:44 | sean-k-mooney | not sure about cidner in general | |
| 17:55:42 | spatel | let me do some research and see what i can do | |
| 17:56:21 | sean-k-mooney | in generall it looks like no | |
| 17:56:30 | spatel | oh boy :( | |
| 17:56:39 | sean-k-mooney | we do not have a volume driver in nova for gluster | |
| 17:56:41 | sean-k-mooney | https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L176-L191 | |
| 17:56:51 | sean-k-mooney | so it can be used for backup bug not vms | |
| 17:57:25 | spatel | I think i should try NFS now because folks are using it.. | |
| 17:57:45 | spatel | i know you hate but i need something to move forward and deal with issue later. :) | |
| 17:58:22 | spatel | we have plan to buy dedicated ceph storage but that is not today but after few months | |
| 17:59:05 | sean-k-mooney | ack the way we detech shared storage https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L10893-L10912 | |