Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2024-09-10
17:34:02 sean-k-mooney woudl that be useful for you
17:34:48 sean-k-mooney there is nothign actionalable here so warning and error woudl not be approate but info woudl likely be ok
17:36:24 whoami-rajat sean-k-mooney, yeah, given the current discussion, i feel that would be a better path to pursue, thanks
17:36:31 whoami-rajat honestly i thought it would be a trivial change to get in and backported since currently the BDMs for FC and iSCSI are just inconsistent
17:36:47 whoami-rajat but looks like the efforts will outweigh the usefulness of the change
17:37:05 whoami-rajat so I'm good with a DEBUG or INFO level logging message
17:37:40 sean-k-mooney the normalisation level argument can be made, im just not sure if that is commpeling enough but its worth considering at least
17:38:04 sean-k-mooney s/level//
17:39:00 sean-k-mooney dansmith: gibi ^ is that more appealign to ye? just a new info level log?
17:39:16 opendevreview Dmitriy Rabotyagov proposed openstack/nova master: Respect supplied arguments in novncproxy_base_url https://review.opendev.org/c/openstack/nova/+/928839
17:40:24 whoami-rajat gibi, basically sean-k-mooney is proposing to add a INFO level log message to print the multipath_id and volume_id for the correlation, if that's OK for the nova team
17:41:16 noonedeadpunk do you have some specific topic during the meeting for blueprint discussion? or just open discussion?
17:41:28 sean-k-mooney noonedeadpunk: just open discussion
17:42:28 gibi whoami-rajat, sean-k-mooney: yeah adding info level logs sounds good to me
17:43:38 noonedeadpunk awesome, thanks!
17:46:10 whoami-rajat thanks gibi and sean-k-mooney , i will pursue that path then
18:27:35 opendevreview Merged openstack/nova master: Update compute rpc alias for dalmatian https://review.opendev.org/c/openstack/nova/+/928661
18:36:02 opendevreview sean mooney proposed openstack/nova master: Add functional repoducer for ephemeral disks https://review.opendev.org/c/openstack/nova/+/928310
18:36:02 opendevreview sean mooney proposed openstack/nova master: only saftey check bootable files created form glance https://review.opendev.org/c/openstack/nova/+/928829
18:36:03 opendevreview sean mooney proposed openstack/nova master: adapt to vfat support in oslo.utils https://review.opendev.org/c/openstack/nova/+/928462
18:38:20 sean-k-mooney bauzas: dansmith i think https://review.opendev.org/q/topic:%22bug/2079850%22 should work. its passing unit/functional tests at least
18:38:37 sean-k-mooney but i have not had time to test it in devstack so we will see what the ci thinks
19:04:36 opendevreview sean mooney proposed openstack/nova master: Add functional repoducer for ephemeral disks https://review.opendev.org/c/openstack/nova/+/928310
19:06:33 sean-k-mooney ill respin thoes in the morning if anything fails. im debating if i should add a release note to the second patch but since we have not released yet i dont htink its needed
19:06:53 sean-k-mooney if other disagree i can add it tomorrow
19:14:01 opendevreview Merged openstack/placement master: Update 2024.2 reqs to support os-traits 3.1.0 as min version https://review.opendev.org/c/openstack/placement/+/928663
#openstack-nova - 2024-09-11
00:54:01 opendevreview sean mooney proposed openstack/nova master: Add functional repoducer for ephemeral disks https://review.opendev.org/c/openstack/nova/+/928310
00:54:51 opendevreview sean mooney proposed openstack/nova master: only saftey check bootable files created form glance https://review.opendev.org/c/openstack/nova/+/928829
00:55:06 opendevreview sean mooney proposed openstack/nova master: adapt to vfat support in oslo.utils https://review.opendev.org/c/openstack/nova/+/928462
01:27:55 opendevreview sean mooney proposed openstack/nova master: only saftey check bootable files created form glance https://review.opendev.org/c/openstack/nova/+/928829
01:27:55 opendevreview sean mooney proposed openstack/nova master: adapt to vfat support in oslo.utils https://review.opendev.org/c/openstack/nova/+/928462
07:58:57 sahid o/
07:59:18 sahid quick question guys, when we have a host ins maintenance, is there a way tp schedule VM on it?
07:59:22 sahid I mean as admin
07:59:35 sahid that to valid the behavior of the host
08:34:00 tobias-urdin we usually create a instance then live migrate it to the host to test it out without enabling it for scheduling
10:03:32 sahid tobias-urdin: interesting workaround thank you
10:03:46 sahid btw it may be useful for an admin to have this priviledge
10:06:01 tis_at_teuto Hi, not shure if this is the right place to ask but currently we have a problem mit oom-kill pcpu-instances. They got oom-killed with `oom-kill:constraint=CONSTRAINT_MEMORY_POLICY`. We use pinned cpus and nova-compute sets the the libvirt numatune.memory and numatune.memnode statically to `mode=strict` https://github.com/openstack/nova/blob/master/nova/virt/libvirt/config.py#L2812 . Is it possible to get this configurable or
10:06:04 tis_at_teuto use preferred instead like mentioned in https://docs.redhat.com/en/documentation/red_hat_enterprise_linux/6/html/virtualization_tuning_and_optimization_guide/sect-virtualization_tuning_optimization_guide-numa-allocation_policy#sect-Virtualization_Tuning_Optimization_Guide-NUMA-Allocation_Policy
11:40:04 opendevreview Merged openstack/osc-placement stable/2024.2: Update .gitreview for stable/2024.2 https://review.opendev.org/c/openstack/osc-placement/+/928358
11:45:13 sean-k-mooney tobias-urdin: sahid if you have disabeld the compute you cannot live migrate to it by defualt. to do so you have to use the old microversin and force the migration
11:45:27 sean-k-mooney sahid: we intentionally do now allow this to work by defualt
11:45:48 sean-k-mooney when a comptue service is disabeld you shuld be able to move instance away form it but not to it
11:46:09 opendevreview Merged openstack/osc-placement stable/2024.2: Update TOX_CONSTRAINTS_FILE for stable/2024.2 https://review.opendev.org/c/openstack/osc-placement/+/928359
11:46:40 sean-k-mooney tis_at_teuto: my initall gues is that you have not defied hw:mem_page_size in your pinned instance
11:47:16 sean-k-mooney tis_at_teuto: when using cpu pinnign either you need to request numa aware memory usign hw:mem_page_size or you need to configure the host for file backed memroy
11:47:48 sean-k-mooney if you dont do one of those two then we expect OOM issue for the vms, its an unsupproted configuraiton.
11:48:43 sean-k-mooney tis_at_teuto: we do not supprot settign the memroy policy to prefered or memory overcommit when using pinned cpus
11:49:17 sean-k-mooney there was a proposal for that many many years ago but it was never implemented
12:29:53 opendevreview Lajos Katona proposed openstack/nova master: docs: update libvirt support matrix for C and D https://review.opendev.org/c/openstack/nova/+/928903
12:30:45 opendevreview Lajos Katona proposed openstack/nova master: docs: update libvirt support matrix for C and D https://review.opendev.org/c/openstack/nova/+/928903
12:30:58 tis_at_teuto sean-k-mooney: Ok, thank you. I will have a look into `hw:mem_page_size`. In the meantime we mitigate the problem by configuring a swap-file. I think that is what you second approach is.
12:31:28 sean-k-mooney swapfiles will only help if you have multiple of them and also mark them as related to a given numa node
12:31:39 sean-k-mooney the OOM reaper runs on a per numa basis
12:31:58 sean-k-mooney so even if you have lots of free swap you can still have OOM issues
12:32:12 sean-k-mooney or free ram on the wrong numa node
12:33:48 lajoskatona bauzas: https://review.opendev.org/c/openstack/nova/+/928903 , pushed an update for qemu/libvirt support matrix, as I see no change in it in C and D, just to be clear for end-users
12:34:08 sahid sean-k-mooney: sean-k-mooney: do you remeber the microversion to use, even when i try to live-migrate on the specified host, I receive the error nova valid host was found
12:35:37 sean-k-mooney force was added in 2.30 and removed in 2.68 so 2.30-2.67
12:36:02 sean-k-mooney sahid: note that force skips schdluer filters
12:36:28 sean-k-mooney it just checks the host exists, placement should still confirm that there is enouch suport for basic resouces
12:38:25 sean-k-mooney note that the compute status filter has been mandaory for many releases
12:38:28 sean-k-mooney https://github.com/openstack/nova/blob/master/nova/scheduler/request_filter.py#L242-L255
12:38:46 sean-k-mooney so where that is not configurabel there is no way to schdule to a disabeld host by design
12:40:11 sean-k-mooney ah i miss rememeberd we intoduced this as a mandatoy prefilter 5 years ago
12:40:13 sean-k-mooney https://github.com/openstack/nova/commit/168d34c8d1161dc4d62493e194819297e079bb51
12:40:28 sean-k-mooney so since placment because mandatory there is not way by design to schduler to disabled computes
13:38:01 bauzas sean-k-mooney: thanks for your work on the "vfat is non-bootable so we can skip it" series, just +2d saying this is fine given oslo will support vfat checks shortly
13:38:23 bauzas if not, I'd be afraid of another attack vector
13:38:48 sean-k-mooney there is an oslo patch for it reference form the 3rd patch
13:38:57 bauzas yes I know, hence my +2
13:39:22 sean-k-mooney im also considerign doing a quick poc of both makeing epmeral disk unformated and removing the backing files form them
13:39:53 sean-k-mooney with that said i dont really have much time to look at either but since im already looking at that code i was going to spend an hour or two and see if they would be easy to do for epoxy
13:40:49 sean-k-mooney the reason i choose bootable as the new flag is i think tis reasonabel to say in the qemu driver that non-bootable disk should not have backing files ever.
13:41:09 sean-k-mooney but i have not really tought about all the implications yet so i didnt want to include that in this inital work
13:43:06 bauzas no worries, given by 2025.1 we will be able to look at vfat, we could remove the skip for non-bootable disks
13:43:48 sean-k-mooney we could thats definetly a diesign disucsison we shoudl have early in 2025.1
13:44:16 sean-k-mooney in my head im kind fo grouping this with the geneal "state of the image backends" topic
13:44:44 sean-k-mooney i think this is just one of the many workitems that go into improving that going forward
14:18:12 opendevreview Dmitriy Rabotyagov proposed openstack/nova master: Respect supplied arguments in novncproxy_base_url https://review.opendev.org/c/openstack/nova/+/928839
14:32:02 opendevreview Kaloyan Kotlarski proposed openstack/nova master: libvirt: Fetch the available vCPUs from the respective cgroup https://review.opendev.org/c/openstack/nova/+/927474
15:02:13 sahid alian
15:02:16 sahid alianz
15:23:27 dansmith sean-k-mooney: safe sounds okay to me
15:24:24 sean-k-mooney ok i can go change that how would you feel about using that for skiping the backing file too?
15:24:30 sean-k-mooney in a seperate patch obviously
15:24:53 sean-k-mooney i.e. not haveing swap an ephmeral have backing files with qcow backend
15:25:25 sean-k-mooney dansmith: ill fix the typoes ectra but were there any other concerns
15:25:42 sean-k-mooney ill repin the patch after the our internal calls end
15:27:12 dansmith sean-k-mooney: I have concerns about how many places you had to make that change :P
15:27:18 dansmith but that's imagebackend's fault not yours
15:33:44 sean-k-mooney ya at least 1 of those i was really not expecting
15:33:52 sean-k-mooney we have a lot of duplication
15:55:36 opendevreview Rajesh Tailor proposed openstack/nova master: Add support for showing finish_time https://review.opendev.org/c/openstack/nova/+/928933
16:06:12 opendevreview Dan Smith proposed openstack/nova stable/2023.1: [stable-only]: Port qcow2v2 support from oslo https://review.opendev.org/c/openstack/nova/+/928937
16:57:38 bauzas we need a second core for https://review.opendev.org/c/openstack/nova/+/928662 please :)
16:59:46 sean-k-mooney that looks correct to me
17:01:17 bauzas thanks
19:03:15 opendevreview sean mooney proposed openstack/nova master: [DNM] testing rdo experimental jobs https://review.opendev.org/c/openstack/nova/+/927762

Earlier   Later