| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2022-07-07 | |||
| 11:27:50 | sean-k-mooney | ok its because we have linuxbrdge in the default mech drivers in those jobs in addtion to ovs | |
| 11:33:11 | sean-k-mooney | ok i sent a mail to the list please hold of recheks in nova until i fix this | |
| 11:33:45 | sean-k-mooney | ill file a gate bug then fix the job configs and reference the neuton change that broke things in the commit once i find it | |
| 11:43:16 | sean-k-mooney | https://bugs.launchpad.net/os-vif/+bug/1980948 | |
| 11:43:35 | sean-k-mooney | or https://bugs.launchpad.net/nova/+bug/1980948 | |
| 11:43:44 | sean-k-mooney | im going to use the same bug for both and fix both | |
| 11:49:49 | opendevreview | sean mooney proposed openstack/nova master: update nova-next and nova-ovs-hybrid-plug to disable linuxbridge https://review.opendev.org/c/openstack/nova/+/848948 | |
| 11:56:45 | opendevreview | sean mooney proposed openstack/os-vif master: update ci since linuxbridge is now experimental https://review.opendev.org/c/openstack/os-vif/+/848949 | |
| 11:59:38 | sean-k-mooney | ci is still pendign but gibi stephenfin bauzas can you review those | |
| 13:05:47 | gibi | sean-k-mooney: +2 on both thanks for detecting and fixing it | |
| 13:09:44 | sean-k-mooney | gibi: thanks | |
| 13:14:15 | TheJulia | sean-k-mooney: and that requires finding time to do so, unfortunately | |
| 13:37:30 | bauzas | gibi: sean-k-mooney: sorry I got a network issue with my F36 upgrade :( | |
| 13:48:17 | opendevreview | Amit Uniyal proposed openstack/nova master: Adds check, if admin has set compute service down https://review.opendev.org/c/openstack/nova/+/848886 | |
| 13:54:23 | gibi | bauzas: ack | |
| 14:36:56 | Uggla | gibi, can you keep some time for me tomorrow morning. I'm blocked with notification. | |
| 14:37:21 | gibi | Uggla: yes, I can. We can have a session. | |
| 14:38:22 | gibi | Uggla: I think I will be available from 10:00 CEST til 17:30 CEST tomorrow | |
| 14:38:32 | Uggla | gibi, great it will be good. | |
| 14:41:59 | Uggla | gibi, are you aware of any specific stuff regarding cells in TestInstanceNotificationSampleWithMultipleCompute ? | |
| 14:42:57 | Uggla | gibi, sorry my bad TestInstanceNotificationSample | |
| 14:46:23 | gibi | Uggla: cells in func test are coming from https://github.com/openstack/nova/blob/512fbdfa9933f2e9b48bcded537ffb394979b24b/nova/test.py#L393-L419 when the compute service is created. As far as I see TestInstanceNotificationSample does not specify any cell so all compute is created in cell1 by default | |
| 14:52:38 | gibi | so if you need computes in different cells then you have to create compute services will cell_name parameter provided | |
| 15:10:21 | opendevreview | Merged openstack/os-vif master: update ci since linuxbridge is now experimental https://review.opendev.org/c/openstack/os-vif/+/848949 | |
| 16:07:33 | sean-k-mooney[m] | my laptop decided to power off | |
| 16:08:31 | sean-k-mooney[m] | im not sure why but im starting it again | |
| 16:16:36 | bauzas | sean-k-mooney1: our laptops are fun | |
| 16:17:08 | bauzas | I have a T14s with 8 CPUs but it's still playing worst than my old 8-year laptop | |
| 17:09:11 | opendevreview | Rajesh Tailor proposed openstack/nova stable/yoga: Remove return from rpc cast https://review.opendev.org/c/openstack/nova/+/848993 | |
| 20:46:57 | opendevreview | Merged openstack/nova master: update nova-next and nova-ovs-hybrid-plug to disable linuxbridge https://review.opendev.org/c/openstack/nova/+/848948 | |
| #openstack-nova - 2022-07-08 | |||
| 04:58:36 | opendevreview | Amit Uniyal proposed openstack/nova master: Adds check, if admin has set compute service down https://review.opendev.org/c/openstack/nova/+/848886 | |
| 07:34:47 | bauzas | good Friday Nova | |
| 08:04:10 | Uggla | bauzas, hello did you upgrade to F36 ? | |
| 08:04:17 | bauzas | yup | |
| 08:04:31 | bauzas | had an issue with my network, but this was on me | |
| 08:05:00 | bauzas | my perf issues with Wayland and any video stream eating all my CPU aren't fixed | |
| 08:05:51 | bauzas | I have to try to see whether I could use hardware acceleration (I have an intel gpu) for those streams | |
| 08:06:01 | bauzas | intel soc I mean | |
| 08:06:53 | Uggla | bauzas, any diff if you use xorg ? | |
| 08:07:06 | bauzas | Uggla: haven't tested yet | |
| 08:07:18 | bauzas | but I need a reproducible test | |
| 08:07:28 | bauzas | I'll use webrtc | |
| 08:07:47 | bauzas | sar gives me a lot of information | |
| 08:08:07 | bauzas | but this is clear this is just a CPU-bound task, that's it | |
| 08:08:12 | bauzas | not a lot of context switching | |
| 08:08:24 | bauzas | my sys % is high, about 20% | |
| 08:08:30 | bauzas | and user % is about 60% | |
| 08:08:36 | bauzas | so I straced | |
| 08:08:41 | bauzas | and I see lots of polling | |
| 08:08:47 | gibi | good morning | |
| 08:09:31 | Uggla | bauzas, mine is also slow sometime when it is getting hot. I think the cooling system is a bit limited. | |
| 08:09:36 | Uggla | gibi, o/ | |
| 08:09:49 | bauzas | Uggla: good point, I should dig sar's power information | |
| 08:10:12 | gibi | d | |
| 08:10:12 | gibi | Uggla: give me 20 mins and I'm all yours if neede | |
| 08:10:17 | bauzas | and yeah, in general, my fan is yelling | |
| 08:10:44 | bauzas | I suspected that the CPU is stepping down | |
| 08:10:51 | bauzas | hence the perf issues | |
| 08:11:05 | bauzas | but that's a guess | |
| 08:11:06 | Uggla | bauzas, in such case, I can not switch the power balance to performance, it sticks to balanced. | |
| 08:11:24 | bauzas | Uggla: me too, can't modify it | |
| 08:11:46 | bauzas | this is like I was running my laptop unplugged | |
| 08:11:59 | bauzas | which shouldn't be the rule | |
| 08:12:22 | bauzas | if my laptop is plugged, I shall expect max performance and CPU power not stepping down | |
| 08:12:47 | bauzas | but yeah, haven't checked the temperature | |
| 08:12:56 | bauzas | you make me realize a thing | |
| 08:13:13 | bauzas | I think my fan was yelling because the CPU was intensively high | |
| 08:13:17 | bauzas | thought* | |
| 08:13:24 | bauzas | but that could be the contrary | |
| 08:13:40 | bauzas | if the temperature rises, then the fan yells and then the CPU could step down | |
| 08:14:11 | bauzas | all of this seems tied to Fedora power management tools | |
| 08:14:37 | bauzas | but yeah, needs a reproducer to validate | |
| 08:14:54 | bauzas | Uggla: either way, I was having performance trouble with F35 already | |
| 08:15:00 | bauzas | so F36 isn't a regression | |
| 08:15:28 | Uggla | bauzas, I think it is what happened in my case. And that's dramatically long when you run the openstack tests suite. | |
| 08:16:10 | bauzas | point is, the TB3 system doesn't help | |
| 08:16:20 | bauzas | previously with my other laptops, those were docked | |
| 08:16:33 | bauzas | so the fan was having room for air | |
| 08:16:52 | bauzas | now, with the tb3 plug, the laptop is just sit down | |
| 08:16:54 | Uggla | clearly | |
| 08:17:42 | bauzas | will continue to dig into it | |
| 08:17:50 | bauzas | there are actions I could do | |
| 08:17:57 | bauzas | and I'd like to verify | |
| 08:18:25 | bauzas | maybe the cooling system is sufficient and this is only Fedora which is too much conservative in terms of power consumption | |
| 08:18:40 | bauzas | having the fan burning isn't a problem | |
| 08:18:52 | bauzas | that's the CPU stepping down which is an issue | |
| 08:19:32 | Uggla | yep I think so as well. | |
| 08:19:46 | gibi | I also have perf issues with google meet (on T14, debian sid, xorg, i3, chrome). During our calls sometimes chrome starts to hogg the CPU and the audio and video starts lagging, and clipping. I haven't figured out yet what triggers the CPU hogging | |
| 08:20:28 | gibi | but as CPU get hot, thermal throttling kicks in and worsen the situation | |
| 08:21:10 | Uggla | gibi, welcome to the club :) | |
| 08:21:20 | gibi | then after 1 minute chrome stops hogging the CPU and after an additional minute google meet audio/video recovers | |
| 08:21:47 | gibi | I suspect that in my case it is chrome that does something crazy | |
| 08:23:40 | Uggla | bauzas, maybe we should have a look to firmware as well. | |
| 08:24:22 | Uggla | *has | |
| 08:25:13 | Uggla | gibi, have you a moment to look at my issue ? | |
| 08:25:20 | gibi | yes, I'm ready now | |
| 08:25:47 | gibi | lets test some google meet ;) | |
| 08:25:53 | Uggla | yep | |
| 08:25:54 | Uggla | :) | |
| 08:34:22 | bauzas | ok, I tuned sar to report my CPU clock freq | |