| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2025-05-19 | |||
| 12:19:27 | sean-k-mooney | it kind of depend on what code paths we are hitting | |
| 12:19:41 | sean-k-mooney | ah ok | |
| 12:20:15 | sean-k-mooney | ya so that not the first time that has casued isseus. we have the eventlet monkey patch env arg because of that too | |
| 12:20:31 | sean-k-mooney | i.e. we disable monkeypatching in the docs env due to the multiple imports | |
| 12:20:54 | sean-k-mooney | that and well we dont need to monkey patch sphinx build | |
| 12:21:07 | sean-k-mooney | /need/want/ | |
| 12:21:12 | gibi | yeah it is similar | |
| 12:21:29 | gibi | but it will work OK as soon as the open oslo.service patch released | |
| 12:21:55 | gibi | as it will allow initing the backend mutliple times if we init it with the same type and it will do noop after the first init | |
| 12:23:49 | sean-k-mooney | if that got held up for any reason we could just wrap our call to init in the run_once decorator anyway to work around it | |
| 12:24:03 | sean-k-mooney | but cool none of that sounds concerning to me | |
| 12:24:59 | gibi | sean-k-mooney: btw, could you check https://review.opendev.org/c/openstack/devstack/+/948436 as well? | |
| 12:26:03 | gibi | that is the small devstack patch to make it possible to pass env variables from zuul.yaml to systemd | |
| 12:26:10 | sean-k-mooney | i can proably check that first :) im workign on seting up docs/reno for a new project currently so i dont have time to deep dive into the eventlet serise right away btu the devstack patch should be fine | |
| 12:27:32 | sean-k-mooney | gibi: i looked at that when you first pushed it so im +1 on it still | |
| 12:27:40 | gibi | thanks | |
| 12:28:04 | sean-k-mooney | gibi: since we are talking about devstack https://review.opendev.org/c/openstack/devstack/+/939825 | |
| 12:28:16 | sean-k-mooney | do you have time to adress frickler's comment | |
| 12:28:40 | sahid | sean-k-mooney, bauzas o/ | |
| 12:28:57 | sahid | anychance that you have a look into that one when you have a moement https://review.opendev.org/c/openstack/nova/+/947804 | |
| 12:29:09 | sahid | looks reasonable and easy fix to backport | |
| 12:29:51 | gibi | sean-k-mooney: yepp that is on my radar to reply | |
| 12:30:25 | sahid | it does not basically fix the root cause but that seems reasonable, as fixing that unsync would be quite difficult I guess | |
| 12:31:26 | sean-k-mooney | sahid: so doing the firsterign in python is not really what we want here | |
| 12:32:06 | sean-k-mooney | limit is a max its nto nessiarly what you will recive | |
| 12:32:51 | sahid | sure but the problem here is that, during the process because we do retrieve less than the limit we do not return "next marker" | |
| 12:33:17 | sahid | does that make sense? | |
| 12:33:41 | sahid | basically the pagination is not working and we can print the other instances | |
| 12:33:56 | sahid | s/can/can't | |
| 12:34:16 | sean-k-mooney | sahid: yep i just tiraged the bug. the only part that is a bug is the lack of the marker | |
| 12:34:22 | sean-k-mooney | as that break paging | |
| 12:34:48 | sean-k-mooney | wther we shoudl be returnign 6 or 7 results is open for debate | |
| 12:35:02 | sean-k-mooney | but the marker being missing is defintlly wrong | |
| 12:35:13 | sahid | yep we are on the same page :-) | |
| 12:40:25 | sahid | sean-k-mooney: you indicated it as low, but this can break many apps, e.g: workflow used to compute billing | |
| 12:41:42 | sean-k-mooney | sahid: i indicated it as low because i was going to mark it invliad until i noticed the marker comment. the marker being missing could raise it to medium but its not high or cirtial bug by any means. it more then whichilist however | |
| 12:42:10 | sahid | ack thanks ! | |
| 12:54:49 | sean-k-mooney | sahid: i left comment on the change. it does not actully show that it fixes the bug and they typs dont look correct either so it need mroe work before proceeding | |
| 12:58:44 | opendevreview | Stephen Finucane proposed openstack/nova-specs master: Add remove-os-volumes_boot-api spec https://review.opendev.org/c/openstack/nova-specs/+/947210 | |
| 12:59:14 | opendevreview | Stephen Finucane proposed openstack/nova-specs master: Add remove-os-volumes_boot-api spec https://review.opendev.org/c/openstack/nova-specs/+/947210 | |
| 13:00:25 | opendevreview | Stephen Finucane proposed openstack/nova-specs master: Add flavor-search-by-name spec https://review.opendev.org/c/openstack/nova-specs/+/940440 | |
| 13:12:40 | sahid | sean-k-mooney: thank you for that review, hoppefuly amorin will have a look ;-) | |
| 13:13:45 | opendevreview | Balazs Gibizer proposed openstack/nova master: Allow services to start with threading https://review.opendev.org/c/openstack/nova/+/948311 | |
| 13:13:46 | opendevreview | Balazs Gibizer proposed openstack/nova master: DNM:Run nova-next with n-sch in threading mode https://review.opendev.org/c/openstack/nova/+/948450 | |
| 13:14:50 | opendevreview | Balazs Gibizer proposed openstack/nova master: Run nova-next with n-sch in threading mode https://review.opendev.org/c/openstack/nova/+/948450 | |
| 13:16:17 | amorin | thanks for review, I will have a look | |
| 15:17:08 | Uggla | bauzas, your work on mtty. Does it allow to get rid of compile_mdev_samples ? | |
| 15:24:50 | Uggla | dansmith, I have a question about OTU. I think youd use real nvme devices for testing ? Am I right ? | |
| 15:25:16 | dansmith | Uggla: are you asking if I have tested it with real nvme devices? | |
| 15:30:27 | Uggla | dansmith, yes | |
| 15:31:02 | Uggla | or did you simulated them with qemu ? | |
| 15:34:00 | dansmith | Uggla: no, I'm using real NVMes | |
| 15:34:14 | dansmith | Uggla: but you can use OTU with any PCI device for testing | |
| 15:34:24 | dansmith | when I started I was using the vRNG | |
| 15:35:03 | Uggla | dansmith, I have seen this article: https://blog.christophersmart.com/2019/12/18/kvm-guests-with-emulated-ssd-and-nvme-drives/ so I wonder if this could be used to simulate them for a demo. | |
| 15:35:37 | dansmith | yeah idk, perhaps | |
| 15:35:53 | Uggla | or testing... | |
| 15:36:01 | dansmith | it wasn't useful to me because I wanted to be able to run the low-level cleaning routine against real hardware since that was part of what I needed to work out | |
| 15:36:14 | dansmith | but for just the nova plumbing, it will probably be enough | |
| 15:43:51 | Uggla | dansmith, thx. | |
| 15:55:42 | frickler | Uggla: seems we are seeing the issue you fixed for the reqs check now in designate in 2024.2 https://review.opendev.org/c/openstack/designate/+/949094 , so I fear we'll have to revert it | |
| 15:58:37 | Uggla | frickler, damned not cool. | |
| 15:59:42 | opendevreview | Dan Smith proposed openstack/nova master: Revert "Support glance's new location API" https://review.opendev.org/c/openstack/nova/+/950336 | |
| 16:07:05 | Uggla | frickler, does that mean we should try to speed up a bit on the pkg_resources replacement patch ? | |
| 16:26:08 | bauzas | Uggla: dansmith: sean-k-mooney: weirdo, I created a devstack host with mtty on noble, it worked fine | |
| 16:26:46 | frickler | bauzas: did that include designate? | |
| 16:27:20 | frickler | Uggla: to me it looks like your fix for the uc-check is masking a real issue for consumers of the affected oslo libs | |
| 16:27:29 | johnsom | +1 | |
| 16:28:46 | frickler | but maybe we should move to reqs or oslo channel for further discussion | |
| 16:28:59 | bauzas | frickler: nope | |
| 16:30:07 | frickler | bauzas: ah, different topic, sorry I misread that comment | |
| 16:31:53 | bauzas | I stupidely forgot to ask in local.conf to file the devstack log, so I'm just recloning my instance to see how it worked when creating the kernel examples | |
| 16:34:14 | Uggla | frickler, ok I wonder how it can worsen the situation because it only act if we get an exception. But I agree it can make identifying the real root cause more difficult. | |
| 16:42:22 | frickler | Uggla: so my current theory is that the oslo.utils 7.3.1 release is somehow broken, the reqs check noticed that and prevented it from getting into u-c, so maybe your fix that resolved that block isn't a real fix. need to do more digging tomorrow or maybe help from oslo or release ppl | |
| 16:43:54 | Uggla | frickler, ok let me know if you need my help. | |
| 16:59:32 | bauzas | ah, stupid I am : | |
| 16:59:33 | bauzas | 6.8.0-35-generic | |
| 16:59:33 | bauzas | stack@sbauza-mtty-ubuntu:~/nova$ uname -r | |
| 17:11:25 | opendevreview | Sylvain Bauza proposed openstack/nova master: Add mtty/mdpy support for testing fake mdevs https://review.opendev.org/c/openstack/nova/+/898100 | |
| 17:11:26 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : Add mtty support to nova-next https://review.opendev.org/c/openstack/nova/+/922140 | |
| 19:34:55 | sean-k-mooney | bauzas: they may have fixed the mirros | |
| 19:35:23 | sean-k-mooney | bauzas: i would suggest prposint a revert the disable patch | |
| 19:35:36 | sean-k-mooney | and see if it starts passign in ci again | |
| 19:36:01 | sean-k-mooney | ah yuou have in https://review.opendev.org/c/openstack/nova/+/922140/21/.zuul.yaml | |
| 19:38:30 | sean-k-mooney | bauzas: that failing with May 19 17:59:54.847711 np0040813405 nova-compute[41390]: ERROR nova nova.exception.InvalidLibvirtMdevConfig: Invalid configuration for mdev-capable devices: incorrect PCI address: mtty_mtty | |
| 19:39:36 | sean-k-mooney | so its compiling fine now but there is either a bug in the previous patch https://review.opendev.org/c/openstack/nova/+/898100/10 os somethign with how you configured the job | |
| 19:40:50 | sean-k-mooney | oh im also seeign libvirt.libvirtError: Cannot find 'mdevctl' in path: No such file or directory | |
| 19:41:14 | sean-k-mooney | bauzas: mell was tryign to adress that in https://review.opendev.org/c/openstack/nova/+/948581/6 | |
| 19:41:44 | opendevreview | melanie witt proposed openstack/nova master: DNM try to install mdevctl https://review.opendev.org/c/openstack/nova/+/948581 | |
| 19:42:21 | sean-k-mooney | i just rebased ^ on top of your latest revision so let see if that helps. if it does you can squah it into your second patch | |
| #openstack-nova - 2025-05-20 | |||
| 06:56:24 | bauzas | sean-k-mooney: yeah, apparently the mirrors were fixed | |
| 06:56:44 | bauzas | that's why I uploaded again my series (because I don't have the same kernel version (I use a virtual host) | |
| 06:57:24 | bauzas | and yeah, bindep is not installing automatically mdevctl | |
| 07:50:46 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : Add mtty support to nova-next https://review.opendev.org/c/openstack/nova/+/922140 | |
| 10:37:39 | bauzas | sean-k-mooney: if you're here, I'm curious why in nova-next, compute1 doesn't get my series https://9eed2832462b93d99d63-9a2c0e6b238d9eb37d7a57d0c5074dee.ssl.cf1.rackcdn.com/openstack/93034cf7903d4f8abe5fa23883c761b8/compute1/logs/screen-n-cpu.txt | |
| 10:38:04 | bauzas | the controller uses it correctly : https://9eed2832462b93d99d63-9a2c0e6b238d9eb37d7a57d0c5074dee.ssl.cf1.rackcdn.com/openstack/93034cf7903d4f8abe5fa23883c761b8/controller/logs/screen-n-cpu.txt | |
| 10:39:07 | sean-k-mooney | the same git repo will be copied to all node by the workspace prepare but my guess is you have not configured something correctly in the devstack config | |
| 10:40:16 | sean-k-mooney | mel had to fix the job config to turn on the compilation fo the sampels in the comptue node for example https://review.opendev.org/c/openstack/nova/+/948581/7/.zuul.yaml | |
| 10:43:45 | sean-k-mooney | bauzas we can confirm if it clooned the corrct content in the logs lets dot that fist but i think that is highly unlikely to be the problem here | |
| 10:45:07 | bauzas | doh, I'll then set the compilation in the subnode section | |