| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2025-05-19 | |||
| 12:28:16 | sean-k-mooney | do you have time to adress frickler's comment | |
| 12:28:40 | sahid | sean-k-mooney, bauzas o/ | |
| 12:28:57 | sahid | anychance that you have a look into that one when you have a moement https://review.opendev.org/c/openstack/nova/+/947804 | |
| 12:29:09 | sahid | looks reasonable and easy fix to backport | |
| 12:29:51 | gibi | sean-k-mooney: yepp that is on my radar to reply | |
| 12:30:25 | sahid | it does not basically fix the root cause but that seems reasonable, as fixing that unsync would be quite difficult I guess | |
| 12:31:26 | sean-k-mooney | sahid: so doing the firsterign in python is not really what we want here | |
| 12:32:06 | sean-k-mooney | limit is a max its nto nessiarly what you will recive | |
| 12:32:51 | sahid | sure but the problem here is that, during the process because we do retrieve less than the limit we do not return "next marker" | |
| 12:33:17 | sahid | does that make sense? | |
| 12:33:41 | sahid | basically the pagination is not working and we can print the other instances | |
| 12:33:56 | sahid | s/can/can't | |
| 12:34:16 | sean-k-mooney | sahid: yep i just tiraged the bug. the only part that is a bug is the lack of the marker | |
| 12:34:22 | sean-k-mooney | as that break paging | |
| 12:34:48 | sean-k-mooney | wther we shoudl be returnign 6 or 7 results is open for debate | |
| 12:35:02 | sean-k-mooney | but the marker being missing is defintlly wrong | |
| 12:35:13 | sahid | yep we are on the same page :-) | |
| 12:40:25 | sahid | sean-k-mooney: you indicated it as low, but this can break many apps, e.g: workflow used to compute billing | |
| 12:41:42 | sean-k-mooney | sahid: i indicated it as low because i was going to mark it invliad until i noticed the marker comment. the marker being missing could raise it to medium but its not high or cirtial bug by any means. it more then whichilist however | |
| 12:42:10 | sahid | ack thanks ! | |
| 12:54:49 | sean-k-mooney | sahid: i left comment on the change. it does not actully show that it fixes the bug and they typs dont look correct either so it need mroe work before proceeding | |
| 12:58:44 | opendevreview | Stephen Finucane proposed openstack/nova-specs master: Add remove-os-volumes_boot-api spec https://review.opendev.org/c/openstack/nova-specs/+/947210 | |
| 12:59:14 | opendevreview | Stephen Finucane proposed openstack/nova-specs master: Add remove-os-volumes_boot-api spec https://review.opendev.org/c/openstack/nova-specs/+/947210 | |
| 13:00:25 | opendevreview | Stephen Finucane proposed openstack/nova-specs master: Add flavor-search-by-name spec https://review.opendev.org/c/openstack/nova-specs/+/940440 | |
| 13:12:40 | sahid | sean-k-mooney: thank you for that review, hoppefuly amorin will have a look ;-) | |
| 13:13:45 | opendevreview | Balazs Gibizer proposed openstack/nova master: Allow services to start with threading https://review.opendev.org/c/openstack/nova/+/948311 | |
| 13:13:46 | opendevreview | Balazs Gibizer proposed openstack/nova master: DNM:Run nova-next with n-sch in threading mode https://review.opendev.org/c/openstack/nova/+/948450 | |
| 13:14:50 | opendevreview | Balazs Gibizer proposed openstack/nova master: Run nova-next with n-sch in threading mode https://review.opendev.org/c/openstack/nova/+/948450 | |
| 13:16:17 | amorin | thanks for review, I will have a look | |
| 15:17:08 | Uggla | bauzas, your work on mtty. Does it allow to get rid of compile_mdev_samples ? | |
| 15:24:50 | Uggla | dansmith, I have a question about OTU. I think youd use real nvme devices for testing ? Am I right ? | |
| 15:25:16 | dansmith | Uggla: are you asking if I have tested it with real nvme devices? | |
| 15:30:27 | Uggla | dansmith, yes | |
| 15:31:02 | Uggla | or did you simulated them with qemu ? | |
| 15:34:00 | dansmith | Uggla: no, I'm using real NVMes | |
| 15:34:14 | dansmith | Uggla: but you can use OTU with any PCI device for testing | |
| 15:34:24 | dansmith | when I started I was using the vRNG | |
| 15:35:03 | Uggla | dansmith, I have seen this article: https://blog.christophersmart.com/2019/12/18/kvm-guests-with-emulated-ssd-and-nvme-drives/ so I wonder if this could be used to simulate them for a demo. | |
| 15:35:37 | dansmith | yeah idk, perhaps | |
| 15:35:53 | Uggla | or testing... | |
| 15:36:01 | dansmith | it wasn't useful to me because I wanted to be able to run the low-level cleaning routine against real hardware since that was part of what I needed to work out | |
| 15:36:14 | dansmith | but for just the nova plumbing, it will probably be enough | |
| 15:43:51 | Uggla | dansmith, thx. | |
| 15:55:42 | frickler | Uggla: seems we are seeing the issue you fixed for the reqs check now in designate in 2024.2 https://review.opendev.org/c/openstack/designate/+/949094 , so I fear we'll have to revert it | |
| 15:58:37 | Uggla | frickler, damned not cool. | |
| 15:59:42 | opendevreview | Dan Smith proposed openstack/nova master: Revert "Support glance's new location API" https://review.opendev.org/c/openstack/nova/+/950336 | |
| 16:07:05 | Uggla | frickler, does that mean we should try to speed up a bit on the pkg_resources replacement patch ? | |
| 16:26:08 | bauzas | Uggla: dansmith: sean-k-mooney: weirdo, I created a devstack host with mtty on noble, it worked fine | |
| 16:26:46 | frickler | bauzas: did that include designate? | |
| 16:27:20 | frickler | Uggla: to me it looks like your fix for the uc-check is masking a real issue for consumers of the affected oslo libs | |
| 16:27:29 | johnsom | +1 | |
| 16:28:46 | frickler | but maybe we should move to reqs or oslo channel for further discussion | |
| 16:28:59 | bauzas | frickler: nope | |
| 16:30:07 | frickler | bauzas: ah, different topic, sorry I misread that comment | |
| 16:31:53 | bauzas | I stupidely forgot to ask in local.conf to file the devstack log, so I'm just recloning my instance to see how it worked when creating the kernel examples | |
| 16:34:14 | Uggla | frickler, ok I wonder how it can worsen the situation because it only act if we get an exception. But I agree it can make identifying the real root cause more difficult. | |
| 16:42:22 | frickler | Uggla: so my current theory is that the oslo.utils 7.3.1 release is somehow broken, the reqs check noticed that and prevented it from getting into u-c, so maybe your fix that resolved that block isn't a real fix. need to do more digging tomorrow or maybe help from oslo or release ppl | |
| 16:43:54 | Uggla | frickler, ok let me know if you need my help. | |
| 16:59:32 | bauzas | ah, stupid I am : | |
| 16:59:33 | bauzas | stack@sbauza-mtty-ubuntu:~/nova$ uname -r | |
| 16:59:33 | bauzas | 6.8.0-35-generic | |
| 17:11:25 | opendevreview | Sylvain Bauza proposed openstack/nova master: Add mtty/mdpy support for testing fake mdevs https://review.opendev.org/c/openstack/nova/+/898100 | |
| 17:11:26 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : Add mtty support to nova-next https://review.opendev.org/c/openstack/nova/+/922140 | |
| 19:34:55 | sean-k-mooney | bauzas: they may have fixed the mirros | |
| 19:35:23 | sean-k-mooney | bauzas: i would suggest prposint a revert the disable patch | |
| 19:35:36 | sean-k-mooney | and see if it starts passign in ci again | |
| 19:36:01 | sean-k-mooney | ah yuou have in https://review.opendev.org/c/openstack/nova/+/922140/21/.zuul.yaml | |
| 19:38:30 | sean-k-mooney | bauzas: that failing with May 19 17:59:54.847711 np0040813405 nova-compute[41390]: ERROR nova nova.exception.InvalidLibvirtMdevConfig: Invalid configuration for mdev-capable devices: incorrect PCI address: mtty_mtty | |
| 19:39:36 | sean-k-mooney | so its compiling fine now but there is either a bug in the previous patch https://review.opendev.org/c/openstack/nova/+/898100/10 os somethign with how you configured the job | |
| 19:40:50 | sean-k-mooney | oh im also seeign libvirt.libvirtError: Cannot find 'mdevctl' in path: No such file or directory | |
| 19:41:14 | sean-k-mooney | bauzas: mell was tryign to adress that in https://review.opendev.org/c/openstack/nova/+/948581/6 | |
| 19:41:44 | opendevreview | melanie witt proposed openstack/nova master: DNM try to install mdevctl https://review.opendev.org/c/openstack/nova/+/948581 | |
| 19:42:21 | sean-k-mooney | i just rebased ^ on top of your latest revision so let see if that helps. if it does you can squah it into your second patch | |
| #openstack-nova - 2025-05-20 | |||
| 06:56:24 | bauzas | sean-k-mooney: yeah, apparently the mirrors were fixed | |
| 06:56:44 | bauzas | that's why I uploaded again my series (because I don't have the same kernel version (I use a virtual host) | |
| 06:57:24 | bauzas | and yeah, bindep is not installing automatically mdevctl | |
| 07:50:46 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP : Add mtty support to nova-next https://review.opendev.org/c/openstack/nova/+/922140 | |
| 10:37:39 | bauzas | sean-k-mooney: if you're here, I'm curious why in nova-next, compute1 doesn't get my series https://9eed2832462b93d99d63-9a2c0e6b238d9eb37d7a57d0c5074dee.ssl.cf1.rackcdn.com/openstack/93034cf7903d4f8abe5fa23883c761b8/compute1/logs/screen-n-cpu.txt | |
| 10:38:04 | bauzas | the controller uses it correctly : https://9eed2832462b93d99d63-9a2c0e6b238d9eb37d7a57d0c5074dee.ssl.cf1.rackcdn.com/openstack/93034cf7903d4f8abe5fa23883c761b8/controller/logs/screen-n-cpu.txt | |
| 10:39:07 | sean-k-mooney | the same git repo will be copied to all node by the workspace prepare but my guess is you have not configured something correctly in the devstack config | |
| 10:40:16 | sean-k-mooney | mel had to fix the job config to turn on the compilation fo the sampels in the comptue node for example https://review.opendev.org/c/openstack/nova/+/948581/7/.zuul.yaml | |
| 10:43:45 | sean-k-mooney | bauzas we can confirm if it clooned the corrct content in the logs lets dot that fist but i think that is highly unlikely to be the problem here | |
| 10:45:07 | bauzas | doh, I'll then set the compilation in the subnode section | |
| 10:45:23 | bauzas | sean-k-mooney: fwiw, I just updated my WIP to install mdevctl | |
| 10:45:41 | bauzas | so melwitt's series shouldn't be needed | |
| 10:45:46 | bauzas | s/series/changre | |
| 10:46:33 | sean-k-mooney | ack. she was working on that because you wre on pto to see if she could move it forward but she didnt intent to keep working on it. she just didnt want to directly update your patch | |
| 10:50:58 | sean-k-mooney | 2025-05-20 08:30:05.668555 | compute1 | + functions-common:git_clone:676 : cd /opt/stack/nova | |
| 10:51:00 | sean-k-mooney | 2025-05-20 08:30:05.673150 | compute1 | + functions-common:git_clone:677 : git show --oneline | |
| 10:51:02 | sean-k-mooney | 2025-05-20 08:30:05.673265 | compute1 | + functions-common:git_clone:677 : head -1 | |
| 10:51:04 | sean-k-mooney | 2025-05-20 08:30:05.691351 | compute1 | 6e752ff1c3 WIP : Add mtty support to nova-next | |
| 10:51:06 | sean-k-mooney | 2025-05-20 08:30:05.695399 | compute1 | + functions-common:git_clone:678 : cd /opt/stack/devstack | |
| 10:51:08 | sean-k-mooney | 2025-05-20 08:30:05.699127 | compute1 | + lib/nova:install_nova:984 : setup_develop /opt/stack/nova | |
| 10:51:11 | sean-k-mooney | so on the compute its definetly usign your change | |
| 10:51:52 | sean-k-mooney | devstack git clone say the git repo already existed (because it was prepared by zuul) and skip the clone and just used it | |
| 10:53:04 | sean-k-mooney | bauzas: i guess that may be an issue with the error message | |
| 10:53:09 | sean-k-mooney | i.e. if it returns https://9eed2832462b93d99d63-9a2c0e6b238d9eb37d7a57d0c5074dee.ssl.cf1.rackcdn.com/openstack/93034cf7903d4f8abe5fa23883c761b8/compute1/logs/screen-n-cpu.txt | |
| 10:53:22 | sean-k-mooney | when the mtty device is not found | |
| 10:53:59 | sean-k-mooney | its conflating incorrect or invalid with not found so we can proably make that more obvious | |
| 10:56:27 | sean-k-mooney | bauzas: anyway let see if enaableign the plugin on the comptue helps and if that resolves teh error | |