| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2023-07-21 | |||
| 14:03:14 | dansmith | "nova-manage controls cloud computing instances by managing various admin-only aspects of Nova." | |
| 14:12:23 | auniyal | thanks dansmith, | |
| 14:25:45 | auniyal | dansmith, I am facing this issue right now - https://review.opendev.org/c/openstack/nova/+/873648/comment/af765efc_a7161f39/ | |
| 14:25:46 | auniyal | even though in both cases while running instance_action.finish, instance was locked, query context and query values were same as required. | |
| 14:25:46 | auniyal | however when I tested it by manually locking before running nova-manage cmd, db query went fine and there were no err msg. | |
| 14:25:46 | auniyal | so this is when the instance is not locked already. | |
| 14:29:51 | dansmith | sorry, I'm not sure what context manager you mean you've removed, but action.finish failing means action_start never actually hit the DB, and none of that should have anything to do with lock as noted above | |
| 14:30:02 | dansmith | I've got to jump on a meeting now | |
| 14:31:30 | auniyal | okay, it did not thorugh any error, will check for if it action_start, thanks | |
| 16:52:53 | opendevreview | Merged openstack/nova master: Add a new policy for cold-migrate with host https://review.opendev.org/c/openstack/nova/+/881562 | |
| 16:56:58 | dansmith | holy crap, something merged | |
| 17:13:39 | gmann | heh | |
| 17:46:54 | sean-k-mooney | ||
| 18:26:40 | melwitt | it's a christmas miracle! (that something merged) | |
| 18:27:15 | sean-k-mooney | hehe | |
| 18:27:46 | dansmith | jgwentworth: jokes on you, that was so delayed it's *last* christmas' miracle | |
| 18:28:43 | jgwentworth | :) | |
| 19:34:37 | opendevreview | Felipe Reyes proposed openstack/nova master: Add RISCV64 support. https://review.opendev.org/c/openstack/nova/+/889137 | |
| #openstack-nova - 2023-07-23 | |||
| 08:21:30 | opendevreview | Rajat Dhasmana proposed openstack/nova master: Include multipath_id in BDM record for iSCSI https://review.opendev.org/c/openstack/nova/+/889257 | |
| #openstack-nova - 2023-07-24 | |||
| 08:13:06 | opendevreview | Nobuhiro MIKI proposed openstack/nova master: libvirt: Add 'COMPUTE_ADDRESS_SPACE_*' traits support https://review.opendev.org/c/openstack/nova/+/873221 | |
| 11:40:28 | opendevreview | Kashyap Chamarthy proposed openstack/nova master: Bump MIN_{LIBVIRT,QEMU} for "Bobcat" https://review.opendev.org/c/openstack/nova/+/887255 | |
| 11:48:28 | opendevreview | Friedrich Hiekel proposed openstack/nova stable/yoga: nova scheduler debug logs TypeError https://review.opendev.org/c/openstack/nova/+/889311 | |
| 14:08:55 | opendevreview | Felipe Reyes proposed openstack/nova master: Add RISCV64 support. https://review.opendev.org/c/openstack/nova/+/889137 | |
| 14:21:20 | opendevreview | Amit Uniyal proposed openstack/nova master: Added context manager for instance lock https://review.opendev.org/c/openstack/nova/+/873648 | |
| 14:21:21 | opendevreview | Amit Uniyal proposed openstack/nova master: Disconnecting volume from the compute host https://review.opendev.org/c/openstack/nova/+/877446 | |
| 14:39:52 | opendevreview | Amit Uniyal proposed openstack/nova master: Disconnecting volume from the compute host https://review.opendev.org/c/openstack/nova/+/877446 | |
| 14:39:52 | opendevreview | Amit Uniyal proposed openstack/nova master: Added context manager for instance lock https://review.opendev.org/c/openstack/nova/+/873648 | |
| 15:01:32 | opendevreview | Felipe Reyes proposed openstack/nova master: Add RISCV64 support. https://review.opendev.org/c/openstack/nova/+/889137 | |
| 19:21:14 | opendevreview | Felipe Reyes proposed openstack/nova master: Add RISCV64 QEMU emulation support. https://review.opendev.org/c/openstack/nova/+/889137 | |
| 21:09:30 | dansmith | gmann: do you know if anyone is looking at this? https://54345f3748db63fac266-f6d343514834eb14212ec1823288b4de.ssl.cf5.rackcdn.com/889196/2/check/tempest-slow-py3/298c784/testr_results.html | |
| 21:09:39 | dansmith | seems like maybe we need to skip it as it's failing a *lot* | |
| 21:10:40 | gmann | dansmith: humm, i saw it earlier when I made this to run in parallel and ykarel mentioned parallel run can be one of the reason. i made it to run serially 2-3 days back but it is still failing | |
| 21:11:00 | dansmith | yeah and it's been failing since before that I think | |
| 21:11:05 | gmann | confirming if it run serially | |
| 21:11:33 | dansmith | ugh, sorry, wrong channel | |
| 21:11:38 | dansmith | meant to be in -qa | |
| 23:24:15 | opendevreview | Merged openstack/nova master: Add compute_id columns to instances, migrations https://review.opendev.org/c/openstack/nova/+/879499 | |
| #openstack-nova - 2023-07-25 | |||
| 01:56:43 | sapd1 | Hi everyone, I'm running openstack train. I have a problem when resize an instance with PCI devices(GPUPassthrough) to a flavor without PCI devices. | |
| 01:56:54 | sapd1 | Does anyone know how to fix this problem. | |
| 01:57:06 | sapd1 | When I perform resize: No valid host was found. No valid host found for resize (HTTP 400) (Request-ID: req-9d6cf3f9-8f6f-482f-b0b1-95ec286a0fc3) | |
| 05:33:40 | auniyal | https://bugs.launchpad.net/nova | |
| 05:33:40 | auniyal | but if you are sure this is not correct and still looking for reason, can you add --debug in your resize cmd to find out exactly which call failed and why, then once you find out that look for req-ID in compute logs. it will give you better idea of fail. if there are any traceback's in logs - you can file a bug here: | |
| 05:33:40 | auniyal | sapd1 - as told No Valid Host. | |
| 07:07:38 | sapd1 | auniyal: this bug: https://bugs.launchpad.net/nova/+bug/1941005 | |
| 07:09:04 | auniyal | it seems fixed | |
| 07:09:55 | sapd1 | auniyal: but it's not merged yet | |
| 07:10:31 | auniyal | oh yes, in train its not merged | |
| 07:19:58 | sapd1 | auniyal: I patched it in my system. | |
| 07:40:43 | opendevreview | Konrad Gube proposed openstack/nova master: Use Cinder's os-extend_volume_completion volume action. https://review.opendev.org/c/openstack/nova/+/873560 | |
| 08:32:18 | bauzas | dansmith: gmann: it occurs to me that nova-next is almost failing on volume detach due to some kind of filesystem check (that's a guess) and kinda related to what you told this night (for me) | |
| 08:32:26 | bauzas | https://6d9b97dc35f887a99105-3214406b4544fce2f9d807df6ea4fe3f.ssl.cf5.rackcdn.com/886232/4/check/nova-next/31d3775/testr_results.html | |
| 09:02:57 | sean-k-mooney | is that using cinder lvm? | |
| 09:03:05 | sean-k-mooney | i.e. not ceph | |
| 09:04:54 | sean-k-mooney | its not quite the saem as what https://github.com/openstack/devstack/commit/58c80b2424623096e4a1f7a901f424be0ce6cb3f adressed and actully that should help there in any case | |
| 09:05:57 | sean-k-mooney | i think https://review.opendev.org/c/openstack/tempest/+/886991 could still help | |
| 09:06:26 | sean-k-mooney | bauzas: i think its https://bugs.launchpad.net/tempest/+bug/2024859 | |
| 09:07:25 | bauzas | sean-k-mooney: -ish yeah | |
| 09:08:42 | sean-k-mooney | i just rebased melwitt patch to see if it will pass ci | |
| 09:09:01 | sean-k-mooney | we have made some other improvment so it might help but im not sure | |
| 09:09:08 | sean-k-mooney | we could also enabel caching in qemu | |
| 09:09:19 | sean-k-mooney | so trun on teh writeback cache | |
| 09:09:51 | sean-k-mooney | and see if that can hide the slow storage performance | |
| 09:13:52 | sean-k-mooney | hehe i was tinkign of setting https://docs.openstack.org/nova/latest/configuration/config.html#libvirt.disk_cachemodes to writeback | |
| 09:14:20 | sean-k-mooney | but we could also set it to unsafe ... that would definetly be faster | |
| 09:15:17 | bauzas | fwiw, I only see this pattern on nova-next | |
| 09:15:55 | bauzas | or, I'd rather say, this failure incidence is way higher on this job than any other one in the nova check and gate pipelines | |
| 09:16:09 | sean-k-mooney | [libvirt]/disk_cachemode=file=none,block=unsafe,network=writeback | |
| 09:17:22 | sean-k-mooney | im goign to add a patch to nova-next to configre that and lets see if it fails | |
| 09:23:42 | opendevreview | sean mooney proposed openstack/nova master: [WIP] use disk caching to hide slow cinder performance https://review.opendev.org/c/openstack/nova/+/889383 | |
| 09:25:47 | sean-k-mooney | bauzas: ^ that might work although in production you would not use unsafe but for ci it should be fine | |
| 09:37:49 | dvo-plv | Hello, nova folks. Maybe you will have a chance to review this commit, thank you https://review.opendev.org/c/openstack/nova/+/876075 | |
| 09:39:47 | sean-k-mooney | i started that review twice already so i proably should go finish it :) | |
| 09:47:27 | sean-k-mooney | dvo-plv: looks good to me | |
| 11:35:44 | kashyap | While I'm off the next 3 days, anyone willing to get this over the line? It's just failing on some timeouts: https://review.opendev.org/c/openstack/nova/+/887255 | |
| 11:36:51 | kashyap | (I see sean-k-mooney already did a recheck on the dep patch; thanks!) | |
| 11:37:41 | sean-k-mooney | it still needs review form other but i set RP+2 on it as well | |
| 11:38:39 | kashyap | Yeah, saw that, thank you! | |
| 12:53:10 | auniyal | sean-k-mooney, and others, how can I set debug=true for nova-scheduler; in devstack nova.conf for [DEFAULT] its already set there is another group [scheduler], I tried there as well but no difference | |
| 12:53:18 | auniyal | I am trying to see https://github.com/openstack/nova/blob/815683ea86492d3ed77b04cc56f3db87e2b8c47d/nova/weights.py#L136 | |
| 12:53:33 | auniyal | in scheduler logs while launching VM | |
| 12:55:19 | auniyal | is there any other conf I should look into ? | |
| 13:06:25 | sean-k-mooney | devstack runs in debug mode by default | |
| 13:07:42 | auniyal | yes, still these logs are not coming in "jouranlctl -u devstack@n-sch" | |
| 13:09:34 | sean-k-mooney | stack@upstream-devstack:~$ sudo journalctl -u devstack@n-sch | grep debug | wc | |
| 13:09:36 | sean-k-mooney | 10 172 2932 | |
| 13:11:54 | auniyal | yes debugs logs are coming in n-sch but not these logs https://github.com/openstack/nova/blob/815683ea86492d3ed77b04cc56f3db87e2b8c47d/nova/weights.py#L136 | |
| 13:12:16 | auniyal | so I think they should come whie VM create | |
| 13:12:32 | auniyal | right ? | |
| 13:12:50 | sean-k-mooney | im seeign the log in the ci | |
| 13:13:17 | sean-k-mooney | https://zuul.opendev.org/t/openstack/build/fd53404ef23341828ae15f8ccf596e6c/log/controller/logs/screen-n-sch.txt#1018 | |
| 13:15:04 | auniyal | yes, here they are coming, I have single-node devstack env localy | |
| 13:15:57 | auniyal | it should be right ? | |
| 13:23:51 | sean-k-mooney | /etc/nova/nova.conf as rendered by devstack has debug=true set in the default section | |
| 13:24:08 | sean-k-mooney | that is what the scheduler uses | |
| 13:30:11 | auniyal | ack, thanks | |
| 13:33:25 | sean-k-mooney | the backport does not seam to be working properly | |
| 13:34:41 | sean-k-mooney | wait why are you proposing https://review.opendev.org/c/openstack/nova/+/889311 directly to yoga | |
| 13:34:55 | sean-k-mooney | oh your are not | |
| 13:35:03 | sean-k-mooney | this is incorrect | |
| 14:01:43 | auniyal | ack | |