| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-10-18 | |||
| 07:24:32 | bauzas | good morning Nova | |
| 07:24:42 | bauzas | and happy PTG in the next hours | |
| 12:48:27 | sean-k-mooney | bauzas: are the nova topics starting today or tomorrow? | |
| 12:48:37 | bauzas | tomorrow | |
| 12:49:46 | bauzas | https://etherpad.opendev.org/p/nova-yoga-ptg | |
| 12:49:58 | bauzas | see also https://ptg.opendev.org/ | |
| 12:50:03 | sean-k-mooney | bauzas: yep i have that open its reeally not clear based on that | |
| 12:50:29 | sean-k-mooney | although the live one is more clear sicne we donthave nova sessions today | |
| 12:50:41 | sean-k-mooney | as in https://ptg.opendev.org/ptg.html | |
| 12:51:07 | bauzas | sean-k-mooney: I just changed "Nova has meeting slots from Tuesday - Friday 13:00 - 17:00 UTC" to be a heading 3 | |
| 12:51:55 | sean-k-mooney | ack i tought we werre gong to do 5 days which is why i asked with some corss project session today | |
| 12:52:06 | sean-k-mooney | but i see most of them are tommorow | |
| 12:52:56 | bauzas | yup, tbc I'll be on the TC/PTL session at 3pm UTC | |
| 12:53:23 | sean-k-mooney | i normally atend oslo or kolla stuff on mondays but i might look a neutron instead | |
| 16:21:45 | opendevreview | Merged openstack/nova master: db: Add migration to resolve shadow table discrepancies https://review.opendev.org/c/openstack/nova/+/805738 | |
| 17:11:53 | opendevreview | Balazs Gibizer proposed openstack/nova master: Add a WA flag waiting for vif-plugged event during reboot https://review.opendev.org/c/openstack/nova/+/813419 | |
| 17:16:46 | opendevreview | Merged openstack/nova master: Fix the wrong exception used to retry detach API calls https://review.opendev.org/c/openstack/nova/+/809934 | |
| 19:13:38 | NobodyCam | Good Morning Nova Folks, crazy is there a way to recreate ironic node hypervisor records with out re-enrolling the node? | |
| 19:14:39 | NobodyCam | s/crazy/crazy question/ | |
| 19:26:32 | opendevreview | Stephen Finucane proposed openstack/nova master: db: Enable auto-generation of API DB migrations https://review.opendev.org/c/openstack/nova/+/812144 | |
| 19:26:33 | opendevreview | Stephen Finucane proposed openstack/nova master: db: Remove unused build_requests columns https://review.opendev.org/c/openstack/nova/+/812145 | |
| 19:26:33 | opendevreview | Stephen Finucane proposed openstack/nova master: db: Remove legacy placement models https://review.opendev.org/c/openstack/nova/+/812146 | |
| 19:26:34 | opendevreview | Stephen Finucane proposed openstack/nova master: objects: Stop querying the main DB for keypairs https://review.opendev.org/c/openstack/nova/+/812147 | |
| 19:26:34 | opendevreview | Stephen Finucane proposed openstack/nova master: objects: Remove 'bandwidth' fields from notifications https://review.opendev.org/c/openstack/nova/+/812148 | |
| 19:26:35 | opendevreview | Stephen Finucane proposed openstack/nova master: db: Remove models that were moved to the API database https://review.opendev.org/c/openstack/nova/+/812149 | |
| 19:26:35 | opendevreview | Stephen Finucane proposed openstack/nova master: db: Remove models for removed services, features https://review.opendev.org/c/openstack/nova/+/812150 | |
| 19:26:36 | opendevreview | Stephen Finucane proposed openstack/nova master: db: Remove nova-network models https://review.opendev.org/c/openstack/nova/+/812151 | |
| 19:26:36 | opendevreview | Stephen Finucane proposed openstack/nova master: db: De-duplicate list of removed table columns https://review.opendev.org/c/openstack/nova/+/814489 | |
| 19:27:22 | stephenfin | melwitt: Regarding that question on the issues from with ARM hosts and the migrations, it could be that the migrations are simply taking too long now on underpowered hosts. I don't know why though since there's only one (well, now two) migrations there. I'll investigate | |
| 19:27:40 | stephenfin | If nothing else, we can reuse gibi's trick of running those particular tests in series instead of parallel | |
| 19:27:58 | stephenfin | (at least I think that's what his tox changes did - I'll have to revisit) | |
| 21:14:56 | opendevreview | melanie witt proposed openstack/nova master: Add logic to enforce local api and db limits https://review.opendev.org/c/openstack/nova/+/712139 | |
| 21:14:57 | opendevreview | melanie witt proposed openstack/nova master: Enforce api and db limits https://review.opendev.org/c/openstack/nova/+/712142 | |
| 21:14:57 | opendevreview | melanie witt proposed openstack/nova master: Update quota_class APIs for db and api limits https://review.opendev.org/c/openstack/nova/+/712143 | |
| 21:14:58 | opendevreview | melanie witt proposed openstack/nova master: Update limit APIs https://review.opendev.org/c/openstack/nova/+/712707 | |
| 21:14:58 | opendevreview | melanie witt proposed openstack/nova master: Update quota sets APIs https://review.opendev.org/c/openstack/nova/+/712749 | |
| 21:14:59 | opendevreview | melanie witt proposed openstack/nova master: Tell oslo.limit how to count nova resources https://review.opendev.org/c/openstack/nova/+/713301 | |
| 21:14:59 | opendevreview | melanie witt proposed openstack/nova master: Enforce resource limits using oslo.limit https://review.opendev.org/c/openstack/nova/+/615180 | |
| 21:15:00 | opendevreview | melanie witt proposed openstack/nova master: Add legacy limits and usage to placement unified limits https://review.opendev.org/c/openstack/nova/+/713498 | |
| 21:15:00 | opendevreview | melanie witt proposed openstack/nova master: Update quota apis with keystone limits and usage https://review.opendev.org/c/openstack/nova/+/713499 | |
| 21:15:02 | opendevreview | melanie witt proposed openstack/nova master: Add reno for unified limits https://review.opendev.org/c/openstack/nova/+/715271 | |
| 21:15:02 | opendevreview | melanie witt proposed openstack/nova master: WIP Enable unified limits in the nova-next job https://review.opendev.org/c/openstack/nova/+/789963 | |
| #openstack-nova - 2021-10-19 | |||
| 05:31:27 | hgy | 1111 | |
| 08:08:48 | bauzas | good morning Nova | |
| 08:16:23 | gibi | bauzas: good morning | |
| 08:16:38 | bauzas | gibi: hey ;) | |
| 08:36:05 | brinzhang | bauzas, gibi: we cannot open the ethercalc, it report Service Unavailable(503), about the nova-cyborg interaction vGPU topic you can talked and pasting the decision on the etherpad, and we will look it ASAP | |
| 08:36:28 | brinzhang | bauzas, gibi: thanks | |
| 08:43:38 | gibi | bauzas: fyi, reported a new gate failure bug https://bugs.launchpad.net/nova/+bug/1947687 | |
| 08:44:26 | gibi | brinzhang: we will have that session today from 13:00 UTC | |
| 08:47:49 | bauzas | brinzhang: the cyborg-nova meeting will happen at 1pm UTC | |
| 08:48:06 | bauzas | gibi: ack | |
| 08:48:27 | gibi | bauzas: I'm not jumping to investigative mode for tha bug now. | |
| 08:51:25 | brinzhang | ack,but I cannot open https://ethercalc.openstack.org/8tum5yl1bx43 this page | |
| 08:52:37 | brinzhang | report 503 now, in cyborg PTG meeting we were usd tencent meeting instead of zoom | |
| 08:58:31 | gibi | brinzhang: could you open https://ptg.opendev.org/ptg.html ? | |
| 08:59:06 | gibi | brinzhang: if yes, then try to click on the nova cell in the 13:00 UTC column | |
| 08:59:20 | gibi | brinzhang: that should bring you in the zoom call | |
| 08:59:35 | gibi | (probably nobody there at the momement) | |
| 09:00:44 | bauzas | brinzhang: what gibi said | |
| 09:00:54 | bauzas | they moved from ethercalc AFAIK | |
| 09:03:03 | brinzhang | ack | |
| 09:03:13 | opendevreview | Balazs Gibizer proposed openstack/nova-specs master: Re-propose QoS minimum guaranteed packet rate https://review.opendev.org/c/openstack/nova-specs/+/814531 | |
| 09:16:38 | stephenfin | gibi: bauzas: Have you noticed many failures on the 'nova.tests.unit.db.main.test_migrations.TestModelsSyncMySQL.test_models_sync' and 'TestModelsLegacySyncMySQL.test_models_sync' tests? | |
| 09:16:56 | gibi | stephenfin: I'm not | |
| 09:18:07 | stephenfin | Ah, okay, I'm seeing a lot of failures on the bp/remove-sqlalchemy-migrate series and trying to figure out if I've already broken master slightly or if its one of the unmerged patches that's breaking things, e.g. https://review.opendev.org/c/openstack/nova/+/812144 | |
| 09:24:38 | songwenping | gibi,bauzas: when i stop nova_compute service and evacuate the vm on the host, then i delete the vm when it is evacuating, the vm is local deleted by nova-api, but the libvirt process is not terminated, and the resources like GPU are still used by the vm process, how can we handle the vm process? | |
| 09:33:46 | gibi | songwenping: you delete the VM while it is being evacuated? | |
| 09:34:54 | songwenping | yes | |
| 09:35:18 | gibi | and then you start the source compute back up | |
| 09:35:48 | songwenping | yeah | |
| 09:36:01 | gibi | and the the source compute does not clean up the instance? | |
| 09:36:22 | songwenping | yeah | |
| 09:36:35 | gibi | I think the source compute should detect that there was a local delete while it was down and clean up the instance | |
| 09:36:38 | gibi | so it is probably a bug | |
| 09:37:15 | songwenping | i am looking into the init_host process. | |
| 10:14:04 | opendevreview | Stephen Finucane proposed openstack/nova master: db: Increase timeout for migration tests https://review.opendev.org/c/openstack/nova/+/814547 | |
| 10:14:51 | stephenfin | gibi: bauzas: I'm not sure how to test that, but I'm pretty sure we're going to need it to at least fix the migrations issues we've been seen in the ARM CI jobs ^ | |
| 10:15:00 | stephenfin | I guess I can mash recheck | |
| 10:16:43 | gibi | stephenfin: ack | |
| 10:16:54 | gibi | is it only affects ARM? | |
| 10:34:16 | stephenfin | I don't think so. I've seen failures on x86 also, but ARM is particularly badly affected | |
| 10:34:33 | stephenfin | example: https://zuul.opendev.org/t/openstack/build/00197f336d1249e4a55255769f24faf7 | |
| 10:34:42 | stephenfin | vs (aarch64) https://zuul.opendev.org/t/openstack/build/f693ac69815f4b92b75f7f8dc5ec3803 | |
| 10:34:49 | stephenfin | gibi: ^ | |
| 10:40:52 | gibi | stephenfin: when it passes it is also slow just not too slow to hit the timeout? | |
| 10:42:39 | gibi | I see this runs | |
| 10:42:40 | gibi | nova.tests.unit.db.main.test_migrations.TestModelsSyncMySQL.test_models_sync 11.154 | |
| 10:42:48 | gibi | where it is actully fast | |
| 10:43:00 | gibi | https://zuul.opendev.org/t/openstack/build/8c4f8a81770e4dd1a523e86690ce340b/log/job-output.txt | |
| 10:44:35 | gibi | anyhow I'm not against extending the timeout | |
| 10:44:51 | gibi | I just feel that we still not fully grok what can be the problems with this db tests | |
| 10:49:31 | opendevreview | Ilya Popov proposed openstack/nova master: Fix to use NUMA cell with more free memory first https://review.opendev.org/c/openstack/nova/+/805649 | |
| 11:09:02 | stephenfin | gibi: Yeah, I see about 7-8 seconds runtime on my localhost but it _seems_ very much dependent on the environment. Perhaps it's because some VMs are using spinning rust and others are SSD based? | |
| 11:09:30 | stephenfin | We can compare these two builds https://zuul.opendev.org/t/openstack/build/00197f336d1249e4a55255769f24faf7 (iWeb) and https://zuul.opendev.org/t/openstack/build/8c4f8a81770e4dd1a523e86690ce340b (OVH) | |
| 11:14:06 | stephenfin | gibi: Yeah, crazy differences in the MySQL tests https://paste.opendev.org/show/810073/ | |
| 11:15:11 | gibi | I remember I saw this craxy differences before alembic too, and I had not explanation for that | |
| 11:16:49 | songwenping | gibi: the evacuation status is failed, and this filter[1] cannot get the vm. [1]https://review.opendev.org/plugins/gitiles/openstack/nova/+/refs/heads/master/nova/compute/manager.py#703 | |
| 11:17:33 | songwenping | so the vm process is not destory when the compute service restore. | |
| 11:18:51 | gibi | songwenping: the problem with failed evacuation itself is that it does not imply the the VM is deleted (and hence the evac failed). If the evac fail for other reasons then keeping the VM on the source host after recovery is logical | |