| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-05-27 | |||
| 17:39:54 | gmann | lucky redhatters :) long weekend | |
| 17:40:24 | gmann | I miss Tokyo in that term for many long weekend and three golden weeks in a year | |
| 23:23:38 | openstackgerrit | Ghanshyam proposed openstack/nova-specs master: Allow project admin to list hypervisors https://review.opendev.org/c/openstack/nova-specs/+/793011 | |
| 23:23:52 | gmann | dansmith: melwitt ^^ | |
| #openstack-nova - 2021-05-28 | |||
| 00:42:54 | openstackgerrit | melanie witt proposed openstack/nova master: Honor [neutron]http_retries in the manual client https://review.opendev.org/c/openstack/nova/+/793512 | |
| 01:34:47 | openstackgerrit | Wenping Song proposed openstack/nova master: Replaces tenant_id with project_id from Rebuild Server API https://review.opendev.org/c/openstack/nova/+/766380 | |
| 01:38:59 | openstackgerrit | Wenping Song proposed openstack/nova master: Replaces tenant_id with project_id from List/Update Servers APIs https://review.opendev.org/c/openstack/nova/+/764292 | |
| 08:39:04 | openstackgerrit | Wenping Song proposed openstack/nova master: Replace tenant* with project* in codes https://review.opendev.org/c/openstack/nova/+/769329 | |
| 08:46:38 | yonglihe | sean-k-mooney, gibi, do you have time for smart patches? thanks. https://review.opendev.org/q/topic:%22bp%252Fsriov-smartnic-support%22+(status:open%20OR%20status:merged) | |
| 09:30:13 | openstackgerrit | Merged openstack/nova-specs master: [pps] Move the alternatives to separate section https://review.opendev.org/c/openstack/nova-specs/+/792634 | |
| 11:45:48 | openstackgerrit | Balazs Gibizer proposed openstack/nova-specs master: Allow provider re-parenting in placement https://review.opendev.org/c/openstack/nova-specs/+/788243 | |
| 11:52:31 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add test coverage for security group checking https://review.opendev.org/c/openstack/nova/+/786044 | |
| 12:15:43 | openstackgerrit | Balazs Gibizer proposed openstack/nova-specs master: [template]suggest work item ordering https://review.opendev.org/c/openstack/nova-specs/+/793197 | |
| 12:38:00 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Fix RequestLevelParams persistence handling in RequestSpec https://review.opendev.org/c/openstack/nova/+/791502 | |
| 12:38:00 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: [func test] create pps resource on OVS agent RP https://review.opendev.org/c/openstack/nova/+/787205 | |
| 12:38:01 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: [func test] move port creation to the NeutronFixture https://review.opendev.org/c/openstack/nova/+/787206 | |
| 12:38:01 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: [func test] refactor assertPortMatchesAllocation https://review.opendev.org/c/openstack/nova/+/792458 | |
| 12:40:38 | elod | gibi: fyi, there are release patches to review: | |
| 12:40:40 | elod | https://review.opendev.org/c/openstack/releases/+/792923 | |
| 12:40:40 | elod | https://review.opendev.org/c/openstack/releases/+/792924 | |
| 12:40:41 | elod | https://review.opendev.org/c/openstack/releases/+/792938 | |
| 12:41:04 | elod | for me they seem OK :] | |
| 12:43:00 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add same_subtree field to RequestLevelParams https://review.opendev.org/c/openstack/nova/+/791503 | |
| 12:45:05 | gibi | elod: ack | |
| 12:46:19 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Bump min placement microversion to 1.36 https://review.opendev.org/c/openstack/nova/+/791504 | |
| 12:48:01 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Support same_subtree in allocation_canadidate query https://review.opendev.org/c/openstack/nova/+/791505 | |
| 12:51:38 | gibi | elod: the osc-placement patch needs more cores as it needs a major version bump. Can we get back to that then RH cores are back next week? | |
| 12:53:08 | gibi | s/then/when/ | |
| 12:55:47 | elod | gibi: I think yes | |
| 12:55:58 | elod | though yesterday was the M1 deadline | |
| 12:56:14 | gibi | elod: cool. I'm not confident bumping the major version alone while they are out | |
| 12:56:39 | elod | gibi: ++ | |
| 16:24:20 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Detect extended_resource_request neutron API extension https://review.opendev.org/c/openstack/nova/+/793618 | |
| 16:25:49 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Support the new port resource_request format https://review.opendev.org/c/openstack/nova/+/787208 | |
| 16:25:50 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Transfer RequestLevelParams from ports to scheduling https://review.opendev.org/c/openstack/nova/+/791506 | |
| 16:25:50 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: [func test] ports with both bw and pps resources https://review.opendev.org/c/openstack/nova/+/792394 | |
| 16:25:51 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Reject server create with extended resource req https://review.opendev.org/c/openstack/nova/+/793619 | |
| 16:25:51 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Reject server operations with extended resource req https://review.opendev.org/c/openstack/nova/+/793620 | |
| 16:25:52 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: [func test] move unshelve test to the proper place https://review.opendev.org/c/openstack/nova/+/793621 | |
| 19:11:18 | openstackgerrit | Merged openstack/nova master: zuul: Skip swap_volume tests as part of nova-next https://review.opendev.org/c/openstack/nova/+/793219 | |
| #openstack-nova - 2021-05-29 | |||
| 02:46:27 | openstackgerrit | Merged openstack/nova stable/queens: Use subqueryload() instead of joinedload() for (system_)metadata https://review.opendev.org/c/openstack/nova/+/761814 | |
| 03:20:45 | openstackgerrit | Brin Zhang proposed openstack/nova-specs master: Repropose vGPU support spec https://review.opendev.org/c/openstack/nova-specs/+/780452 | |
| 09:46:50 | openstackgerrit | Dmitrii Shcherbakov proposed openstack/nova-specs master: Integration With Off-path Network Backends https://review.opendev.org/c/openstack/nova-specs/+/787458 | |
| 12:31:32 | openstackgerrit | norman shen proposed openstack/nova master: Saving security group to info_cache https://review.opendev.org/c/openstack/nova/+/786348 | |
| #openstack-nova - 2021-05-31 | |||
| 04:39:25 | gryf | /LEAVE oh well | |
| 07:45:37 | gibi | IRC logging moved to the other IRC server (OFTC) so I will ask anybody to move discussion there :) | |
| 10:08:19 | bauzas | reminder : see emails about freenode and don't discuss here | |
| #openstack-nova - 2021-06-01 | |||
| 02:53:17 | opendevreview | norman shen proposed openstack/nova master: Saving security group to info_cache https://review.opendev.org/c/openstack/nova/+/786348 | |
| 03:31:22 | opendevreview | norman shen proposed openstack/nova master: Saving security group to info_cache https://review.opendev.org/c/openstack/nova/+/786348 | |
| 04:09:26 | opendevreview | norman shen proposed openstack/nova master: Saving security group to info_cache https://review.opendev.org/c/openstack/nova/+/786348 | |
| 06:24:33 | opendevreview | chengsheng proposed openstack/nova master: libvirt: Use improved guest CPU config APIs https://review.opendev.org/c/openstack/nova/+/762330 | |
| 06:52:18 | opendevreview | norman shen proposed openstack/nova master: Saving security group to info_cache https://review.opendev.org/c/openstack/nova/+/786348 | |
| 07:31:42 | frickler | I'm seeing issues with the nova-metadata service on stein, does that ring a bell with someone? from the logs it always seems to start with an eventlet traceback, then some requests timeout. sometimes it recovers, sometimes thing break completely and need a restart of apache2 http://paste.openstack.org/show/sjn1zlp9BYRX4zNGckmg/ | |
| 09:10:10 | bauzas | frickler: sorry for the late bump, but eventlet and stein are in my mind | |
| 09:11:57 | bauzas | something like https://bugs.launchpad.net/nova/+bug/1825584 | |
| 09:11:57 | opendevmeet | Launchpad bug 1825584 in OpenStack Compute (nova) stein "eventlet monkey-patching breaks AMQP heartbeat on uWSGI" [Low,In progress] - Assigned to sean mooney (sean-k-mooney) | |
| 09:15:45 | bauzas | frickler: also, fwiw, we deprecated using eventlet for the API by Rocky | |
| 09:15:52 | bauzas | https://review.opendev.org/c/openstack/nova/+/549510 | |
| 10:11:44 | frickler | bauzas: actually the service is running with wsgi in apache, the traceback is seen within /var/log/apache2/nova-metadata_error.log , I should have noted that | |
| 10:12:14 | bauzas | so a greenthread issue, I think | |
| 10:13:35 | frickler | ah, I just found https://review.opendev.org/c/openstack/nova/+/662095/5/releasenotes/notes/eventlet-monkey-patch-5f734ef581aa550e.yaml in the bug you linked, I need to check on those settings | |
| 10:15:07 | frickler | bauzas: ha, I think that's the issue, we have "threads=1" for nova-api, but =10 for metadata. hopefully that should be the issue already | |
| 10:15:20 | frickler | thx for the pointers | |
| 10:16:52 | jkulik | on that topic^ how does one deal with longrunning rpc-calls done from the API and the number of processes in uWSGI? It should block a whole process right? Thus making a DoS possible by doing a lot of volume-attachments in parallel (which does an RPC which holds a lock on the Instance) | |
| 10:18:47 | lyarwood | Only the initial part of the attachment is a call, the main part is a cast that should yield | |
| 10:19:02 | lyarwood | https://docs.openstack.org/nova/latest/reference/attach-volume.html | |
| 10:19:44 | lyarwood | I haven't had enough coffee to fully answer the impact of threads=1 on that flow however ;) | |
| 10:20:22 | jkulik | if there's an attachment running already, this takes the Instance lock. then all the other calls from nova-api to nova-compute for reserving the block-device-mapping entry (says for k8s workloads attaching > 10 volumes) will wait on the lock | |
| 10:21:16 | jkulik | so would it be recommended to run nova-api with a high number of threads to counter that? | |
| 10:21:24 | lyarwood | right that instance lock will block the remaining attachments | |
| 10:21:41 | lyarwood | that isn't going to help | |
| 10:21:59 | lyarwood | so you can run additional nova-api processes to avoid the lock on that side | |
| 10:22:10 | lyarwood | but nova-compute also takes an instance lock per attachment | |
| 10:22:20 | lyarwood | and another connect_volume lock within os-brick per compute node | |
| 10:22:42 | jkulik | yes, I'm not worried about nova-compute. I'm worried about some k8s projects starving out other users of nova-api | |
| 10:23:19 | lyarwood | I'm not sure if the instance lock actually blocks anything else from being accepted tbh | |
| 10:23:27 | lyarwood | but I get what you're saying | |
| 10:23:58 | lyarwood | we've not had any reports of n-api rejecting requests with k8s calling into it tbh but it could be possible | |
| 10:25:02 | jkulik | we're still on eventlet with a low number of process and trying to go to uWSGI, it looks like we have to run a huge number of processes to accommodate for that | |
| 10:25:14 | jkulik | or play around with threads=100 or something | |
| 10:26:39 | lyarwood | would you mind writing this up as a bug https://launchpad.net/nova/+bug ? | |
| 10:30:40 | jkulik | if you think that helps, sure. I just wanted to get input on how to run Nova tbh. | |
| 10:31:45 | lyarwood | It's mostly so others in NA can chime in later today with thoughts | |
| 10:32:46 | jkulik | ok. I'll write the problem statement down | |
| 10:34:51 | lyarwood | thanks | |
| 10:41:36 | sean-k-mooney | i generally try to avoid theads like "X is old and broken and Y is new an shiny" but a recent internal one pointed me to https://github.com/tummychow/git-absorb | |
| 10:41:54 | sean-k-mooney | which looks quite interesting | |
| 10:43:22 | sean-k-mooney | has anyone used it? im not sure how well it would work in pratice | |
| 10:43:24 | kashyap | sean-k-mooney: That project is missing a 1-line summary at the top; instead of a long elevator pitch | |
| 10:43:47 | kashyap | It says it is a port of "Facebook's "hg absorb"; which I don't know what it is | |
| 10:43:49 | sean-k-mooney | well its porting a feature of mecurial to git | |
| 10:43:55 | kashyap | "a feature"? | |
| 10:44:01 | sean-k-mooney | yes | |
| 10:44:09 | kashyap | That's what I mean by a simple 1-line summary of the feature :) | |
| 10:44:13 | gibi | sean-k-mooney: "will automatically identify which commits are safe to modify, and which staged changes belong to each of those commits" this sounds dangerous | |
| 10:44:17 | bauzas | sean-k-mooney: well, I trust in Gerrit for this | |
| 10:44:18 | kashyap | Yeah | |
| 10:44:23 | sean-k-mooney | so what it does is allow you to write one commit at the end of a patch chain that fixes all the review feedback | |
| 10:44:36 | bauzas | and I trust reviewers | |
| 10:44:45 | sean-k-mooney | then it will automaticly decomose it into may commits and aplly them as fixup via an interactive rebase | |