Posted	Nick	Remark
#openstack-nova - 2021-05-27
17:31:04	gmann	I will update the spec accordingly.
17:31:09	gmann	thanks dansmith melwitt sean-k-mooney
17:31:19	dansmith	gmann: cool, sorry for missing your reply earlier
17:31:22	sean-k-mooney	oh to remove the aggreate metadtata requirement
17:31:37	sean-k-mooney	form an end user perspecitv i would not be able to tell the diffrenece
17:31:38	gmann	dansmith: np! I too missed to ask that day itself.
17:32:04	sean-k-mooney	so that policy would not be an interop issue so i think its ok to add one yes
17:33:05	sean-k-mooney	ok i am going to finish up for the day. ill see everyon on our new home on tuesday o/
17:33:25	dansmith	sean-k-mooney: enjoy o/
17:33:26	melwitt	have a good weekend o/
17:35:21	dansmith	wow
17:35:28	dansmith	not used to seeing that :P
17:36:17	melwitt	😆
17:39:21	artom	He's been making big improvement in keeping a regular work schedule
17:39:26	artom	(I sound like his dad)
17:39:54	gmann	lucky redhatters :) long weekend
17:40:24	gmann	I miss Tokyo in that term for many long weekend and three golden weeks in a year
23:23:38	openstackgerrit	Ghanshyam proposed openstack/nova-specs master: Allow project admin to list hypervisors https://review.opendev.org/c/openstack/nova-specs/+/793011
23:23:52	gmann	dansmith: melwitt ^^
#openstack-nova - 2021-05-28
00:42:54	openstackgerrit	melanie witt proposed openstack/nova master: Honor [neutron]http_retries in the manual client https://review.opendev.org/c/openstack/nova/+/793512
01:34:47	openstackgerrit	Wenping Song proposed openstack/nova master: Replaces tenant_id with project_id from Rebuild Server API https://review.opendev.org/c/openstack/nova/+/766380
01:38:59	openstackgerrit	Wenping Song proposed openstack/nova master: Replaces tenant_id with project_id from List/Update Servers APIs https://review.opendev.org/c/openstack/nova/+/764292
08:39:04	openstackgerrit	Wenping Song proposed openstack/nova master: Replace tenant* with project* in codes https://review.opendev.org/c/openstack/nova/+/769329
08:46:38	yonglihe	sean-k-mooney, gibi, do you have time for smart patches? thanks. https://review.opendev.org/q/topic:%22bp%252Fsriov-smartnic-support%22+(status:open%20OR%20status:merged)
09:30:13	openstackgerrit	Merged openstack/nova-specs master: [pps] Move the alternatives to separate section https://review.opendev.org/c/openstack/nova-specs/+/792634
11:45:48	openstackgerrit	Balazs Gibizer proposed openstack/nova-specs master: Allow provider re-parenting in placement https://review.opendev.org/c/openstack/nova-specs/+/788243
11:52:31	openstackgerrit	Balazs Gibizer proposed openstack/nova master: Add test coverage for security group checking https://review.opendev.org/c/openstack/nova/+/786044
12:15:43	openstackgerrit	Balazs Gibizer proposed openstack/nova-specs master: [template]suggest work item ordering https://review.opendev.org/c/openstack/nova-specs/+/793197
12:38:00	openstackgerrit	Balazs Gibizer proposed openstack/nova master: [func test] create pps resource on OVS agent RP https://review.opendev.org/c/openstack/nova/+/787205
12:38:00	openstackgerrit	Balazs Gibizer proposed openstack/nova master: Fix RequestLevelParams persistence handling in RequestSpec https://review.opendev.org/c/openstack/nova/+/791502
12:38:01	openstackgerrit	Balazs Gibizer proposed openstack/nova master: [func test] refactor assertPortMatchesAllocation https://review.opendev.org/c/openstack/nova/+/792458
12:38:01	openstackgerrit	Balazs Gibizer proposed openstack/nova master: [func test] move port creation to the NeutronFixture https://review.opendev.org/c/openstack/nova/+/787206
12:40:38	elod	gibi: fyi, there are release patches to review:
12:40:40	elod	https://review.opendev.org/c/openstack/releases/+/792924
12:40:40	elod	https://review.opendev.org/c/openstack/releases/+/792923
12:40:41	elod	https://review.opendev.org/c/openstack/releases/+/792938
12:41:04	elod	for me they seem OK :]
12:43:00	openstackgerrit	Balazs Gibizer proposed openstack/nova master: Add same_subtree field to RequestLevelParams https://review.opendev.org/c/openstack/nova/+/791503
12:45:05	gibi	elod: ack
12:46:19	openstackgerrit	Balazs Gibizer proposed openstack/nova master: Bump min placement microversion to 1.36 https://review.opendev.org/c/openstack/nova/+/791504
12:48:01	openstackgerrit	Balazs Gibizer proposed openstack/nova master: Support same_subtree in allocation_canadidate query https://review.opendev.org/c/openstack/nova/+/791505
12:51:38	gibi	elod: the osc-placement patch needs more cores as it needs a major version bump. Can we get back to that then RH cores are back next week?
12:53:08	gibi	s/then/when/
12:55:47	elod	gibi: I think yes
12:55:58	elod	though yesterday was the M1 deadline
12:56:14	gibi	elod: cool. I'm not confident bumping the major version alone while they are out
12:56:39	elod	gibi: ++
16:24:20	openstackgerrit	Balazs Gibizer proposed openstack/nova master: Detect extended_resource_request neutron API extension https://review.opendev.org/c/openstack/nova/+/793618
16:25:49	openstackgerrit	Balazs Gibizer proposed openstack/nova master: Support the new port resource_request format https://review.opendev.org/c/openstack/nova/+/787208
16:25:50	openstackgerrit	Balazs Gibizer proposed openstack/nova master: [func test] ports with both bw and pps resources https://review.opendev.org/c/openstack/nova/+/792394
16:25:50	openstackgerrit	Balazs Gibizer proposed openstack/nova master: Transfer RequestLevelParams from ports to scheduling https://review.opendev.org/c/openstack/nova/+/791506
16:25:51	openstackgerrit	Balazs Gibizer proposed openstack/nova master: Reject server operations with extended resource req https://review.opendev.org/c/openstack/nova/+/793620
16:25:51	openstackgerrit	Balazs Gibizer proposed openstack/nova master: Reject server create with extended resource req https://review.opendev.org/c/openstack/nova/+/793619
16:25:52	openstackgerrit	Balazs Gibizer proposed openstack/nova master: [func test] move unshelve test to the proper place https://review.opendev.org/c/openstack/nova/+/793621
19:11:18	openstackgerrit	Merged openstack/nova master: zuul: Skip swap_volume tests as part of nova-next https://review.opendev.org/c/openstack/nova/+/793219
#openstack-nova - 2021-05-29
02:46:27	openstackgerrit	Merged openstack/nova stable/queens: Use subqueryload() instead of joinedload() for (system_)metadata https://review.opendev.org/c/openstack/nova/+/761814
03:20:45	openstackgerrit	Brin Zhang proposed openstack/nova-specs master: Repropose vGPU support spec https://review.opendev.org/c/openstack/nova-specs/+/780452
09:46:50	openstackgerrit	Dmitrii Shcherbakov proposed openstack/nova-specs master: Integration With Off-path Network Backends https://review.opendev.org/c/openstack/nova-specs/+/787458
12:31:32	openstackgerrit	norman shen proposed openstack/nova master: Saving security group to info_cache https://review.opendev.org/c/openstack/nova/+/786348
#openstack-nova - 2021-05-31
04:39:25	gryf	/LEAVE oh well
07:45:37	gibi	IRC logging moved to the other IRC server (OFTC) so I will ask anybody to move discussion there :)
10:08:19	bauzas	reminder : see emails about freenode and don't discuss here
#openstack-nova - 2021-06-01
02:53:17	opendevreview	norman shen proposed openstack/nova master: Saving security group to info_cache https://review.opendev.org/c/openstack/nova/+/786348
03:31:22	opendevreview	norman shen proposed openstack/nova master: Saving security group to info_cache https://review.opendev.org/c/openstack/nova/+/786348
04:09:26	opendevreview	norman shen proposed openstack/nova master: Saving security group to info_cache https://review.opendev.org/c/openstack/nova/+/786348
06:24:33	opendevreview	chengsheng proposed openstack/nova master: libvirt: Use improved guest CPU config APIs https://review.opendev.org/c/openstack/nova/+/762330
06:52:18	opendevreview	norman shen proposed openstack/nova master: Saving security group to info_cache https://review.opendev.org/c/openstack/nova/+/786348
07:31:42	frickler	I'm seeing issues with the nova-metadata service on stein, does that ring a bell with someone? from the logs it always seems to start with an eventlet traceback, then some requests timeout. sometimes it recovers, sometimes thing break completely and need a restart of apache2 http://paste.openstack.org/show/sjn1zlp9BYRX4zNGckmg/
09:10:10	bauzas	frickler: sorry for the late bump, but eventlet and stein are in my mind
09:11:57	opendevmeet	Launchpad bug 1825584 in OpenStack Compute (nova) stein "eventlet monkey-patching breaks AMQP heartbeat on uWSGI" [Low,In progress] - Assigned to sean mooney (sean-k-mooney)
09:11:57	bauzas	something like https://bugs.launchpad.net/nova/+bug/1825584
09:15:45	bauzas	frickler: also, fwiw, we deprecated using eventlet for the API by Rocky
09:15:52	bauzas	https://review.opendev.org/c/openstack/nova/+/549510
10:11:44	frickler	bauzas: actually the service is running with wsgi in apache, the traceback is seen within /var/log/apache2/nova-metadata_error.log , I should have noted that
10:12:14	bauzas	so a greenthread issue, I think
10:13:35	frickler	ah, I just found https://review.opendev.org/c/openstack/nova/+/662095/5/releasenotes/notes/eventlet-monkey-patch-5f734ef581aa550e.yaml in the bug you linked, I need to check on those settings
10:15:07	frickler	bauzas: ha, I think that's the issue, we have "threads=1" for nova-api, but =10 for metadata. hopefully that should be the issue already
10:15:20	frickler	thx for the pointers
10:16:52	jkulik	on that topic^ how does one deal with longrunning rpc-calls done from the API and the number of processes in uWSGI? It should block a whole process right? Thus making a DoS possible by doing a lot of volume-attachments in parallel (which does an RPC which holds a lock on the Instance)
10:18:47	lyarwood	Only the initial part of the attachment is a call, the main part is a cast that should yield
10:19:02	lyarwood	https://docs.openstack.org/nova/latest/reference/attach-volume.html
10:19:44	lyarwood	I haven't had enough coffee to fully answer the impact of threads=1 on that flow however ;)
10:20:22	jkulik	if there's an attachment running already, this takes the Instance lock. then all the other calls from nova-api to nova-compute for reserving the block-device-mapping entry (says for k8s workloads attaching > 10 volumes) will wait on the lock
10:21:16	jkulik	so would it be recommended to run nova-api with a high number of threads to counter that?
10:21:24	lyarwood	right that instance lock will block the remaining attachments
10:21:41	lyarwood	that isn't going to help
10:21:59	lyarwood	so you can run additional nova-api processes to avoid the lock on that side
10:22:10	lyarwood	but nova-compute also takes an instance lock per attachment
10:22:20	lyarwood	and another connect_volume lock within os-brick per compute node
10:22:42	jkulik	yes, I'm not worried about nova-compute. I'm worried about some k8s projects starving out other users of nova-api
10:23:19	lyarwood	I'm not sure if the instance lock actually blocks anything else from being accepted tbh
10:23:27	lyarwood	but I get what you're saying
10:23:58	lyarwood	we've not had any reports of n-api rejecting requests with k8s calling into it tbh but it could be possible
10:25:02	jkulik	we're still on eventlet with a low number of process and trying to go to uWSGI, it looks like we have to run a huge number of processes to accommodate for that
10:25:14	jkulik	or play around with threads=100 or something
10:26:39	lyarwood	would you mind writing this up as a bug https://launchpad.net/nova/+bug ?
10:30:40	jkulik	if you think that helps, sure. I just wanted to get input on how to run Nova tbh.
10:31:45	lyarwood	It's mostly so others in NA can chime in later today with thoughts
10:32:46	jkulik	ok. I'll write the problem statement down
10:34:51	lyarwood	thanks

Earlier   Later