Posted	Nick	Remark
#openstack-nova - 2020-07-17
02:45:14	sean-k-mooney	no worries
04:21:07	openstackgerrit	Huaqiang Wang proposed openstack/nova master: hardware: create 'mixed' instance for realtime CPUs https://review.opendev.org/728485
04:21:08	openstackgerrit	Huaqiang Wang proposed openstack/nova master: metadata: export the vCPU IDs that are pinning on the host CPUs https://review.opendev.org/688936
04:21:08	openstackgerrit	Huaqiang Wang proposed openstack/nova master: compute: bump nova-compute version and check in API https://review.opendev.org/740933
04:21:09	openstackgerrit	Huaqiang Wang proposed openstack/nova master: test: add some notes and new tests for mixed instance https://review.opendev.org/741395
04:21:09	openstackgerrit	Huaqiang Wang proposed openstack/nova master: release note: add new features introduces by use-pcpu-and-vcpu-in-one-instance https://review.opendev.org/736997
06:07:24	openstackgerrit	Huaqiang Wang proposed openstack/nova master: hardware: create 'mixed' instance for realtime CPUs https://review.opendev.org/728485
06:07:25	openstackgerrit	Huaqiang Wang proposed openstack/nova master: metadata: export the vCPU IDs that are pinning on the host CPUs https://review.opendev.org/688936
06:07:25	openstackgerrit	Huaqiang Wang proposed openstack/nova master: compute: bump nova-compute version and check in API https://review.opendev.org/740933
06:07:26	openstackgerrit	Huaqiang Wang proposed openstack/nova master: test: add some notes and new tests for mixed instance https://review.opendev.org/741395
06:07:26	openstackgerrit	Huaqiang Wang proposed openstack/nova master: release note: add new features introduces by use-pcpu-and-vcpu-in-one-instance https://review.opendev.org/736997
06:12:15	openstackgerrit	Wenping Song proposed openstack/nova-specs master: Add no user token when get Cyborg client https://review.opendev.org/740184
07:38:11	openstackgerrit	Kevin Zhao proposed openstack/nova master: [WIP] CI: add tempest-integrated-compute-aarch64 job https://review.opendev.org/714439
07:45:12	openstackgerrit	Luigi Toscano proposed openstack/nova stable/ussuri: zuul: remove legacy-tempest-dsvm-neutron-dvr-multinode-full https://review.opendev.org/741590
08:14:14	openstackgerrit	Kevin Zhao proposed openstack/nova master: [WIP] CI: add tempest-integrated-compute-aarch64 job https://review.opendev.org/714439
08:37:05	openstackgerrit	Balazs Gibizer proposed openstack/nova-specs master: Support SRIOV interface attach and detach https://review.opendev.org/741601
09:02:03	openstackgerrit	Tobias Urdin proposed openstack/nova master: [PoC] libvirt: Broadcast RARP post live migration https://review.opendev.org/741529
09:03:17	openstackgerrit	Tobias Urdin proposed openstack/nova master: [PoC] libvirt: Send announce-self post live migration https://review.opendev.org/741529
09:04:44	tobias-urdin	sean-k-mooney: yes I agree, it's a dirty workaround but until it is solved I will need to carry this downstream
09:05:15	openstackgerrit	Balazs Gibizer proposed openstack/nova master: Remove broken legacy zuul jobs https://review.opendev.org/741603
09:07:02	gibi	gmann, tosky: I proposed some clean of our jobs ^^
09:08:20	tosky	gibi: as long as it works for you, I'm fine :)
09:08:28	gibi	tosky: they never passed
09:08:41	gibi	tosky: and they are really old jobs
09:09:07	gibi	and anyhow if somebody needs them and cares about them then we can resurrect them in zuul v3 form later
09:09:30	tosky	I don't remember if I mentioned it yesterday: even though it's not part of the main goal (just stretch), if you plan to backport the fixes to the older branches, that will help cleaning up openstack-zuul-jobs
09:09:59	gibi	tosky: I'm happy to backport these job deletes to older branches
09:09:59	tosky	that's why I proposed a backport of the fix that was merged yesterday
09:10:05	tosky	thanks :)
09:23:30	gibi	lyarwood, melwitt: if you have time could you hit this pike backport? https://review.opendev.org/#/q/topic:bug/1862633+status:open
09:52:18	lyarwood	gibi: ack I can look today
09:52:35	gibi	thanks
09:55:11	gibi	sean-k-mooney, stephenfin: fyi I pushed a small spec for SRIOV attach https://review.opendev.org/#/c/741601/
10:22:21	openstackgerrit	Wenping Song proposed openstack/nova master: Cyborg shelve/unshelve support https://review.opendev.org/729563
10:26:52	brinzhang0	gibi: hi, I update the nova runway, added the cyborg-shelve-and-unshelve patches to the queue
10:46:51	stephenfin	gibi: I lost the race for some o.vo versions. Could I get your +2 on this again? https://review.opendev.org/#/c/739210/
10:51:29	stephenfin	gibi: -1 on spec for nits but otherwise perfect
10:53:05	openstackgerrit	Stephen Finucane proposed openstack/nova master: libvirt: Re-enable live snapshot for paused instances https://review.opendev.org/740334
10:53:06	openstackgerrit	Stephen Finucane proposed openstack/nova master: libvirt: Use better variable names for '_create_guest' https://review.opendev.org/740945
10:53:06	openstackgerrit	Stephen Finucane proposed openstack/nova master: libvirt: Remove workaround for really old QEMU https://review.opendev.org/740335
10:53:07	openstackgerrit	Stephen Finucane proposed openstack/nova master: WIP: Attempt to restore some sanity to snapshot https://review.opendev.org/740336
10:53:51	stephenfin	lyarwood: The first two of those are pretty simple but would benefit from your eyes, IMO. The third is a FUP for your comments ^
10:56:38	kashyap	stephenfin: Good catch on re-enabling the 'paused' thing
10:56:40	kashyap	I recall the old change
10:57:25	kashyap	Yep, it makes sense, given how far we've come w/ newer (and largely improved) versions
11:37:06	sean-k-mooney	gibi: ill read your sepc shortly. did you see my comments on the code change.
11:37:47	sean-k-mooney	your code change wont fix PF detach either so i might just add a small patch on top to do that
12:04:10	openstackgerrit	Stephen Finucane proposed openstack/nova master: api: Add type hints for 'nova.compute.api' https://review.opendev.org/741623
12:04:11	openstackgerrit	Stephen Finucane proposed openstack/nova master: WIP: api: Add 'nova.compute.API.migrate' https://review.opendev.org/741624
12:05:47	openstackgerrit	Elod Illes proposed openstack/nova stable/queens: Reject boot request for unsupported images https://review.opendev.org/708609
12:21:03	openstackgerrit	Lee Yarwood proposed openstack/nova master: libvirt: Handle VIR_ERR_DEVICE_MISSING when detaching devices https://review.opendev.org/741561
13:01:09	jkulik	How often and how do you clean up your instances table in the cell0 db?
13:01:52	sean-k-mooney	i think you do it with nova-manage
13:02:13	sean-k-mooney	how often is up to you
13:02:29	sean-k-mooney	i think downstream we default to every 30days
13:03:52	jkulik	hm ... I thought so, but I can't seem to find the docs or the code for that
13:05:10	sean-k-mooney	i think you do "nova-manage db archive_deleted_rows" then "nova-manage db purge"
13:05:28	sean-k-mooney	but you need to us a config file with the cell0 credentials
13:06:37	gibi	stephenfin: thanks.
13:06:50	jkulik	deleted_at is NULL for the instance I'm looking at. it's over 200 days old
13:06:51	gibi	sean-k-mooney: I haven't read the comments on the code yet
13:07:26	gibi	sean-k-mooney: I have some review to make before I can circle back to the sriov code patches
13:07:37	sean-k-mooney	gibi: there is no rush
13:08:02	sean-k-mooney	it can wait till next week
13:08:20	gibi	ack
13:08:23	jkulik	Seems to be just that one instance, that's not deleted, though. Thank you.
13:09:05	mnaser	i think the archive code didn't cover cell0 before and recently added support to go over all cells
13:09:06	mnaser	if i'm remembering right
13:09:36	sean-k-mooney	mnaser: so by default nova manage used to only look at cell1
13:09:59	sean-k-mooney	you could create a second config can use that to run the commands on cell0
13:10:10	sean-k-mooney	but i dont know if we have now made it do that by default or not
13:10:10	mnaser	yeah, i get this feeling i remember there was an improvement that let you run it against all cells more recently
13:10:40	sean-k-mooney	it came up as a downstream bug i think and melwitt? might have imporved it
13:11:01	mnaser	sean-k-mooney: good memory https://review.opendev.org/#/c/507486/
13:11:45	sean-k-mooney	11 months so proably train?
13:11:58	mnaser	yes, the earliest tag this commit is part of is train
13:12:03	mnaser	or 20.0.0
13:12:10	mnaser	so yeah, train onwards
13:12:19	lyarwood	melwitt: https://review.opendev.org/#/c/741561/ - would you be able to take a look at this today?
13:13:00	sean-k-mooney	im not sure if this is backportable or not but jkulik are you pre train
13:13:52	jkulik	I'm fine for now, thank you. (we're on queens but going to upgrade soon. it can wait. the instance in question just wasn't marked deleted and thus still came up in "server list" and customers wondered ...)
13:14:19	sean-k-mooney	if it was in cell0 then it would have been in error
13:14:36	jkulik	It was actually in state BUILD
13:14:52	sean-k-mooney	really? that should not happen
13:15:16	sean-k-mooney	that likely means you had an rpc issue at some point that lost a callback to set it to error
13:15:25	jkulik	but since that happened somewhere last year, I also don't have logs anymore. this being the only instance in that state, I think it can be ignored.
13:15:53	sean-k-mooney	ya but if you do see this crop up more often let us know
13:16:13	sean-k-mooney	queens is sufficently old that if you hit an issue its proably already fixed but still good to know
13:16:35	mnaser	yeah, i've ran into a few of the isssues that jkulik ran into and cleaned them up in later release
13:16:46	mnaser	mostly around making things happen in a single transaction to avoid BUILD inside cell0
13:17:43	sean-k-mooney	maybe that is something we shoudl add to nova audit
13:18:06	mnaser	btw - debug from yesterday's issue exposes this https://www.irccloud.com/pastebin/FdpUKxPC/
13:18:08	sean-k-mooney	set instance in build in cell0 to error after x time
13:18:48	mnaser	so it sounds like the actual commit to addport happened 34 seconds after
13:19:54	sean-k-mooney	ya so if your using iptables os-vif need to create a linux bridge then a veth pair then add one end of the veth pair to the linux bridge and the other end to ovs
13:20:17	mnaser	so maybe that part took a long time so i need to do some more log grepping
13:20:19	sean-k-mooney	so that can take a few second although i would not normally expect it to be that long
13:20:54	mnaser	system has 1157 total devices
13:21:00	sean-k-mooney	going form vsctl to native seams to have cut it form 3 mins to ~30 seconds so thats an improvement at least
13:21:11	mnaser	from qvo/qvb/qbr

Earlier   Later