Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2020-09-04
18:28:20 openstack Launchpad bug 1882521 in OpenStack Compute (nova) "Failing device detachments on Focal" [Critical,Confirmed] - Assigned to Lee Yarwood (lyarwood)
18:28:20 lyarwood gmann: re https://bugs.launchpad.net/nova/+bug/1882521 - I can hit this 100% of the time running the full suite but never if I run things in serial
18:28:55 lyarwood gmann: looking at dstat etc I'm pretty sure the host CPU is just maxed out slowing the guestOSs within the instances to the point where they can't detach disks quickly enough
18:30:52 lyarwood --concurrency nvm sorry
18:44:58 gmann lyarwood: yeah, via concurrency. for serial run concurrency is hardcoded to 1
19:40:03 openstackgerrit Merged openstack/nova stable/stein: libvirt: Handle VIR_ERR_DEVICE_MISSING when detaching devices https://review.opendev.org/742416
19:47:01 openstackgerrit Ghanshyam Mann proposed openstack/nova master: Migrate default policy file from JSON to YAML https://review.opendev.org/748059
20:30:25 openstackgerrit Merged openstack/nova stable/stein: libvirt: Do not reference VIR_ERR_DEVICE_MISSING when libvirt is < v4.1.0 https://review.opendev.org/747360
22:04:06 openstackgerrit Merged openstack/nova stable/stein: Improve CinderFixtureNewAttachFlow https://review.opendev.org/748509
22:04:12 openstackgerrit Merged openstack/nova stable/stein: Robustify attachment tracking in CinderFixtureNewAttachFlow https://review.opendev.org/748510
22:08:35 sean-k-mooney luyao: yes you can set concurrency in the zuul config
22:08:52 sean-k-mooney luyao: sory that was for lyarwood
22:08:57 sean-k-mooney but he is offline
23:16:04 openstackgerrit Merged openstack/nova stable/stein: compute: Use source_bdms to reset attachment_ids during LM rollback https://review.opendev.org/748511
23:33:15 openstackgerrit Merged openstack/nova stable/stein: compute: refactor volume bdm rollback error handling https://review.opendev.org/748512
23:33:23 openstack bug 1889108 in OpenStack Compute (nova) stein "failures during driver.pre_live_migration remove source attachments during rollback" [Undecided,In progress] https://launchpad.net/bugs/1889108 - Assigned to Lee Yarwood (lyarwood)
23:33:23 openstackgerrit Merged openstack/nova stable/stein: Add regression tests for bug #1889108 https://review.opendev.org/748513
23:33:28 openstackgerrit Merged openstack/nova stable/stein: compute: Don't delete the original attachment during pre LM rollback https://review.opendev.org/748514
23:41:11 openstackgerrit Ghanshyam Mann proposed openstack/nova master: Migrate default policy file from JSON to YAML https://review.opendev.org/748059
23:41:23 openstackgerrit Ghanshyam Mann proposed openstack/nova master: [Trivial] Replace ref of policy.json to policy.yaml https://review.opendev.org/749821
#openstack-nova - 2020-09-05
01:55:01 openstackgerrit Merged openstack/nova-specs master: Unified virtual persistent memory restrictions https://review.opendev.org/749472
04:00:02 openstackgerrit Takashi Natsume proposed openstack/nova master: Remove six.moves https://review.opendev.org/727224
04:01:49 openstackgerrit Takashi Natsume proposed openstack/nova master: Remove six.iteritems/itervalues/iterkeys https://review.opendev.org/727757
04:02:00 openstackgerrit Takashi Natsume proposed openstack/nova master: Remove six.byte2int/int2byte https://review.opendev.org/727777
04:02:15 openstackgerrit Takashi Natsume proposed openstack/nova master: Remove six.binary_type/integer_types/string_types https://review.opendev.org/728094
04:02:31 openstackgerrit Takashi Natsume proposed openstack/nova master: Remove six.text_type (1/2) https://review.opendev.org/728109
04:17:25 openstackgerrit Takashi Natsume proposed openstack/nova master: Remove six.text_type (2/2) https://review.opendev.org/728117
06:53:35 openstackgerrit Brin Zhang proposed openstack/nova stable/ussuri: Reject resize operation for accelerator https://review.opendev.org/749701
07:19:53 openstackgerrit Merged openstack/nova master: Add type hints to 'nova.virt.libvirt.utils' https://review.opendev.org/742865
14:06:55 openstackgerrit Ghanshyam Mann proposed openstack/nova master: Migrate default policy file from JSON to YAML https://review.opendev.org/748059
16:00:54 openstackgerrit Ghanshyam Mann proposed openstack/nova master: [Trivial] Replace ref of policy.json to policy.yaml https://review.opendev.org/749821
17:36:36 openstackgerrit Ghanshyam Mann proposed openstack/nova master: Run voting jobs in gate pipeline also https://review.opendev.org/750078
17:37:31 gmann dansmith: smcginnis : adding both jobs in gate pipeline too -https://review.opendev.org/#/c/750078/1
17:37:36 gmann sean-k-mooney1: ^^
17:37:43 gmann smcginnis: ignore it
18:42:29 openstackgerrit Ghanshyam Mann proposed openstack/nova master: Migrate default policy file from JSON to YAML https://review.opendev.org/748059
22:35:17 openstackgerrit Ghanshyam Mann proposed openstack/nova master: Run voting jobs in gate pipeline also https://review.opendev.org/750078
#openstack-nova - 2020-09-06
07:39:16 openstackgerrit Mamduh proposed openstack/os-vif master: Fix - os-vif fails to get the correct UpLink Representor https://review.opendev.org/745895
11:42:51 openstackgerrit Takashi Natsume proposed openstack/nova master: doc: Fix note directives https://review.opendev.org/750094
#openstack-nova - 2020-09-07
01:42:24 openstackgerrit Wenping Song proposed openstack/nova-specs master: Support vGPU in nova and cyborg interaction https://review.opendev.org/750116
07:35:39 bauzas good morning Nova
07:37:14 gibi bauzas: good morning
08:29:30 brinzhang bauzas, gibi: good morning
08:30:24 brinzhang bauzas, gibi: two backport patches hope you can review, trivial changes https://review.opendev.org/#/c/749681/ , https://review.opendev.org/#/c/749701/
08:53:09 openstackgerrit Balazs Gibizer proposed openstack/nova master: Support SRIOV interface attach and detach https://review.opendev.org/740995
08:53:09 openstackgerrit Balazs Gibizer proposed openstack/nova master: Use UUID as vif and network_id in vif tests https://review.opendev.org/748722
09:02:35 openstackgerrit Liang Fang proposed openstack/nova master: Add volume local cache support https://review.opendev.org/663542
09:04:16 elod gibi: if you will have time: https://review.opendev.org/#/c/750068/ :) (Stein release patch)
09:09:17 openstackgerrit Balazs Gibizer proposed openstack/nova master: Make PCI claim NUMA aware during live migration https://review.opendev.org/748453
09:10:02 gibi elod: done
09:10:03 gibi thanks
09:12:41 gibi stephenfin: hi! the nova-multi-cell failure in the vtpm resize patch seems to be relevant
09:13:01 stephenfin ack, looking
09:13:19 gibi https://zuul.opendev.org/t/openstack/build/7326bc59092346b18fe9858774606321/log/compute1/logs/screen-n-cpu.txt?severity=4#7741
09:18:41 elod gibi: thx! \o/
09:24:46 luyao stephenfin: Hi, not sure whether you saw my message last week, just a kind remind for vpmem-enhencement https://review.opendev.org/#/q/topic:bp/vpmem-enhancement+(status:open+OR+status:merged) . I move the patch 'improve orphans tracking' to the last of the patch sequence (we don't have any big concern on the other 3 patches I think), I redefined those orphans in updated patch since previous version involved the
09:24:47 openstack bug 1879878 in OpenStack Compute (nova) "VM become Error after confirming resize with Error info CPUUnpinningInvalid on source node " [Medium,In progress] https://launchpad.net/bugs/1879878 - Assigned to Stephen Finucane (stephenfinucane)
09:24:47 luyao bug #1879878, and I didn't notice you have fixed it.
09:25:25 stephenfin luyao: ack, will take a look this afternoon
09:25:43 luyao stephenfin: Thank you in advance. :)
09:34:52 bauzas gosh, morning hell here
09:47:00 openstackgerrit Wenping Song proposed openstack/nova-specs master: Support vGPU in nova and cyborg interaction https://review.opendev.org/750116
09:59:46 nightmare_unreal live-migration force node is not working with v2.67 , In v.268 force live migration was completely removed but it should work with v2.67
10:10:53 bauzas why don't we have good api reference for https://docs.openstack.org/api-ref/network/v2/index.html#subnets ?
10:11:24 noonedeadpunk hi everyone. any chance you know why nova-compute may fail on centos7 for master and ussuri that way? https://zuul.opendev.org/t/openstack/build/6add842202c34390959d5fd0bd6fc83b/log/logs/host/nova-compute.service.journal-15-37-20.log.txt#2729-2768
10:13:19 noonedeadpunk centos8, debian,ubuntu feel ok with the same setup path and configs
10:13:45 bauzas gibi: do you know how I can know the API reference for getting the subnets information ?
10:13:54 bauzas gibi: looking at https://docs.openstack.org/neutron/latest/admin/config-routed-networks.html#example
10:14:05 bauzas gibi: it looks to me you can get the related segment of a subnet
10:14:15 bauzas openstack subnet show my_subnet --c segment_id
10:14:56 bauzas but i guess it's a neutron extension
10:17:37 bauzas ahah, that's the reference which is confusing
10:17:56 bauzas https://docs.openstack.org/api-ref/network/v2/index.html?expanded=show-subnet-details-detail#show-subnet-details
10:33:24 gibi bauzas: sorry, I was afk
11:27:12 lee1 kashyap: morning, random question, have you had to debug device detach issues before through libvirt and the guestOS and if so do you have any tips?
11:27:29 openstack Launchpad bug 1882521 in OpenStack Compute (nova) "Failing device detachments on Focal" [Critical,Confirmed] - Assigned to Lee Yarwood (lyarwood)
11:27:29 lyarwood kashyap: context is https://bugs.launchpad.net/nova/+bug/1882521
11:27:51 kashyap Ack; back here in a min :)
11:28:20 lyarwood kashyap: I can reproduce while running the full suite of tests and I'm pretty sure it's just an issue of the guestOS (cirros) not being able to process the request but I just want to prove it somehow
11:28:23 lyarwood ack np
11:29:34 kashyap lyarwood: lee1 was your nick too, I suppose?
11:32:05 kashyap lyarwood: I vaguely recall some triaging some device detach issues; but I forget the details. Gimme a few
11:32:22 kashyap lyarwood: Are you also implying that this is not reproducible with non-CirrOS guests?
11:34:03 kashyap Okay, you say as much in #5
11:34:05 kashyap "Each time this has been hit however it appears that the Guest OS (cirros) isn't able to react to the ACPI request to detach the disk device. "
11:34:45 lyarwood kashyap: yeah that's my feeling at the moment, I'm looking to prove it now
11:35:07 lyarwood kashyap: just trying to work out how to capture the moment libvirt / QEMU signal the guestOS to detach the device
11:35:24 kashyap lyarwood: Right, configure the debug log filters, it should definitely give us some clues
11:35:25 lyarwood kashyap: and then work out how to capture that in the guest, AFAICT dmesg doesn't list it
11:35:40 kashyap `journalctl`?
11:37:01 lyarwood kashyap: cirros doesn't have systemd
11:37:08 kashyap Darn, I keep forgetting
11:37:44 lyarwood ah it's using acpid
11:40:43 sean-k-mooney1 i need to try and find time to test alpine as a cirros alternitive
11:40:47 kashyap lyarwood: Fedora doesn't do it?
11:40:56 kashyap (As in, 'acpid' daemon)
11:41:39 sean-k-mooney1 fedora uses systemd for udev im not cure if that will handel acpid too
11:41:50 sean-k-mooney1 *sure
11:45:35 kashyap sean-k-mooney: 'systemd' can handle some ACPI events; not all - https://wiki.archlinux.org/index.php/Power_management#ACPI_events
11:45:43 kashyap On my Fedora laptop I see:

Earlier   Later