| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-09-24 | |||
| 13:19:43 | gibi | gmann: thanks | |
| 13:20:04 | gibi | then I will check the gate after the weekly meeting and decide if anything is close, if not we deferr them | |
| 13:20:20 | gibi | gmann: does the same true for the other two zuul migration patch (live migration + evac) | |
| 13:20:47 | gmann | gibi: let me check | |
| 13:36:03 | gmann | lyarwood: gibi nova-grenade-multinode job disappear from run in -https://review.opendev.org/#/c/752557/6 | |
| 13:36:09 | gmann | commented on review | |
| 13:38:04 | gibi | gmann: good point | |
| 13:41:06 | openstack | bug 1896463 in OpenStack Compute (nova) "evacuation failed: Port update failed : Unable to correlate PCI slot " [Low,Confirmed] https://launchpad.net/bugs/1896463 - Assigned to Balazs Gibizer (balazs-gibizer) | |
| 13:41:06 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Reproduce bug 1896463 in func env https://review.opendev.org/754100 | |
| 13:41:22 | gibi | this is a nasty race ^^ | |
| 13:43:33 | sean-k-mooney | that a knonw issue | |
| 13:44:29 | sean-k-mooney | let me see if i can find the downstream bug | |
| 13:44:37 | lyarwood | gmann: urgh sorry, weird how zuul don't complain about that | |
| 13:45:25 | gmann | lyarwood: yeah, that was strange, it think it skipped running it as base job it found from some stable branch and made this job valid only for stable branch. but yes this is confusing | |
| 13:45:47 | lyarwood | loverly | |
| 13:46:09 | gmann | it should be error instead of skip | |
| 13:46:12 | openstack | bugzilla.redhat.com bug 1852110 in openstack-nova "nova host-evacuation returns erroneous pci addresses and an error: Unable to correlate PCI slot" [High,New] - Assigned to smooney | |
| 13:46:12 | sean-k-mooney | gibi https://bugzilla.redhat.com/show_bug.cgi?id=1852110 | |
| 13:46:17 | lyarwood | yeah agreed | |
| 13:47:38 | openstack | Launchpad bug 1896463 in OpenStack Compute (nova) "evacuation failed: Port update failed : Unable to correlate PCI slot " [Low,Confirmed] - Assigned to Balazs Gibizer (balazs-gibizer) | |
| 13:47:38 | sean-k-mooney | gibi ill add https://bugs.launchpad.net/nova/+bug/1896463 ad the upstream track of the downstream bug | |
| 13:47:47 | gibi | sean-k-mooney: thanks | |
| 13:48:04 | sean-k-mooney | it exist in qeens for what it worth | |
| 13:49:22 | sean-k-mooney | gibi: there are other similar races for retries to other host and a much of issues with shevle and other move operations | |
| 13:49:55 | sean-k-mooney | also all move operation involving PFs dont work as we never update the neutorn port mac | |
| 13:50:43 | gibi | sean-k-mooney: yeah, the problem seems generic for every move that uses migration context and claims | |
| 13:51:08 | sean-k-mooney | yep | |
| 13:51:18 | gibi | now I have a reproducer for evacuate | |
| 13:51:22 | sean-k-mooney | it should not affect live migration for what its worth | |
| 13:51:54 | sean-k-mooney | ya i did not have time to look into this yet since it was only reported downstream in august | |
| 13:52:16 | sean-k-mooney | having a repoducer will certenly help figure out the fix | |
| 13:53:08 | openstack | bugzilla.redhat.com bug 1767797 in openstack-nova "When unshelving an SR-IOV instance, the binding profile isn't reclaimed or rescheduled, and this might cause PCI-PT conflicts" [High,New] - Assigned to nova-maint | |
| 13:53:08 | sean-k-mooney | this is the unshevle case i think https://bugzilla.redhat.com/show_bug.cgi?id=1767797 | |
| 13:53:28 | openstack | Launchpad bug 1851545 in OpenStack Compute (nova) "Port update exception on nova unshelve for instance with PCI devices (part 2)" [Medium,Triaged] | |
| 13:53:28 | sean-k-mooney | https://bugs.launchpad.net/nova/+bug/1851545 | |
| 13:54:16 | sean-k-mooney | it might be the same root cause. perhapse we coudl copy your repoducer for shelve and see it it causes it | |
| 13:54:46 | sean-k-mooney | gibi: ill try and review it later | |
| 13:55:16 | gibi | could be, I haven't checked the live migration relevance here | |
| 13:55:44 | sean-k-mooney | live migration does not use claims | |
| 13:55:57 | sean-k-mooney | for sriov devies | |
| 13:56:13 | sean-k-mooney | which si why i think it would be fine | |
| 13:56:19 | gibi | ahh, true, | |
| 13:57:04 | sean-k-mooney | pfs still wont work becaue of the mac issue but vfs should be fine | |
| 13:57:21 | gibi | yeah, I keep the PF-mac issue separate | |
| 13:57:37 | gibi | do we have a bug and a reproducer there? | |
| 13:57:48 | sean-k-mooney | while you are in a sriov context you might want to take a look at https://review.opendev.org/#/c/749175/ | |
| 13:58:15 | sean-k-mooney | i need to review the latest version but i think its more or less ready to merge after we reopen master and rc1 is done | |
| 13:59:25 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Migrate nova-grenade-multinode job to zuulv3 native https://review.opendev.org/742056 | |
| 13:59:33 | gibi | sean-k-mooney: ack, I have to get back to that | |
| 13:59:50 | gibi | at some point I started reading it but got pulled away | |
| 14:04:04 | sean-k-mooney | i tested it shortly after your attach stuff merged and it did not break anything but i can repoduce the issue so that is all i could say | |
| 14:05:51 | gibi | sean-k-mooney: do you mean you could not able to reproduce the bug before the fix? | |
| 14:11:33 | sean-k-mooney | yes it required the pci config space capablities to change for the device | |
| 14:11:44 | sean-k-mooney | that normally need a bios or firmware update | |
| 14:12:05 | sean-k-mooney | or change to the kernel/kernel_module paramters | |
| 14:12:42 | sean-k-mooney | gibi: for exampl if you put some intel nics into datacenter brinding mode it disable sriov capablity and repalces it with vmdq | |
| 14:13:01 | sean-k-mooney | that remove the virtual_funciotns capablity form the pci config space | |
| 14:13:15 | sean-k-mooney | meaning it would show up as type-PCI | |
| 14:13:28 | sean-k-mooney | if you put it back in sriov mode it woucl change to type-PF | |
| 14:13:38 | sean-k-mooney | but i do not have any hardwar that can do that to test with | |
| 14:16:31 | gibi | I see. When I get back to this bug I will check if I can test this or not in my SRIOV hardware | |
| 14:25:56 | sean-k-mooney | gibi: i asked for a functional test so we atleast have that | |
| 14:26:30 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Migrate nova-grenade-multinode job to zuulv3 native https://review.opendev.org/742056 | |
| 14:34:06 | gibi | sean-k-mooney: good point | |
| 14:34:37 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Migrate nova-grenade-multinode job to zuulv3 native https://review.opendev.org/742056 | |
| 14:34:39 | openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP: nova-next: Start testing the 'q35' machine type https://review.opendev.org/708701 | |
| 14:35:02 | lyarwood | kashyap: ^ fixed it up a little and removed the SCSI CDROM change dep as it isn't helping us test this | |
| 14:35:18 | gmann | lyarwood: ^^ let's see how it run. not using the script in grenade job. I have not disable the smoke test run on base and new cloud and only run live,cold migration and resize tests | |
| 14:35:44 | lyarwood | gmann: ack looking | |
| 14:36:55 | lyarwood | gmann: zuul isn't happyt | |
| 14:36:59 | lyarwood | happy* | |
| 14:37:13 | gmann | yeah some syntax things, checking | |
| 14:38:44 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Migrate nova-grenade-multinode job to zuulv3 native https://review.opendev.org/742056 | |
| 14:39:08 | openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP: nova-next: Start testing the 'q35' machine type https://review.opendev.org/708701 | |
| 14:45:08 | kashyap | lyarwood: Will check shortly; thanks! | |
| 14:48:23 | lyarwood | gibi: I'm not going to be around for the meeting btw | |
| 14:48:34 | lyarwood | gibi: I don't have anything rc related or for stable | |
| 14:50:51 | sean-k-mooney | gibi: i should be around for the meeting but ill be on PTO then until wednesday just an fyi | |
| 14:51:11 | sean-k-mooney | * ill be back on wednesday | |
| 14:52:59 | gibi | lyarwood: ack, thanks for the info | |
| 14:53:11 | gibi | sean-k-mooney: OK, have a nice PTO | |
| 14:55:25 | sean-k-mooney | i think im going to repaint my bedroom or assembel some dresser drawers. such an exciting life i leed :) | |
| 15:06:46 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Add tests for 'AggregateImagePropertiesIsolation' https://review.opendev.org/754115 | |
| 15:06:47 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Add tests for 'AggregateInstanceExtraSpecsFilter' https://review.opendev.org/754116 | |
| 15:33:28 | tosky | stephenfin: re placement PTL, couldn't the nova candidate (I assume there is just one :) also apply for placement PTL? It would be a "personal union" of the crown | |
| 15:33:54 | stephenfin | tosky: entirely possible. That's a very valid option 3 | |
| 15:50:25 | gibi | nova meeting starts in 10 minutes in #openstack-meeting-3 | |
| 15:54:22 | openstackgerrit | Balazs Gibizer proposed openstack/nova-specs master: Move implemented spec https://review.opendev.org/754124 | |
| 15:54:35 | openstackgerrit | Balazs Gibizer proposed openstack/nova-specs master: Move implemented specs https://review.opendev.org/754124 | |
| 16:24:33 | frickler | did nova recently raise the bar on qemu? looks like opensuse is failing with "nova.exception.InternalError: Nova requires QEMU version 4.0.0 or greater." https://a5f2733c1907b1f26b90-5593d50c131879f6a486eeedbad80e3c.ssl.cf5.rackcdn.com/743800/14/check/devstack-platform-opensuse-15/91eeaf7/controller/logs/screen-n-cpu.txt | |
| 16:26:14 | gibi | frickler: yes we did bumped min version | |
| 16:26:50 | gibi | frickler: https://review.opendev.org/#/c/746981/ | |
| 16:27:48 | frickler | gibi: ah, o.k., so I guess nobody checked opensuse? I mean, personally I don't care, we can just drop that devstack job | |
| 16:28:28 | gibi | yeah it seems nobody checked the opensuse job | |
| 16:29:12 | gibi | as far as I see it is a non-voting job that was not run for the nova patch | |
| 16:30:02 | gibi | frickler: I will open a bug to track this if you haven't done that yet | |
| 16:30:27 | frickler | gibi: I've asked the suse contacts I know in #openstack-infra, feel free to create a bug, too | |
| 16:30:51 | sean-k-mooney | frickler: the latest version of opensuse shoudl have the new minium | |
| 16:31:03 | sean-k-mooney | but that does not mean that job is using the latest version | |
| 16:31:33 | gmann | i think opensuse 15.1. has qemu 3.1.1.1 | |