| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-03-25 | |||
| 16:08:41 | sean-k-mooney | luyao: yes we clean up those resouces ealier in the function | |
| 16:08:59 | sean-k-mooney | luyao: so we unplug the guest interface on the ovs bridge for example | |
| 16:09:20 | sean-k-mooney | and we have to unmount any cinder volumes that were mounted on the soucres node | |
| 16:09:30 | luyao | sean-k-mooney: yeah, invoking driver.cleanup will not cleanup them again | |
| 16:09:44 | openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Add support for stable device rescue https://review.opendev.org/700812 | |
| 16:09:44 | openstackgerrit | Lee Yarwood proposed openstack/nova master: virt: Provide block_device_info during rescue https://review.opendev.org/700811 | |
| 16:09:45 | openstackgerrit | Lee Yarwood proposed openstack/nova master: compute: Extract _get_bdm_image_metadata into nova.utils https://review.opendev.org/705212 | |
| 16:09:45 | openstackgerrit | Lee Yarwood proposed openstack/nova master: compute: Report COMPUTE_RESCUE_BFV and check during rescue https://review.opendev.org/701429 | |
| 16:09:46 | openstackgerrit | Lee Yarwood proposed openstack/nova master: api: Introduce microverion 2.83 allowing boot from volume rescue https://review.opendev.org/701430 | |
| 16:09:46 | openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Support boot from volume stable device instance rescue https://review.opendev.org/701431 | |
| 16:09:47 | openstackgerrit | Lee Yarwood proposed openstack/nova master: DNM - Test stable device rescue tests with BFV instances https://review.opendev.org/710050 | |
| 16:10:09 | sean-k-mooney | luyao: ya i know | |
| 16:10:22 | sean-k-mooney | well with the flags you have set | |
| 16:10:23 | gmann | sean-k-mooney: brinzhang and that is what use case if actually. expose something a non-admin could fix. may be filter or whitelist the non-admin fixable exceptions can be better here ? | |
| 16:10:42 | gmann | or at least not expose the non-nova exception at all. | |
| 16:11:10 | sean-k-mooney | gmann: well i would geuss any 4xx errors should be actionable by them in some way | |
| 16:11:27 | sean-k-mooney | if we are identifying them as client issues | |
| 16:11:30 | luyao | sean-k-mooney: yeah, and now I need driver.cleanup to cleanup vpmems | |
| 16:12:28 | gmann | sean-k-mooney: yeah most of them yes. few 404 might not be but I have not checked all exceptions but overall 4xx is in their range | |
| 16:17:19 | luyao | sean-k-mooney, lyarwood: I'll offline and can't response promptly, so please left comments on patch https://review.opendev.org/#/c/687856 if you have any suggestion about vpmem cleanup during live migration. Many Thanks. :) | |
| 16:24:57 | sean-k-mooney | luyao: sure | |
| 16:25:03 | sean-k-mooney | luyao: o/ | |
| 16:32:20 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Add test coverage of existing flavor_manage policies https://review.opendev.org/714814 | |
| 16:53:31 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Reproduce bug 1869050 https://review.opendev.org/714997 | |
| 16:53:32 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Update scheduler instance info at confirm resize https://review.opendev.org/714998 | |
| 16:53:32 | openstack | bug 1869050 in OpenStack Compute (nova) "migration of anti-affinity server fails due to stale scheduler instance info" [Low,Triaged] https://launchpad.net/bugs/1869050 - Assigned to Balazs Gibizer (balazs-gibizer) | |
| 16:56:37 | hrw | https://review.opendev.org/#/c/709494 - can someone take a look so aarch64 will be a bit better in nova? | |
| 16:58:09 | openstackgerrit | John Garbutt proposed openstack/nova master: Tell oslo.limit how to count nova resources https://review.opendev.org/713301 | |
| 16:58:09 | openstackgerrit | John Garbutt proposed openstack/nova master: Update quota sets APIs https://review.opendev.org/712749 | |
| 17:06:53 | melwitt | kashyap: would you mind revisiting the aarch64 patch, it's been updated ^ | |
| 17:09:32 | openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP libvirt: Break up get_disk_mapping within blockinfo https://review.opendev.org/714962 | |
| 17:12:05 | sean-k-mooney | alex_xu: dansmith gibi so just did a evacuate test with the cyborg fake driver. http://paste.openstack.org/show/791153/ | |
| 17:12:06 | openstackgerrit | Stephen Finucane proposed openstack/nova master: libvirt: Add typing information https://review.opendev.org/714695 | |
| 17:12:06 | openstackgerrit | Stephen Finucane proposed openstack/nova master: hardware: Update and correct typing information https://review.opendev.org/714694 | |
| 17:12:07 | openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: Replace 'cpu_pinning_requested' helper https://review.opendev.org/714697 | |
| 17:12:07 | openstackgerrit | Stephen Finucane proposed openstack/nova master: tests: Split instance NUMA object tests https://review.opendev.org/714696 | |
| 17:12:08 | openstackgerrit | Stephen Finucane proposed openstack/nova master: hardware: Remove handling of pre-Train compute nodes https://review.opendev.org/714699 | |
| 17:12:08 | openstackgerrit | Stephen Finucane proposed openstack/nova master: hardware: Don't consider overhead CPUs for unpinned instances https://review.opendev.org/714698 | |
| 17:12:09 | openstackgerrit | Stephen Finucane proposed openstack/nova master: hardware: Tweak the 'cpu_realtime_mask' handling slightly https://review.opendev.org/461456 | |
| 17:12:09 | openstackgerrit | Stephen Finucane proposed openstack/nova master: hardware: Add validation for 'cpu_realtime_mask' https://review.opendev.org/468203 | |
| 17:12:10 | openstackgerrit | Stephen Finucane proposed openstack/nova master: hardware: Invert order of NUMA topology generation https://review.opendev.org/714701 | |
| 17:12:10 | openstackgerrit | Stephen Finucane proposed openstack/nova master: hardware: Rework 'get_realtime_constraint' https://review.opendev.org/714700 | |
| 17:12:49 | sean-k-mooney | alex_xu: dansmith gibi we can evacuate but it does not create allocation for the fpga | |
| 17:15:03 | sean-k-mooney | the arqs are also not updated http://paste.openstack.org/show/791154/ | |
| 17:15:34 | sean-k-mooney | ill update the block operation patch review with that info but currently we cannot evacuate properly. | |
| 17:16:08 | lyarwood | stephenfin: https://review.opendev.org/#/c/696834/ - not sure if you're still here but this should be ready now. | |
| 17:18:50 | stephenfin | lyarwood: done | |
| 17:19:30 | lyarwood | stephenfin: thanks | |
| 17:20:44 | openstackgerrit | John Garbutt proposed openstack/nova master: WIP: Enforce resource limits using oslo.limit https://review.opendev.org/615180 | |
| 17:21:46 | openstackgerrit | John Garbutt proposed openstack/nova master: Prevent compute manager freeze when greenpool is full https://review.opendev.org/575034 | |
| 17:27:24 | openstackgerrit | melanie witt proposed openstack/nova stable/train: Add config option for neutron client retries https://review.opendev.org/715010 | |
| 17:30:15 | openstackgerrit | John Garbutt proposed openstack/nova master: Prevent compute manager freeze when greenpool is full https://review.opendev.org/575034 | |
| 17:31:54 | melwitt | lyarwood: I dunno if you saw my comment on this one https://review.opendev.org/708030 IIUC this is an option you're thinking to keep indefinitely, if so, it shouldn't go under [workarounds] as they're things intended to be temporary and removed | |
| 17:44:03 | kashyap | melwitt: Hiya; will look at the AArch64 thing tom. in the AM. (Aside: just to keep you posted, I'm off from tomm. evening until 31) | |
| 17:44:15 | kashyap | (s/31/31st-Mar/) | |
| 17:45:57 | kashyap | Actually, looking now | |
| 17:46:24 | melwitt | cool thanks! | |
| 17:47:03 | kashyap | melwitt: Okay, they went with the upstream QEMU AArch64 recomm. of model 'max'. Cool | |
| 17:52:09 | openstackgerrit | John Garbutt proposed openstack/nova master: WIP: Enforce resource limits using oslo.limit https://review.opendev.org/615180 | |
| 18:05:08 | kashyap | stephenfin: melwitt: The release note contains a lot of not useful info, which will only confuse: https://review.opendev.org/#/c/709494/20 | |
| 18:05:22 | kashyap | stephenfin: melwitt: I suggested whittling it down to a couple of sentences. Hope that looks okay | |
| 18:06:07 | stephenfin | kashyap: yeah, I was iffy on that too but figured it was good enough. Now that there's two of us... | |
| 18:06:13 | kashyap | Maybe whoever is merging it can amend it? If it's not urgent, perhaps Kevin could respoin | |
| 18:06:51 | kashyap | stephenfin: Hehe, much of it is verbatim from a review comment I made; looks odd to have "stream of consciounsess" as a release note ;-) | |
| 18:07:55 | kashyap | Err, I myself made a grammar error; /me goes to fix | |
| 18:09:22 | kashyap | Alright; /me goes to make some dinner | |
| 18:57:49 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Add test coverage of existing hypervisors policies https://review.opendev.org/715029 | |
| 19:10:23 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Introduce scope_types in os-hypervisors https://review.opendev.org/715036 | |
| 19:14:31 | lyarwood | melwitt: yeah sorry was working my way down to these changes this week | |
| 19:14:36 | melwitt | dansmith: are you aware that in a vanilla devstack with one cell, we are getting [workarounds]disable_group_policy_check_upcall = True ? this is new to me | |
| 19:14:56 | lyarwood | melwitt: I'll respin and/or update in the morning. | |
| 19:14:59 | mriedem | it's intentional because of superconductor mode | |
| 19:15:02 | mriedem | melwitt: ^ | |
| 19:15:13 | dansmith | yeah, what mriedem said | |
| 19:15:14 | mriedem | otherwise affinity tests will below up | |
| 19:15:28 | dansmith | so people either have to disable affinity or enable that workaround | |
| 19:15:29 | mriedem | there are a few things disabled by default like that in devstack | |
| 19:15:31 | melwitt | lyarwood: ok, np at all. just wanted to make sure in case you didn't see | |
| 19:15:33 | dansmith | because we still don't have affinity in placement | |
| 19:16:14 | mriedem | https://docs.openstack.org/nova/latest/user/cellsv2-layout.html#operations-requiring-upcalls | |
| 19:16:40 | mriedem | anything not marked complete in that list probably has some kind of flag to disable it in devstack | |
| 19:17:31 | mriedem | and we don't test cross_az_attach=false in the gate anywhere so...that just flies under the radar | |
| 19:17:35 | melwitt | mriedem, dansmith: thanks. yeah, I see that the logic is based on whether we have a superconductor going or not. just trying to work out whether we want or if there's way to set it False if we know everything's on the same MQ. context, we got a regression reported https://bugs.launchpad.net/nova/+bug/1863190 that's looking not like a regression since I saw [workarounds]disable_group_policy_check_upcall = True in the config | |
| 19:17:36 | openstack | Launchpad bug 1863190 in OpenStack Compute (nova) "Server group anti-affinity no longer works" [Undecided,New] | |
| 19:18:26 | mriedem | i think there is at least one known latent multi-cell bug with how (anti-)affinity works, but i'm fuzzy on the details | |
| 19:18:28 | melwitt | two parallel anti-affinity requests seeming to violate policy in the single MQ deployment | |
| 19:18:33 | mriedem | if you don't have multiple cells then i guess that doesn't apply | |
| 19:19:01 | mriedem | if you have single cell and are support anti-affinity then you need the late check enabled in the compute | |
| 19:19:02 | melwitt | yeah if you are multi MQ then you can't get anti-affinity if the requests hit at the same time | |
| 19:19:11 | melwitt | right | |
| 19:19:37 | mriedem | [workarounds]disable_group_policy_check_upcall = True means you're opting into the wildness | |
| 19:19:43 | melwitt | I was just thinking you'd think our default devstack with one MQ should set it False | |
| 19:19:50 | mriedem | it's false by default | |
| 19:20:12 | melwitt | it is, but something in the default devstack logic is setting it True | |
| 19:20:32 | melwitt | that is, I cloned the devstack repo and brought up a vanilla devstack and I'm getting it set to True | |
| 19:20:34 | mriedem | yeah, because superconductor is the default mode | |
| 19:20:51 | mriedem | superconductor is the ideal mode for deploying nova, so we test in the gate with that by default | |
| 19:21:11 | melwitt | yeah. and I'm thinking this sort of "bug" will keep being reported occasionally bc people not realizing what devstack is doing | |
| 19:21:32 | mriedem | it's a known limitation, link them to the docs | |
| 19:22:02 | mriedem | tempest has (anti)affinity tests as well but i don't think they make parallel requests | |