Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2021-01-22
15:10:23 melwitt elod: oh, good. ah, it hadn't had its zuul result yet at the time I reviewed. ok, all makes sense now :)
15:10:35 stephenfin gibi: I have the code done and the change is small, but it's also probably not important enough to warrant a spec freeze exception
15:10:51 gibi stephenfin: let's merge it today
15:10:55 gibi lyarwood: ^^
15:11:45 spatel sean-k-mooney: thank for you comments - https://bugs.launchpad.net/nova/+bug/1912273
15:11:46 openstack Launchpad bug 1912273 in OpenStack Compute (nova) "SRIOV instance Error: Exception during message handling: KeyError: 'pci_slot'" [Undecided,Incomplete]
15:12:01 lyarwood gibi: ack, just on a call now, I'll review once this is over
15:12:14 gibi thanks
15:12:37 elod melwitt: the 'zuul summary' maybe a bit misleading as it shows the last runs, but does not show that a new test is running
15:12:46 spatel This is what i have noticed, when my vm get oom and stuck/hung then openstack destroying its all configuration from box (is that normal behavior?)
15:13:44 melwitt elod: yeah, I'm not sure what I did to miss it. might have just been pebkac :P
15:14:19 elod :)
15:14:41 elod anyway, it's fixed now, so we'll see :)
15:15:04 melwitt ++
15:20:16 openstackgerrit Merged openstack/nova master: libvirt: Stop NVMe and ScaleIO unit tests from calling os-brick https://review.opendev.org/c/openstack/nova/+/771806
15:34:14 openstackgerrit Merged openstack/nova master: libvirt: Load and cache volume drivers on-demand https://review.opendev.org/c/openstack/nova/+/741545
15:36:27 openstackgerrit Merged openstack/nova stable/queens: sync_guest_time: use the proper errno https://review.opendev.org/c/openstack/nova/+/742423
15:36:49 openstackgerrit Merged openstack/nova stable/queens: libvirt: Remove reference to transient domain when detaching devices https://review.opendev.org/c/openstack/nova/+/608186
15:37:37 openstackgerrit Merged openstack/nova stable/rocky: [stable-only] Cap bandit and make lower-constraints job non-voting https://review.opendev.org/c/openstack/nova/+/766492
15:45:56 zigo In Debian Unstable/Testing, I'm getting this for absolutely everything that connects to rabbit: http://paste.openstack.org/show/801876/
15:46:02 zigo Does anyone know what's going on ?
15:56:30 frickler zigo: looks like this one to me https://bugs.launchpad.net/oslo.messaging/+bug/1902696
15:56:32 openstack Launchpad bug 1902696 in oslo.messaging "nova-compute fails with Unhandled error: TypeError: _wrap_socket_sni() got an unexpected keyword argument 'ca_certs'" [Undecided,New]
15:57:38 zigo frickler: Thanks !
15:58:38 lyarwood stephenfin: looking at that spec now btw
15:59:19 sean-k-mooney mnaser: hi o/ do you have time for a qq
16:00:32 sean-k-mooney mnaser: we are talking about nova db archives downstream
16:00:59 sean-k-mooney mnaser: we were just wondering how often you run them at vexhost and with what parmaters
16:01:45 sean-k-mooney mnaser: also if you have the openstck ci cluster tuned differently the the rest of the public cloud
16:08:40 lyarwood artom / bauzas: https://review.opendev.org/c/openstack/nova-specs/+/770842 - you're listed on this review, do you want to give it a look before we +W it?
16:09:23 lyarwood stephenfin: ^ LGTM btw, but I'll give others a chance to also look before we merge
16:11:12 openstackgerrit Merged openstack/nova stable/queens: libvirt: Handle VIR_ERR_DEVICE_MISSING when detaching devices https://review.opendev.org/c/openstack/nova/+/742424
16:13:10 artom lyarwood, stephenfin, as I've just posted in the spec, we should also make OS-EXT-SRV-ATTR:hostname not admin-only by default then, right?
16:13:14 artom Since users can now set it?
16:13:40 artom Not sure I want to -1 over that this close to the deadline...
16:13:57 stephenfin Fair point. I can do a follow-up
16:14:49 lyarwood ooooff nice catch yeah
16:15:16 lyarwood that's a new microversion at that point right?
16:15:26 stephenfin this is already a new microversion
16:15:39 artom Yeah, it already is, just add the visibility thing to it
16:15:40 lyarwood stephenfin: ah true sorry
16:16:16 lyarwood brb kid just got home
16:16:35 artom By herself? o_O
16:23:38 gibi zigo, frickler: I think this is related https://review.opendev.org/c/openstack/requirements/+/761194
16:24:23 zigo AttributeError: 'Semaphore' object has no attribute '_at_fork_reinit'
16:24:23 zigo gibi: I've bumped to 5.0.3, this fixes my issues, but now I'm getting:
16:24:36 gibi :/
16:24:36 zigo which looks like a problem with Eventlet + Python 3.9... :(
16:24:56 zigo https://github.com/eventlet/eventlet/issues/646
16:25:41 gibi zigo: does eventlet officially states that it supports py3.9?
16:26:00 lyarwood artom: yeah we send them down the mines at ~6 months old around here /s
16:26:03 zigo gibi: I don't know, but Bullseye will be released with it (no py3.8 at all).
16:26:21 zigo This looks like fixing it, I'll try: https://github.com/eventlet/eventlet/pull/664/commits/087f2246ef5380cc5d519f614be7e928ab5ea025
16:27:06 zigo Debian has already 18 patches in the Eventlet package.
16:27:33 zigo Half a decade ago, there was some discussions to get rid of Eventlet in OpenStack. I'd love to have this effort started some day !
16:27:46 zigo Eventlet is a Bi... (pardon my language).
16:28:23 openstackgerrit Merged openstack/nova-specs master: Add spec for configurable-instance-hostnames https://review.opendev.org/c/openstack/nova-specs/+/770842
16:28:27 zigo Oh, we got that one already ... :/
16:29:47 gibi stephenfin: https://review.opendev.org/c/openstack/nova-specs/+/770842 will you push a followup fixing artom's comments?
16:29:59 stephenfin on it
16:30:44 gibi stephenfin: also I dont find the related bp in launchpad
16:30:45 openstackgerrit Lance Bragstad proposed openstack/placement master: Refactor usage tests to properly test project personas https://review.opendev.org/c/openstack/placement/+/772061
16:30:47 lbragstad stephenfin ^ that fixes the tests you modified to expose usage in placement to project users
16:33:06 stephenfin lbragstad: oh, the project_id was different /o\
16:33:38 stephenfin I even wrote a quick unit test that proved it worked, but I figured the unit test was wrong because the functional test was obviously correct /o\
16:33:55 lbragstad stephenfin right - so the tenancy check was doing what it should
16:34:07 lbragstad but i found something else that's concerning and i'm not sure how it's working now
16:34:33 lbragstad stephenfin https://review.opendev.org/c/openstack/placement/+/772061/1/placement/tests/functional/gabbits/usage-secure-rbac.yaml
16:35:04 lbragstad i added negative tests to ensure project users from anther project can't fetch usage information for projects they don't have authorization on
16:35:52 stephenfin Oh, I noticed that when I was debugging the rule
16:35:59 lbragstad and the project admin persona test fails consistently because the rule:admin_api rule is appended to the new default, regardless of what we're setting up in fixture
16:36:53 lbragstad i went splunking through the enforce_new_default configuration behavior and it appears to be working as expected
16:37:28 stephenfin Hmm, I'm guessing misconfiguration _somewhere_. We have a lot of examples of project reader policies in nova and I'm pretty sure we have unit tests for them all that prove that other project admins can't access $RESOURCE
16:37:34 lbragstad but that deprecated rule check get appended to the default rule magically
16:38:08 lbragstad yeah... i started looking at the placement fixture structure to see if it was doing something unexpected (not cleaning things up properly)?
16:38:16 stephenfin gibi: There's the BP https://blueprints.launchpad.net/nova/+spec/configurable-instance-hostnames
16:38:35 gibi stephenfin: on it
16:38:58 lbragstad but i couldn't find anything that stuck out - and i'm not that knowledgeable about gabbi/placement tests
16:39:31 lbragstad so - i pushed what i have based on your patch... but if you pull that down you should be able to recreate the issue, it'll fail the check gate
16:39:43 stephenfin Neither am I. They're tough to debug. I can't figure out how to even get logs from the placement server
16:40:08 stephenfin I'll have to poke cdent or efried when they're about, to see if they have any suggestions
16:40:08 lbragstad downgrade gabbi
16:41:05 efried Howdy. TLDR or should I read scrollback?
16:41:35 lbragstad if you're using gabbi > 2.0.0 the output logging is broken
16:41:37 lbragstad https://github.com/cdent/gabbi/issues/287
16:41:54 stephenfin lbragstad++ Well that makes my life much easier
16:42:02 zigo gibi: I just looked, Eventlet claims compat with ... python 3.7 ! :/
16:42:17 lbragstad stephenfin downgrading to 1.49.0 works for me
16:42:33 lbragstad in the sense that you can actually capture stdout in tests
16:42:48 gibi zigo: based on that we cannot even release OpenStack :/
16:43:01 zigo Yeah...
16:43:10 zigo Or I stay forever on Buster...
16:43:11 stephenfin efried: We're seeing some unusual policy behavior in placement as part of the RBAC work, and I was looking for a way to get more info from the placement server to debug. Sounds like it's just a downgrade of gabbi that's needed ^
16:43:30 efried cool
16:45:43 openstackgerrit Stephen Finucane proposed openstack/nova-specs master: Update spec for configurable-instance-hostnames https://review.opendev.org/c/openstack/nova-specs/+/772065
16:46:03 stephenfin gibi: And there's the spec amendment ^
16:46:13 stephenfin bauzas, lyarwood, artom also ^
16:47:52 gibi stephenfin: thanks
16:50:05 zigo Great, tests.patcher_test.test_fork_after_monkey_patch fails in Py 3.9 ... :/
16:53:48 melwitt lyarwood: I wanted to ask you about a failure in test_volume_swap I saw yesterday in the gate, have you seen a thing where it doesn't finish the copy and emits "COPY block job progress, current cursor: 1073741823 final cursor: 1073741824" a lot of times, showing that the cursor is only 1 from the end?

Earlier   Later