Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2019-06-07
01:11:52 mnaser that's from the rabbitmq logs
01:12:09 mnaser it means that for some reason, its actually rabbitmq thats not lteting it declare?
01:12:43 sean-k-mooney mnaser: im not sure what it means by channel exception not_found but ill ask google
01:12:52 mnaser yeah im trying to ask google too
01:12:57 sapd1 sean-k-mooney, it's a specific for my deployment :)
01:13:58 sean-k-mooney mnaser: Binding a non-existing queue or a non-existing exchange will fail with a 404 NOT_FOUND error
01:14:23 sean-k-mooney https://www.rabbitmq.com/channels.html
01:14:47 mnaser i wonder if it tries to declare, fails, then binds, and fails, and then bombs out
01:18:02 sapd1 sean-k-mooney, Does my case related this function (https://github.com/openstack/nova/blob/6657339a7393226c72b9c8a293a6b92695ecb4cb/nova/virt/driver.py#L1374)?
01:18:27 mnaser bleh, i've been at this for 2.5h -- i dunno what to do at this point, its a bit too much
01:19:04 mnaser https://github.com/rabbitmq/rabbitmq-server/issues/959
01:19:05 sean-k-mooney mnaser: i would proably set the quese to durable and enabel auto delete if this is an issue for you on production
01:19:07 mnaser i wonder if this has to do with this
01:19:20 sean-k-mooney at least untill we figure this out more direclty
01:21:50 mnaser yeah ill just work around it for now.. my brain is toast
01:22:11 mnaser and there you go, restarted them all, went into spawning state
01:22:26 mnaser i bet neutron is suffering from teh same thing
01:22:27 sean-k-mooney https://bugs.launchpad.net/oslo.messaging/+bug/1661510
01:22:28 openstack Launchpad bug 1661510 in oslo.messaging "topic_send may loss messages if the queue not exists" [Medium,In progress] - Assigned to Gabriele Santomaggio (gsantomaggio)
01:23:11 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (20) https://review.opendev.org/576689
01:23:28 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (21) https://review.opendev.org/576709
01:23:40 sean-k-mooney mnaser: i think https://bugs.launchpad.net/oslo.messaging/+bug/1661510 is basically the issue right
01:23:41 openstack Launchpad bug 1661510 in oslo.messaging "topic_send may loss messages if the queue not exists" [Medium,In progress] - Assigned to Gabriele Santomaggio (gsantomaggio)
01:23:41 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (22) https://review.opendev.org/576712
01:27:25 sean-k-mooney https://bugs.launchpad.net/oslo.messaging/+bug/1437955 seams to be also related
01:27:26 openstack Launchpad bug 1437955 in oslo.messaging "RPC calls and responses do not use the mandatory flag (AMQP)" [Wishlist,Confirmed] - Assigned to Gabriele Santomaggio (gsantomaggio)
01:29:24 mnaser sean-k-mooney: that seems exactly it
01:30:47 sean-k-mooney mnaser: melwitt so i cuess we want to encourage https://review.opendev.org/#/c/660373/
01:45:10 mnaser sean-k-mooney: I guess so!
01:45:50 sean-k-mooney the current approch would require nova to be modified to handel the retry whic may or may not be what we want
01:46:06 sean-k-mooney i left some feed back in the review
01:46:46 sean-k-mooney but its shoudl help even if we need to do some extra work as a consumer of oslo.messaging
01:47:52 sean-k-mooney mnaser: i was tired and when to sleep for 4 hours so while its 2 am from me here it must be getting pretty late for you
01:48:18 sean-k-mooney well almost 3 but as i said i alreay got some sleep
01:54:43 mnaser sean-k-mooney: where are you based out of?
01:54:52 sean-k-mooney ireland
01:55:10 sean-k-mooney but i tend to shift my day to overlap with the us more
01:57:52 sean-k-mooney i would normally end my day and go to sleep at aound 1 am but i was tired and went to bed at 8pm today but when i do that i never get more then about 4 hours and then i get up and work for a bit and typically go back to sleep around 3-4 ish
01:58:11 sean-k-mooney or 8-9 ish if my sleeping pattern is totally messed up
03:28:23 openstackgerrit Daniel Speichert proposed openstack/nova-specs master: Directly download and upload images to RBD https://review.opendev.org/658903
04:32:17 openstackgerrit Eric Fried proposed openstack/nova master: Introduces the openstacksdk to nova https://review.opendev.org/643664
04:32:18 openstackgerrit Eric Fried proposed openstack/nova master: Use OpenStack SDK for placement https://review.opendev.org/656023
07:20:03 openstackgerrit Brin Zhang proposed openstack/nova master: WIP:Specify availability_zone to unshelve https://review.opendev.org/663851
07:55:27 kashyap sean-k-mooney: Yeah, I _did_ see the obscure "vm_mode" yesterday, and reading its documentation. It is a Xen-related term, but used as a general abstraction in Nova to represent any hypervisor
07:56:11 kashyap tonyb: I wanted to do some tests on AArch64 host; got it from another dev.
07:56:44 kashyap efried: No, that "pick guest arch" Blueprint is not for Train. (It's Tech Debt)
08:39:51 tonyb[m] kashyap: okay have fun
09:50:49 openstackgerrit Balazs Gibizer proposed openstack/nova master: Fold ComputeManager._resize to its only caller https://review.opendev.org/663873
10:23:37 stephenfin RuntimeError: On Python 3, zvm sdk supports to Python 3.6
10:23:45 stephenfin and all I want to do is build docs
10:24:14 stephenfin We need to find some way to move that out of requirements.txt. More hassle than it's worth.
10:37:33 openstackgerrit Stephen Finucane proposed openstack/nova stable/rocky: docs: Don't version links to reno docs https://review.opendev.org/662178
10:37:34 openstackgerrit Stephen Finucane proposed openstack/nova stable/rocky: tox: Use basepython of python3.5 https://review.opendev.org/663887
10:37:34 openstackgerrit Stephen Finucane proposed openstack/nova stable/rocky: tox: Stop build *all* docs in 'docs' https://review.opendev.org/663888
11:40:18 sean-k-mooney just an fyi but i have marked https://blueprints.launchpad.net/nova/+spec/libvirt-neutron-sriov-livemigration as implemented/complete since the documentation update we were waiting for is now merged in neutron.
11:48:01 openstackgerrit Theodoros Tsioutsias proposed openstack/nova-specs master: Enable rebuild for instances in cell0 https://review.opendev.org/648686
12:28:57 openstackgerrit Merged openstack/nova master: Make nova-next archive using --before https://review.opendev.org/661002
12:35:47 openstackgerrit Merged openstack/nova master: Update usage in RT.drop_move_claim during confirm resize https://review.opendev.org/641806
12:35:56 openstackgerrit Merged openstack/nova master: Robustify attachment tracking in CinderFixtureNewAttachFlow https://review.opendev.org/658904
12:50:33 openstackgerrit Dr. Clemens Hardewig proposed openstack/nova master: Fixes instance resizing/migration when swap volume is on lvm https://review.opendev.org/618621
12:50:34 openstackgerrit Dr. Clemens Hardewig proposed openstack/nova master: This patch is to fix bug #1831657 https://review.opendev.org/663926
12:50:35 openstack bug 1831657 in OpenStack Compute (nova) "Instance migration/Instance resize with lvm volumes" [Undecided,New] https://launchpad.net/bugs/1831657
12:57:12 openstackgerrit Stephen Finucane proposed openstack/nova master: Remove 'ComputeManager._reschedule' https://review.opendev.org/660774
12:57:13 openstackgerrit Stephen Finucane proposed openstack/nova master: Remove cells v1 parameter from 'ComputeTaskAPI.resize_instance' https://review.opendev.org/651311
12:57:13 openstackgerrit Stephen Finucane proposed openstack/nova master: Stop passing 'kwargs' to 'rebuild_instance' https://review.opendev.org/651312
12:57:14 openstackgerrit Stephen Finucane proposed openstack/nova master: Stop passing 'delete_type' to 'terminate_instance' https://review.opendev.org/651313
12:57:14 openstackgerrit Stephen Finucane proposed openstack/nova master: filters: Stop handling cells v1 https://review.opendev.org/651314
12:57:15 openstackgerrit Stephen Finucane proposed openstack/nova master: Remove nova.compute.*API() shims https://review.opendev.org/660527
12:57:15 openstackgerrit Stephen Finucane proposed openstack/nova master: Add reno for removed cells v1 policies https://review.opendev.org/662031
12:57:16 openstackgerrit Stephen Finucane proposed openstack/nova master: Remove 'InstanceUnknownCell' exception https://review.opendev.org/662411
12:57:16 openstackgerrit Stephen Finucane proposed openstack/nova master: Ensure controllers all call super https://review.opendev.org/660950
12:58:12 stephenfin gibi++
12:58:21 stephenfin Thanks for taking a look at those tests
13:28:55 mriedem stephenfin: gibi: comments inline on https://review.opendev.org/#/c/660774/
13:29:05 mriedem for the notification sample test weirdness
13:29:47 stephenfin in a meeting but I'll look after
13:30:17 stephenfin mriedem: Actually, I did try to that. It failed miserably
13:31:02 stephenfin The issue that I pointed out previously is that I want the call to succeed in the other places it's called
13:31:08 stephenfin And just stub out that one caller
13:31:43 gibi stephenfin, mriedem: I can try to iterate on those tests sometime next week
13:40:33 mriedem i can play with it, maybe 3 sets of eyes can sort it out
13:42:53 gibi mriedem: one hint, in those resize sample tests there is only one compute (as far as I see) but still there is a successfull re-schedule attempt
13:43:40 mriedem which is totally unrealistic but ok
13:44:11 mriedem maybe it's not unrealistic i guess, hard to know how this flow really works
13:44:36 mriedem it would be unrealistic to reschedule and land back on the same host
13:44:43 sean-k-mooney gibi: a rescuderl would only work in that case if the retry filter is disabled
13:45:17 gibi mriedem: that two test are totally unrealistic :/
13:45:18 mriedem we don't go back through the scheduler on a reschedule
13:45:21 mriedem since queens
13:45:40 gibi mriedem: fault injection is hard
13:45:51 mriedem in fact we could probably deprecate the RetryFilter
13:45:56 mriedem i don't think it's ever used anymore
13:46:05 mriedem anyway, bbiab
13:46:24 sean-k-mooney that worth looking into
13:46:43 sean-k-mooney ill file a bug so we dont forget
13:53:59 stephenfin mriedem: Yeah, if you've ideas I'd be happy to hear them. Those tests really aren't good but I'm out of ideas at this point
14:15:45 mriedem i'll tinker
14:21:39 openstackgerrit Matt Riedemann proposed openstack/nova master: WIP: Deprecate RetryFilter https://review.opendev.org/663953
14:21:40 mriedem sean-k-mooney: let's see what blows up ^
14:21:48 mriedem edleafe: ^

Earlier   Later