| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-06-07 | |||
| 01:11:18 | sapd1 | sean-k-mooney, in my case, this is a special requirement :D | |
| 01:11:48 | mnaser | operation queue.declare caused a channel exception not_found: failed to perform operation on queue 'scheduler.ctl2-xxxxxx.vexxhost.cn' in vhost '/nova' due to timeout | |
| 01:11:49 | sean-k-mooney | hehe ok ya that shoudl work. any reaon not to push the extra metadata upstream or is it specifc to your deployment | |
| 01:11:52 | mnaser | that's from the rabbitmq logs | |
| 01:12:09 | mnaser | it means that for some reason, its actually rabbitmq thats not lteting it declare? | |
| 01:12:43 | sean-k-mooney | mnaser: im not sure what it means by channel exception not_found but ill ask google | |
| 01:12:52 | mnaser | yeah im trying to ask google too | |
| 01:12:57 | sapd1 | sean-k-mooney, it's a specific for my deployment :) | |
| 01:13:58 | sean-k-mooney | mnaser: Binding a non-existing queue or a non-existing exchange will fail with a 404 NOT_FOUND error | |
| 01:14:23 | sean-k-mooney | https://www.rabbitmq.com/channels.html | |
| 01:14:47 | mnaser | i wonder if it tries to declare, fails, then binds, and fails, and then bombs out | |
| 01:18:02 | sapd1 | sean-k-mooney, Does my case related this function (https://github.com/openstack/nova/blob/6657339a7393226c72b9c8a293a6b92695ecb4cb/nova/virt/driver.py#L1374)? | |
| 01:18:27 | mnaser | bleh, i've been at this for 2.5h -- i dunno what to do at this point, its a bit too much | |
| 01:19:04 | mnaser | https://github.com/rabbitmq/rabbitmq-server/issues/959 | |
| 01:19:05 | sean-k-mooney | mnaser: i would proably set the quese to durable and enabel auto delete if this is an issue for you on production | |
| 01:19:07 | mnaser | i wonder if this has to do with this | |
| 01:19:20 | sean-k-mooney | at least untill we figure this out more direclty | |
| 01:21:50 | mnaser | yeah ill just work around it for now.. my brain is toast | |
| 01:22:11 | mnaser | and there you go, restarted them all, went into spawning state | |
| 01:22:26 | mnaser | i bet neutron is suffering from teh same thing | |
| 01:22:27 | sean-k-mooney | https://bugs.launchpad.net/oslo.messaging/+bug/1661510 | |
| 01:22:28 | openstack | Launchpad bug 1661510 in oslo.messaging "topic_send may loss messages if the queue not exists" [Medium,In progress] - Assigned to Gabriele Santomaggio (gsantomaggio) | |
| 01:23:11 | openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (20) https://review.opendev.org/576689 | |
| 01:23:28 | openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (21) https://review.opendev.org/576709 | |
| 01:23:40 | sean-k-mooney | mnaser: i think https://bugs.launchpad.net/oslo.messaging/+bug/1661510 is basically the issue right | |
| 01:23:41 | openstack | Launchpad bug 1661510 in oslo.messaging "topic_send may loss messages if the queue not exists" [Medium,In progress] - Assigned to Gabriele Santomaggio (gsantomaggio) | |
| 01:23:41 | openstackgerrit | Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (22) https://review.opendev.org/576712 | |
| 01:27:25 | sean-k-mooney | https://bugs.launchpad.net/oslo.messaging/+bug/1437955 seams to be also related | |
| 01:27:26 | openstack | Launchpad bug 1437955 in oslo.messaging "RPC calls and responses do not use the mandatory flag (AMQP)" [Wishlist,Confirmed] - Assigned to Gabriele Santomaggio (gsantomaggio) | |
| 01:29:24 | mnaser | sean-k-mooney: that seems exactly it | |
| 01:30:47 | sean-k-mooney | mnaser: melwitt so i cuess we want to encourage https://review.opendev.org/#/c/660373/ | |
| 01:45:10 | mnaser | sean-k-mooney: I guess so! | |
| 01:45:50 | sean-k-mooney | the current approch would require nova to be modified to handel the retry whic may or may not be what we want | |
| 01:46:06 | sean-k-mooney | i left some feed back in the review | |
| 01:46:46 | sean-k-mooney | but its shoudl help even if we need to do some extra work as a consumer of oslo.messaging | |
| 01:47:52 | sean-k-mooney | mnaser: i was tired and when to sleep for 4 hours so while its 2 am from me here it must be getting pretty late for you | |
| 01:48:18 | sean-k-mooney | well almost 3 but as i said i alreay got some sleep | |
| 01:54:43 | mnaser | sean-k-mooney: where are you based out of? | |
| 01:54:52 | sean-k-mooney | ireland | |
| 01:55:10 | sean-k-mooney | but i tend to shift my day to overlap with the us more | |
| 01:57:52 | sean-k-mooney | i would normally end my day and go to sleep at aound 1 am but i was tired and went to bed at 8pm today but when i do that i never get more then about 4 hours and then i get up and work for a bit and typically go back to sleep around 3-4 ish | |
| 01:58:11 | sean-k-mooney | or 8-9 ish if my sleeping pattern is totally messed up | |
| 03:28:23 | openstackgerrit | Daniel Speichert proposed openstack/nova-specs master: Directly download and upload images to RBD https://review.opendev.org/658903 | |
| 04:32:17 | openstackgerrit | Eric Fried proposed openstack/nova master: Introduces the openstacksdk to nova https://review.opendev.org/643664 | |
| 04:32:18 | openstackgerrit | Eric Fried proposed openstack/nova master: Use OpenStack SDK for placement https://review.opendev.org/656023 | |
| 07:20:03 | openstackgerrit | Brin Zhang proposed openstack/nova master: WIP:Specify availability_zone to unshelve https://review.opendev.org/663851 | |
| 07:55:27 | kashyap | sean-k-mooney: Yeah, I _did_ see the obscure "vm_mode" yesterday, and reading its documentation. It is a Xen-related term, but used as a general abstraction in Nova to represent any hypervisor | |
| 07:56:11 | kashyap | tonyb: I wanted to do some tests on AArch64 host; got it from another dev. | |
| 07:56:44 | kashyap | efried: No, that "pick guest arch" Blueprint is not for Train. (It's Tech Debt) | |
| 08:39:51 | tonyb[m] | kashyap: okay have fun | |
| 09:50:49 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Fold ComputeManager._resize to its only caller https://review.opendev.org/663873 | |
| 10:23:37 | stephenfin | RuntimeError: On Python 3, zvm sdk supports to Python 3.6 | |
| 10:23:45 | stephenfin | and all I want to do is build docs | |
| 10:24:14 | stephenfin | We need to find some way to move that out of requirements.txt. More hassle than it's worth. | |
| 10:37:33 | openstackgerrit | Stephen Finucane proposed openstack/nova stable/rocky: docs: Don't version links to reno docs https://review.opendev.org/662178 | |
| 10:37:34 | openstackgerrit | Stephen Finucane proposed openstack/nova stable/rocky: tox: Use basepython of python3.5 https://review.opendev.org/663887 | |
| 10:37:34 | openstackgerrit | Stephen Finucane proposed openstack/nova stable/rocky: tox: Stop build *all* docs in 'docs' https://review.opendev.org/663888 | |
| 11:40:18 | sean-k-mooney | just an fyi but i have marked https://blueprints.launchpad.net/nova/+spec/libvirt-neutron-sriov-livemigration as implemented/complete since the documentation update we were waiting for is now merged in neutron. | |
| 11:48:01 | openstackgerrit | Theodoros Tsioutsias proposed openstack/nova-specs master: Enable rebuild for instances in cell0 https://review.opendev.org/648686 | |
| 12:28:57 | openstackgerrit | Merged openstack/nova master: Make nova-next archive using --before https://review.opendev.org/661002 | |
| 12:35:47 | openstackgerrit | Merged openstack/nova master: Update usage in RT.drop_move_claim during confirm resize https://review.opendev.org/641806 | |
| 12:35:56 | openstackgerrit | Merged openstack/nova master: Robustify attachment tracking in CinderFixtureNewAttachFlow https://review.opendev.org/658904 | |
| 12:50:33 | openstackgerrit | Dr. Clemens Hardewig proposed openstack/nova master: Fixes instance resizing/migration when swap volume is on lvm https://review.opendev.org/618621 | |
| 12:50:34 | openstackgerrit | Dr. Clemens Hardewig proposed openstack/nova master: This patch is to fix bug #1831657 https://review.opendev.org/663926 | |
| 12:50:35 | openstack | bug 1831657 in OpenStack Compute (nova) "Instance migration/Instance resize with lvm volumes" [Undecided,New] https://launchpad.net/bugs/1831657 | |
| 12:57:12 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove 'ComputeManager._reschedule' https://review.opendev.org/660774 | |
| 12:57:13 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove cells v1 parameter from 'ComputeTaskAPI.resize_instance' https://review.opendev.org/651311 | |
| 12:57:13 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Stop passing 'kwargs' to 'rebuild_instance' https://review.opendev.org/651312 | |
| 12:57:14 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Stop passing 'delete_type' to 'terminate_instance' https://review.opendev.org/651313 | |
| 12:57:14 | openstackgerrit | Stephen Finucane proposed openstack/nova master: filters: Stop handling cells v1 https://review.opendev.org/651314 | |
| 12:57:15 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove nova.compute.*API() shims https://review.opendev.org/660527 | |
| 12:57:15 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Add reno for removed cells v1 policies https://review.opendev.org/662031 | |
| 12:57:16 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove 'InstanceUnknownCell' exception https://review.opendev.org/662411 | |
| 12:57:16 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Ensure controllers all call super https://review.opendev.org/660950 | |
| 12:58:12 | stephenfin | gibi++ | |
| 12:58:21 | stephenfin | Thanks for taking a look at those tests | |
| 13:28:55 | mriedem | stephenfin: gibi: comments inline on https://review.opendev.org/#/c/660774/ | |
| 13:29:05 | mriedem | for the notification sample test weirdness | |
| 13:29:47 | stephenfin | in a meeting but I'll look after | |
| 13:30:17 | stephenfin | mriedem: Actually, I did try to that. It failed miserably | |
| 13:31:02 | stephenfin | The issue that I pointed out previously is that I want the call to succeed in the other places it's called | |
| 13:31:08 | stephenfin | And just stub out that one caller | |
| 13:31:43 | gibi | stephenfin, mriedem: I can try to iterate on those tests sometime next week | |
| 13:40:33 | mriedem | i can play with it, maybe 3 sets of eyes can sort it out | |
| 13:42:53 | gibi | mriedem: one hint, in those resize sample tests there is only one compute (as far as I see) but still there is a successfull re-schedule attempt | |
| 13:43:40 | mriedem | which is totally unrealistic but ok | |
| 13:44:11 | mriedem | maybe it's not unrealistic i guess, hard to know how this flow really works | |
| 13:44:36 | mriedem | it would be unrealistic to reschedule and land back on the same host | |
| 13:44:43 | sean-k-mooney | gibi: a rescuderl would only work in that case if the retry filter is disabled | |
| 13:45:17 | gibi | mriedem: that two test are totally unrealistic :/ | |
| 13:45:18 | mriedem | we don't go back through the scheduler on a reschedule | |
| 13:45:21 | mriedem | since queens | |
| 13:45:40 | gibi | mriedem: fault injection is hard | |
| 13:45:51 | mriedem | in fact we could probably deprecate the RetryFilter | |
| 13:45:56 | mriedem | i don't think it's ever used anymore | |
| 13:46:05 | mriedem | anyway, bbiab | |
| 13:46:24 | sean-k-mooney | that worth looking into | |
| 13:46:43 | sean-k-mooney | ill file a bug so we dont forget | |
| 13:53:59 | stephenfin | mriedem: Yeah, if you've ideas I'd be happy to hear them. Those tests really aren't good but I'm out of ideas at this point | |
| 14:15:45 | mriedem | i'll tinker | |