Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2018-04-05
20:18:54 melwitt that's not about a lot of computes, sorry. that's about a lot of instances
20:22:23 eandersson nice
20:22:30 eandersson we are looking at pike at the moment
20:27:43 owalsh melwitt: nope, donno if https://bugs.launchpad.net/nova/+bug/1717915 got resolved. I'd assume it's an oslo.messaging bug
20:27:43 openstack Launchpad bug 1717915 in oslo.messaging "nova services and transport_url, cannot connect to vhost if specified" [Undecided,New]
20:28:04 melwitt owalsh: ack, thanks
20:29:23 owalsh melwitt: actually, I had problems with oslo.messaging the other day where the transport_url handling wasn't right up when some, but not all, of the legacy conf options were set
20:29:54 owalsh not had time to look into it though
20:30:00 efried mriedem, melwitt: tblakes has acked internally and will get on that fup.
20:30:36 melwitt owalsh: by transport_url handling do you mean trying to use both the transport_url config option and the legacy options at the same time? or using only legacy options the resultant transport_url was wrong?
20:31:13 owalsh melwitt: using both transport_url and the legacy options at the same time
20:31:34 owalsh melwitt: I'll mention it on the LP at least
20:31:57 melwitt owalsh: yeah, I'm pretty sure that won't work because one (transport_url) is a superset of the others. like, if transport_url is set, that will be taken and nothing else considered. I'm not 100% sure though
20:32:24 melwitt if it tries to merge them or not
20:32:26 mriedem efried: ok, i hope the requisite amount of gifs were posted on slack during that conversation
20:32:47 efried mriedem: No giphys were harmed in the making of this conversation.
20:32:50 zigo kashyap: Just sent my reply.
20:33:41 owalsh melwitt: that's what I expected, but no. transport_url was correct but nova couldn't connect to rabbitmq. IIRC the legacy conf option for the port was also set but the host options was not
20:34:21 melwitt owalsh: ugh, okay. link me to the LP and I can look later
20:48:58 openstackgerrit Tyler Blakeslee proposed openstack/nova master: Use six.text_type instead of str in NovaException __repr__ https://review.openstack.org/559169
21:00:00 openstackgerrit Matt Riedemann proposed openstack/nova master: Wait for network-vif-plugged before starting live migration https://review.openstack.org/558001
21:00:00 openstackgerrit Matt Riedemann proposed openstack/nova master: Add check if neutron "binding-extended" extension is available https://review.openstack.org/523548
21:00:01 openstackgerrit Matt Riedemann proposed openstack/nova master: Add "bind_ports_to_host" neutron API method https://review.openstack.org/523604
21:00:01 openstackgerrit Matt Riedemann proposed openstack/nova master: Add "delete_port_binding" network API method https://review.openstack.org/552170
21:00:02 openstackgerrit Matt Riedemann proposed openstack/nova master: Add "activate_port_binding" neutron API method https://review.openstack.org/555947
21:00:02 openstackgerrit Matt Riedemann proposed openstack/nova master: Delete port bindings in setup_networks_on_host if teardown=True https://review.openstack.org/556333
21:00:03 openstackgerrit Matt Riedemann proposed openstack/nova master: Implement migrate_instance_start method for neutron https://review.openstack.org/556334
21:00:03 openstackgerrit Matt Riedemann proposed openstack/nova master: Add VIFMigrateData object for live migration https://review.openstack.org/515423
21:00:04 openstackgerrit Matt Riedemann proposed openstack/nova master: WIP: libvirt: use dest host vif migrate details for live migration https://review.openstack.org/551370
21:00:04 openstackgerrit Matt Riedemann proposed openstack/nova master: WIP: compute: use port binding extended API during live migration https://review.openstack.org/551371
21:00:05 openstackgerrit Matt Riedemann proposed openstack/nova master: WIP: Port binding based on events during live migration https://review.openstack.org/434870
21:00:05 openstackgerrit Matt Riedemann proposed openstack/nova master: conductor: use port binding extended API in during live migrate https://review.openstack.org/522537
21:03:16 melwitt owalsh: thanks. I misunderstood you earlier, I thought there was a second LP bug you had opened about the other issue
21:03:36 openstackgerrit Merged openstack/nova master: Make generation optional in ProviderTree https://review.openstack.org/539324
21:04:12 openstackgerrit Tyler Blakeslee proposed openstack/nova master: Use six.text_type instead of str in NovaException __repr__ https://review.openstack.org/559169
21:04:25 owalsh melwitt: ah, yea, not had time to investigate it yet...
21:04:55 melwitt yeah, no worries. just explaining why I said, "link me the LP" because I thought there was a second LP :)
21:05:00 openstackgerrit Matt Riedemann proposed openstack/nova master: DNM: test live_migration_wait_for_vif_plug=True https://review.openstack.org/558006
21:05:39 melwitt you were probably like, "what ... link the same bug you told me about?"
21:06:04 melwitt haha
21:17:35 arvindn05 i am having issues running tox -epep8. Was working fine unti it wasnt...
21:17:54 arvindn05 gettting the error netifaces.c:1:20: fatal error: Python.h: No such file or directory
21:18:04 arvindn05 anyone saw this error before?
21:20:28 melwitt we recently switched it to run with python3 by default
21:20:49 melwitt so maybe you need the python3-dev package, or the like
21:21:47 openstackgerrit Arvind Nadendla proposed openstack/nova master: Update ImageMetaProp object to expose traits https://review.openstack.org/557795
21:24:15 arvindn05 melwitt: thanks...i tried that based on similar recommendation
21:24:18 arvindn05 The following packages have unmet dependencies:
21:24:18 arvindn05 python3-dev : Depends: libpython3-dev (= 3.5.1-3) but it is not going to be installed
21:24:19 arvindn05 Depends: python3.5-dev (>= 3.5.1-2~) but it is not going to be installed
21:24:19 arvindn05 E: Unable to correct problems, you have held broken packages.
21:24:55 arvindn05 unable to install them because it says i have unmet dependencies...i looked for broken packages...but no luck
21:29:01 arvindn05 melwitt: nevermind got it to work. Thanks for the hint
21:29:20 arvindn05 had to use a different package manager aptitude to resolve the dependencies
21:29:45 melwitt k, cool
21:32:56 openstackgerrit Merged openstack/nova master: [placement] Fix incorrect exception import https://review.openstack.org/558916
21:47:43 melwitt looks like limestone hosts still timing out
22:27:53 openstackgerrit Michael Still proposed openstack/nova master: Move xenapi disk resizing to privsep. https://review.openstack.org/552242
22:27:54 openstackgerrit Michael Still proposed openstack/nova master: Sync xenapi and libvirt on what flags to pass e2fsck. https://review.openstack.org/554078
22:27:54 openstackgerrit Michael Still proposed openstack/nova master: Move xenapi partition copies to privsep. https://review.openstack.org/553605
22:27:55 openstackgerrit Michael Still proposed openstack/nova master: Move image conversion to privsep. https://review.openstack.org/554437
22:27:55 openstackgerrit Michael Still proposed openstack/nova master: We don't need utils.trycmd any more. https://review.openstack.org/554439
22:27:56 openstackgerrit Michael Still proposed openstack/nova master: We no longer need rootwrap. https://review.openstack.org/554438
22:31:40 logan- melwitt: would you mind linking me to the job log? im not seeing the fail in logstash. we (limestone) are actively monitoring and fixing the timeouts noticed yesterday and the failure rate has been much lower today.
22:33:44 openstackgerrit Michael Still proposed openstack/nova master: Use a pythonic delete, with a retry. https://review.openstack.org/554793
22:51:55 cfriesen_ eandersson: I was off working other stuff today, didn't see your messages. If you have questions abut numa stuff, feel free to ping me. Just wondering, do you have the NUMATopologyFilter enabled in the "scheduler_default_filters" config option in nova.conf?
23:01:42 openstackgerrit Eric Fried proposed openstack/nova master: WIP: placement: Granular GET /allocation_candidates https://review.openstack.org/517757
23:04:13 mriedem cfriesen_: i think the net is https://bugs.launchpad.net/nova/+bug/1417667/comments/45
23:04:13 openstack Launchpad bug 1417667 in OpenStack Compute (nova) "migration/evacuation/resize/unshelve of instance with NUMA topology needs to recalculate NUMA topology" [Medium,In progress] - Assigned to sahid (sahid-ferdjaoui)
23:04:38 mriedem cfriesen_: ah you replied
23:04:48 mriedem ok, so i think we should probably close that bug
23:08:03 mriedem mikal: fyi, i'm cleaning up https://review.openstack.org/#/c/324720/
23:11:43 eandersson cfriesen_, yea it's enabled
23:15:15 openstackgerrit Arvind Nadendla proposed openstack/nova master: Update ImageMetaProp object to expose traits https://review.openstack.org/557795
23:16:14 openstackgerrit Merged openstack/nova master: Add --enable and --disable options to nova-manage update_cell https://review.openstack.org/555416
23:16:25 openstackgerrit Merged openstack/nova master: Update the cells FAQs and scheduler maintenance docs. https://review.openstack.org/556459
23:16:53 arvindn05 mriedem: added the check to unit test for the image traits review
23:20:37 Spaz-Home Morning folks
23:27:55 openstackgerrit Merged openstack/nova master: update_provider_tree devref and docstring updates https://review.openstack.org/553476
23:30:18 cfriesen_ mriedem: I guess we've got https://bugs.launchpad.net/nova/+bug/1289064 to track the live migration issues, so yeah I'm okay with closing that one.
23:30:18 openstack Launchpad bug 1289064 in OpenStack Compute (nova) "live migration of instance should claim resources on target compute node" [Medium,In progress] - Assigned to sahid (sahid-ferdjaoui)
23:33:42 cfriesen_ eandersson: in that case I'm a bit surprised. Do you see resource claims being made on the destination?
23:52:40 Spaz-Home Interesting.. does it only do those claims if a host is specified?
23:55:30 eandersson cfriesen_, > During the sync_power process the instance has moved from host X to host Y
23:55:36 eandersson Is all I see in the normal logs
23:55:55 cfriesen_ eandersson: mitaka, right?
23:55:58 eandersson yea
23:56:04 eandersson > CPUPinningInvalid: Cannot pin/unpin cpus [1, 21] from the following pinned set [0, 1, 20, 5, 25, 21]
23:57:15 eandersson It's complaning about that after it was moved
#openstack-nova - 2018-04-06
00:00:33 cfriesen_ eandersson: you might try enabling debug logs and redoing the test. I'd expect that on the dest nova-compute rebuild_instance() would call ResourceTracker.rebuild_claim()
00:00:48 cfriesen_ eandersson: that in turn should emit logs like "Attempting claim: ....."
00:02:10 cfriesen_ Spaz-Home: no, it should claim resources for scheduler-chosen destinations as well since even now placement doesn't do cpu pinning, hugepages, etc.
00:02:52 cfriesen_ eandersson: just to be clear, the "Attempting claim" log should come out at "info" level
00:03:45 eandersson Is that in the compute logs?
00:03:54 cfriesen_ eandersson: yes, on the dest node
00:04:42 eandersson I only see three of those, and none from the evacuated nodes
00:05:08 cfriesen_ eandersson: that claim is what calls _test_numa_topology(), which is what handles setting up the CPU pinning for the instance that is being evacuated.
00:06:11 openstackgerrit Michael Still proposed openstack/nova master: Rename network.utils to network.linux_utils. https://review.openstack.org/559197
00:07:33 cfriesen_ eandersson: I'd expect to see the "Attempting claim" log on instance boot as well.
00:09:55 eandersson > Creating Image

Earlier   Later