| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-04-05 | |||
| 20:17:10 | mriedem | well, depends - placement is more meant to solve the lots of computes issue | |
| 20:17:31 | mriedem | doing filtering in sql queries rather than post-db query python filters in memory | |
| 20:17:53 | mriedem | and doing resource claims in the scheduler rather than racing to claim in the computes, hitting conflicts and rescheduling | |
| 20:18:08 | mriedem | you'll need to be at least at pike to do claims via placement in the scheduler | |
| 20:18:24 | mriedem | and pike for mult-cell | |
| 20:18:39 | melwitt | that reminds me, I was looking at this yesterday. need to check on something in the scheduler https://bugs.launchpad.net/nova/+bug/1737465 | |
| 20:18:39 | openstack | Launchpad bug 1737465 in OpenStack Compute (nova) "[cellv2] the performance issue of cellv2 when creating 500 instances concurrently" [Undecided,New] - Assigned to Surya Seetharaman (tssurya) | |
| 20:18:54 | melwitt | that's not about a lot of computes, sorry. that's about a lot of instances | |
| 20:22:23 | eandersson | nice | |
| 20:22:30 | eandersson | we are looking at pike at the moment | |
| 20:27:43 | owalsh | melwitt: nope, donno if https://bugs.launchpad.net/nova/+bug/1717915 got resolved. I'd assume it's an oslo.messaging bug | |
| 20:27:43 | openstack | Launchpad bug 1717915 in oslo.messaging "nova services and transport_url, cannot connect to vhost if specified" [Undecided,New] | |
| 20:28:04 | melwitt | owalsh: ack, thanks | |
| 20:29:23 | owalsh | melwitt: actually, I had problems with oslo.messaging the other day where the transport_url handling wasn't right up when some, but not all, of the legacy conf options were set | |
| 20:29:54 | owalsh | not had time to look into it though | |
| 20:30:00 | efried | mriedem, melwitt: tblakes has acked internally and will get on that fup. | |
| 20:30:36 | melwitt | owalsh: by transport_url handling do you mean trying to use both the transport_url config option and the legacy options at the same time? or using only legacy options the resultant transport_url was wrong? | |
| 20:31:13 | owalsh | melwitt: using both transport_url and the legacy options at the same time | |
| 20:31:34 | owalsh | melwitt: I'll mention it on the LP at least | |
| 20:31:57 | melwitt | owalsh: yeah, I'm pretty sure that won't work because one (transport_url) is a superset of the others. like, if transport_url is set, that will be taken and nothing else considered. I'm not 100% sure though | |
| 20:32:24 | melwitt | if it tries to merge them or not | |
| 20:32:26 | mriedem | efried: ok, i hope the requisite amount of gifs were posted on slack during that conversation | |
| 20:32:47 | efried | mriedem: No giphys were harmed in the making of this conversation. | |
| 20:32:50 | zigo | kashyap: Just sent my reply. | |
| 20:33:41 | owalsh | melwitt: that's what I expected, but no. transport_url was correct but nova couldn't connect to rabbitmq. IIRC the legacy conf option for the port was also set but the host options was not | |
| 20:34:21 | melwitt | owalsh: ugh, okay. link me to the LP and I can look later | |
| 20:48:58 | openstackgerrit | Tyler Blakeslee proposed openstack/nova master: Use six.text_type instead of str in NovaException __repr__ https://review.openstack.org/559169 | |
| 21:00:00 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Wait for network-vif-plugged before starting live migration https://review.openstack.org/558001 | |
| 21:00:00 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add check if neutron "binding-extended" extension is available https://review.openstack.org/523548 | |
| 21:00:01 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add "bind_ports_to_host" neutron API method https://review.openstack.org/523604 | |
| 21:00:01 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add "delete_port_binding" network API method https://review.openstack.org/552170 | |
| 21:00:02 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add "activate_port_binding" neutron API method https://review.openstack.org/555947 | |
| 21:00:02 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Delete port bindings in setup_networks_on_host if teardown=True https://review.openstack.org/556333 | |
| 21:00:03 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Implement migrate_instance_start method for neutron https://review.openstack.org/556334 | |
| 21:00:03 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add VIFMigrateData object for live migration https://review.openstack.org/515423 | |
| 21:00:04 | openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: libvirt: use dest host vif migrate details for live migration https://review.openstack.org/551370 | |
| 21:00:04 | openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: compute: use port binding extended API during live migration https://review.openstack.org/551371 | |
| 21:00:05 | openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Port binding based on events during live migration https://review.openstack.org/434870 | |
| 21:00:05 | openstackgerrit | Matt Riedemann proposed openstack/nova master: conductor: use port binding extended API in during live migrate https://review.openstack.org/522537 | |
| 21:03:16 | melwitt | owalsh: thanks. I misunderstood you earlier, I thought there was a second LP bug you had opened about the other issue | |
| 21:03:36 | openstackgerrit | Merged openstack/nova master: Make generation optional in ProviderTree https://review.openstack.org/539324 | |
| 21:04:12 | openstackgerrit | Tyler Blakeslee proposed openstack/nova master: Use six.text_type instead of str in NovaException __repr__ https://review.openstack.org/559169 | |
| 21:04:25 | owalsh | melwitt: ah, yea, not had time to investigate it yet... | |
| 21:04:55 | melwitt | yeah, no worries. just explaining why I said, "link me the LP" because I thought there was a second LP :) | |
| 21:05:00 | openstackgerrit | Matt Riedemann proposed openstack/nova master: DNM: test live_migration_wait_for_vif_plug=True https://review.openstack.org/558006 | |
| 21:05:39 | melwitt | you were probably like, "what ... link the same bug you told me about?" | |
| 21:06:04 | melwitt | haha | |
| 21:17:35 | arvindn05 | i am having issues running tox -epep8. Was working fine unti it wasnt... | |
| 21:17:54 | arvindn05 | gettting the error netifaces.c:1:20: fatal error: Python.h: No such file or directory | |
| 21:18:04 | arvindn05 | anyone saw this error before? | |
| 21:20:28 | melwitt | we recently switched it to run with python3 by default | |
| 21:20:49 | melwitt | so maybe you need the python3-dev package, or the like | |
| 21:21:47 | openstackgerrit | Arvind Nadendla proposed openstack/nova master: Update ImageMetaProp object to expose traits https://review.openstack.org/557795 | |
| 21:24:15 | arvindn05 | melwitt: thanks...i tried that based on similar recommendation | |
| 21:24:18 | arvindn05 | The following packages have unmet dependencies: | |
| 21:24:18 | arvindn05 | python3-dev : Depends: libpython3-dev (= 3.5.1-3) but it is not going to be installed | |
| 21:24:19 | arvindn05 | Depends: python3.5-dev (>= 3.5.1-2~) but it is not going to be installed | |
| 21:24:19 | arvindn05 | E: Unable to correct problems, you have held broken packages. | |
| 21:24:55 | arvindn05 | unable to install them because it says i have unmet dependencies...i looked for broken packages...but no luck | |
| 21:29:01 | arvindn05 | melwitt: nevermind got it to work. Thanks for the hint | |
| 21:29:20 | arvindn05 | had to use a different package manager aptitude to resolve the dependencies | |
| 21:29:45 | melwitt | k, cool | |
| 21:32:56 | openstackgerrit | Merged openstack/nova master: [placement] Fix incorrect exception import https://review.openstack.org/558916 | |
| 21:47:43 | melwitt | looks like limestone hosts still timing out | |
| 22:27:53 | openstackgerrit | Michael Still proposed openstack/nova master: Move xenapi disk resizing to privsep. https://review.openstack.org/552242 | |
| 22:27:54 | openstackgerrit | Michael Still proposed openstack/nova master: Sync xenapi and libvirt on what flags to pass e2fsck. https://review.openstack.org/554078 | |
| 22:27:54 | openstackgerrit | Michael Still proposed openstack/nova master: Move xenapi partition copies to privsep. https://review.openstack.org/553605 | |
| 22:27:55 | openstackgerrit | Michael Still proposed openstack/nova master: Move image conversion to privsep. https://review.openstack.org/554437 | |
| 22:27:55 | openstackgerrit | Michael Still proposed openstack/nova master: We don't need utils.trycmd any more. https://review.openstack.org/554439 | |
| 22:27:56 | openstackgerrit | Michael Still proposed openstack/nova master: We no longer need rootwrap. https://review.openstack.org/554438 | |
| 22:31:40 | logan- | melwitt: would you mind linking me to the job log? im not seeing the fail in logstash. we (limestone) are actively monitoring and fixing the timeouts noticed yesterday and the failure rate has been much lower today. | |
| 22:33:44 | openstackgerrit | Michael Still proposed openstack/nova master: Use a pythonic delete, with a retry. https://review.openstack.org/554793 | |
| 22:51:55 | cfriesen_ | eandersson: I was off working other stuff today, didn't see your messages. If you have questions abut numa stuff, feel free to ping me. Just wondering, do you have the NUMATopologyFilter enabled in the "scheduler_default_filters" config option in nova.conf? | |
| 23:01:42 | openstackgerrit | Eric Fried proposed openstack/nova master: WIP: placement: Granular GET /allocation_candidates https://review.openstack.org/517757 | |
| 23:04:13 | mriedem | cfriesen_: i think the net is https://bugs.launchpad.net/nova/+bug/1417667/comments/45 | |
| 23:04:13 | openstack | Launchpad bug 1417667 in OpenStack Compute (nova) "migration/evacuation/resize/unshelve of instance with NUMA topology needs to recalculate NUMA topology" [Medium,In progress] - Assigned to sahid (sahid-ferdjaoui) | |
| 23:04:38 | mriedem | cfriesen_: ah you replied | |
| 23:04:48 | mriedem | ok, so i think we should probably close that bug | |
| 23:08:03 | mriedem | mikal: fyi, i'm cleaning up https://review.openstack.org/#/c/324720/ | |
| 23:11:43 | eandersson | cfriesen_, yea it's enabled | |
| 23:15:15 | openstackgerrit | Arvind Nadendla proposed openstack/nova master: Update ImageMetaProp object to expose traits https://review.openstack.org/557795 | |
| 23:16:14 | openstackgerrit | Merged openstack/nova master: Add --enable and --disable options to nova-manage update_cell https://review.openstack.org/555416 | |
| 23:16:25 | openstackgerrit | Merged openstack/nova master: Update the cells FAQs and scheduler maintenance docs. https://review.openstack.org/556459 | |
| 23:16:53 | arvindn05 | mriedem: added the check to unit test for the image traits review | |
| 23:20:37 | Spaz-Home | Morning folks | |
| 23:27:55 | openstackgerrit | Merged openstack/nova master: update_provider_tree devref and docstring updates https://review.openstack.org/553476 | |
| 23:30:18 | cfriesen_ | mriedem: I guess we've got https://bugs.launchpad.net/nova/+bug/1289064 to track the live migration issues, so yeah I'm okay with closing that one. | |
| 23:30:18 | openstack | Launchpad bug 1289064 in OpenStack Compute (nova) "live migration of instance should claim resources on target compute node" [Medium,In progress] - Assigned to sahid (sahid-ferdjaoui) | |
| 23:33:42 | cfriesen_ | eandersson: in that case I'm a bit surprised. Do you see resource claims being made on the destination? | |
| 23:52:40 | Spaz-Home | Interesting.. does it only do those claims if a host is specified? | |
| 23:55:30 | eandersson | cfriesen_, > During the sync_power process the instance has moved from host X to host Y | |
| 23:55:36 | eandersson | Is all I see in the normal logs | |
| 23:55:55 | cfriesen_ | eandersson: mitaka, right? | |
| 23:55:58 | eandersson | yea | |
| 23:56:04 | eandersson | > CPUPinningInvalid: Cannot pin/unpin cpus [1, 21] from the following pinned set [0, 1, 20, 5, 25, 21] | |
| 23:57:15 | eandersson | It's complaning about that after it was moved | |
| #openstack-nova - 2018-04-06 | |||
| 00:00:33 | cfriesen_ | eandersson: you might try enabling debug logs and redoing the test. I'd expect that on the dest nova-compute rebuild_instance() would call ResourceTracker.rebuild_claim() | |
| 00:00:48 | cfriesen_ | eandersson: that in turn should emit logs like "Attempting claim: ....." | |
| 00:02:10 | cfriesen_ | Spaz-Home: no, it should claim resources for scheduler-chosen destinations as well since even now placement doesn't do cpu pinning, hugepages, etc. | |
| 00:02:52 | cfriesen_ | eandersson: just to be clear, the "Attempting claim" log should come out at "info" level | |