| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-04-05 | |||
| 20:12:19 | efried | mriedem: Hum, that totally wouldn't help here, huh? | |
| 20:12:26 | mriedem | efried: no | |
| 20:12:31 | eandersson | they are conflicting with vms that already were on the compute | |
| 20:12:44 | mriedem | eandersson: hmm | |
| 20:12:59 | mriedem | eandersson: the evac should fail then shouldn't it? | |
| 20:13:04 | mriedem | if the resources are already taken by other VMs on that host | |
| 20:13:21 | eandersson | Yea - I just don't think it knows that it is conflicting | |
| 20:13:38 | eandersson | because it's technically not "invalid" to pin two vms on the same cores | |
| 20:14:15 | mriedem | what is valid or not with the numa stuff at this level is over my head, and would require the likes of cfriesen_, stephenfin, jaypipes, et al | |
| 20:14:31 | eandersson | Yea - hoenstly I bet this is fixed in newer versions | |
| 20:14:36 | eandersson | We just need to upgrade | |
| 20:14:53 | mriedem | hopefully you're not too heavily forked | |
| 20:14:59 | eandersson | nah - it's more cells etc | |
| 20:15:14 | mriedem | upgrading to cells v2 never hurt *anybody* | |
| 20:15:18 | eandersson | it's a big jump, or feels like one at least :D | |
| 20:15:37 | melwitt | yeah. no one has ever complained about it | |
| 20:15:55 | eandersson | How does nova perform now with... a lot of computes? | |
| 20:15:57 | mriedem | if you haven't read up yet, https://docs.openstack.org/nova/latest/user/cells.html - https://docs.openstack.org/nova/latest/user/cellsv2-layout.html - | |
| 20:16:24 | mriedem | there are some summit videos here if you don't like reading https://docs.openstack.org/nova/latest/user/cells.html#cells-v2 | |
| 20:16:27 | mriedem | to prime that pump | |
| 20:17:10 | mriedem | well, depends - placement is more meant to solve the lots of computes issue | |
| 20:17:31 | mriedem | doing filtering in sql queries rather than post-db query python filters in memory | |
| 20:17:53 | mriedem | and doing resource claims in the scheduler rather than racing to claim in the computes, hitting conflicts and rescheduling | |
| 20:18:08 | mriedem | you'll need to be at least at pike to do claims via placement in the scheduler | |
| 20:18:24 | mriedem | and pike for mult-cell | |
| 20:18:39 | melwitt | that reminds me, I was looking at this yesterday. need to check on something in the scheduler https://bugs.launchpad.net/nova/+bug/1737465 | |
| 20:18:39 | openstack | Launchpad bug 1737465 in OpenStack Compute (nova) "[cellv2] the performance issue of cellv2 when creating 500 instances concurrently" [Undecided,New] - Assigned to Surya Seetharaman (tssurya) | |
| 20:18:54 | melwitt | that's not about a lot of computes, sorry. that's about a lot of instances | |
| 20:22:23 | eandersson | nice | |
| 20:22:30 | eandersson | we are looking at pike at the moment | |
| 20:27:43 | owalsh | melwitt: nope, donno if https://bugs.launchpad.net/nova/+bug/1717915 got resolved. I'd assume it's an oslo.messaging bug | |
| 20:27:43 | openstack | Launchpad bug 1717915 in oslo.messaging "nova services and transport_url, cannot connect to vhost if specified" [Undecided,New] | |
| 20:28:04 | melwitt | owalsh: ack, thanks | |
| 20:29:23 | owalsh | melwitt: actually, I had problems with oslo.messaging the other day where the transport_url handling wasn't right up when some, but not all, of the legacy conf options were set | |
| 20:29:54 | owalsh | not had time to look into it though | |
| 20:30:00 | efried | mriedem, melwitt: tblakes has acked internally and will get on that fup. | |
| 20:30:36 | melwitt | owalsh: by transport_url handling do you mean trying to use both the transport_url config option and the legacy options at the same time? or using only legacy options the resultant transport_url was wrong? | |
| 20:31:13 | owalsh | melwitt: using both transport_url and the legacy options at the same time | |
| 20:31:34 | owalsh | melwitt: I'll mention it on the LP at least | |
| 20:31:57 | melwitt | owalsh: yeah, I'm pretty sure that won't work because one (transport_url) is a superset of the others. like, if transport_url is set, that will be taken and nothing else considered. I'm not 100% sure though | |
| 20:32:24 | melwitt | if it tries to merge them or not | |
| 20:32:26 | mriedem | efried: ok, i hope the requisite amount of gifs were posted on slack during that conversation | |
| 20:32:47 | efried | mriedem: No giphys were harmed in the making of this conversation. | |
| 20:32:50 | zigo | kashyap: Just sent my reply. | |
| 20:33:41 | owalsh | melwitt: that's what I expected, but no. transport_url was correct but nova couldn't connect to rabbitmq. IIRC the legacy conf option for the port was also set but the host options was not | |
| 20:34:21 | melwitt | owalsh: ugh, okay. link me to the LP and I can look later | |
| 20:48:58 | openstackgerrit | Tyler Blakeslee proposed openstack/nova master: Use six.text_type instead of str in NovaException __repr__ https://review.openstack.org/559169 | |
| 21:00:00 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Wait for network-vif-plugged before starting live migration https://review.openstack.org/558001 | |
| 21:00:00 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add check if neutron "binding-extended" extension is available https://review.openstack.org/523548 | |
| 21:00:01 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add "bind_ports_to_host" neutron API method https://review.openstack.org/523604 | |
| 21:00:01 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add "delete_port_binding" network API method https://review.openstack.org/552170 | |
| 21:00:02 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add "activate_port_binding" neutron API method https://review.openstack.org/555947 | |
| 21:00:02 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Delete port bindings in setup_networks_on_host if teardown=True https://review.openstack.org/556333 | |
| 21:00:03 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Implement migrate_instance_start method for neutron https://review.openstack.org/556334 | |
| 21:00:03 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add VIFMigrateData object for live migration https://review.openstack.org/515423 | |
| 21:00:04 | openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: libvirt: use dest host vif migrate details for live migration https://review.openstack.org/551370 | |
| 21:00:04 | openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: compute: use port binding extended API during live migration https://review.openstack.org/551371 | |
| 21:00:05 | openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Port binding based on events during live migration https://review.openstack.org/434870 | |
| 21:00:05 | openstackgerrit | Matt Riedemann proposed openstack/nova master: conductor: use port binding extended API in during live migrate https://review.openstack.org/522537 | |
| 21:03:16 | melwitt | owalsh: thanks. I misunderstood you earlier, I thought there was a second LP bug you had opened about the other issue | |
| 21:03:36 | openstackgerrit | Merged openstack/nova master: Make generation optional in ProviderTree https://review.openstack.org/539324 | |
| 21:04:12 | openstackgerrit | Tyler Blakeslee proposed openstack/nova master: Use six.text_type instead of str in NovaException __repr__ https://review.openstack.org/559169 | |
| 21:04:25 | owalsh | melwitt: ah, yea, not had time to investigate it yet... | |
| 21:04:55 | melwitt | yeah, no worries. just explaining why I said, "link me the LP" because I thought there was a second LP :) | |
| 21:05:00 | openstackgerrit | Matt Riedemann proposed openstack/nova master: DNM: test live_migration_wait_for_vif_plug=True https://review.openstack.org/558006 | |
| 21:05:39 | melwitt | you were probably like, "what ... link the same bug you told me about?" | |
| 21:06:04 | melwitt | haha | |
| 21:17:35 | arvindn05 | i am having issues running tox -epep8. Was working fine unti it wasnt... | |
| 21:17:54 | arvindn05 | gettting the error netifaces.c:1:20: fatal error: Python.h: No such file or directory | |
| 21:18:04 | arvindn05 | anyone saw this error before? | |
| 21:20:28 | melwitt | we recently switched it to run with python3 by default | |
| 21:20:49 | melwitt | so maybe you need the python3-dev package, or the like | |
| 21:21:47 | openstackgerrit | Arvind Nadendla proposed openstack/nova master: Update ImageMetaProp object to expose traits https://review.openstack.org/557795 | |
| 21:24:15 | arvindn05 | melwitt: thanks...i tried that based on similar recommendation | |
| 21:24:18 | arvindn05 | The following packages have unmet dependencies: | |
| 21:24:18 | arvindn05 | python3-dev : Depends: libpython3-dev (= 3.5.1-3) but it is not going to be installed | |
| 21:24:19 | arvindn05 | Depends: python3.5-dev (>= 3.5.1-2~) but it is not going to be installed | |
| 21:24:19 | arvindn05 | E: Unable to correct problems, you have held broken packages. | |
| 21:24:55 | arvindn05 | unable to install them because it says i have unmet dependencies...i looked for broken packages...but no luck | |
| 21:29:01 | arvindn05 | melwitt: nevermind got it to work. Thanks for the hint | |
| 21:29:20 | arvindn05 | had to use a different package manager aptitude to resolve the dependencies | |
| 21:29:45 | melwitt | k, cool | |
| 21:32:56 | openstackgerrit | Merged openstack/nova master: [placement] Fix incorrect exception import https://review.openstack.org/558916 | |
| 21:47:43 | melwitt | looks like limestone hosts still timing out | |
| 22:27:53 | openstackgerrit | Michael Still proposed openstack/nova master: Move xenapi disk resizing to privsep. https://review.openstack.org/552242 | |
| 22:27:54 | openstackgerrit | Michael Still proposed openstack/nova master: Sync xenapi and libvirt on what flags to pass e2fsck. https://review.openstack.org/554078 | |
| 22:27:54 | openstackgerrit | Michael Still proposed openstack/nova master: Move xenapi partition copies to privsep. https://review.openstack.org/553605 | |
| 22:27:55 | openstackgerrit | Michael Still proposed openstack/nova master: Move image conversion to privsep. https://review.openstack.org/554437 | |
| 22:27:55 | openstackgerrit | Michael Still proposed openstack/nova master: We don't need utils.trycmd any more. https://review.openstack.org/554439 | |
| 22:27:56 | openstackgerrit | Michael Still proposed openstack/nova master: We no longer need rootwrap. https://review.openstack.org/554438 | |
| 22:31:40 | logan- | melwitt: would you mind linking me to the job log? im not seeing the fail in logstash. we (limestone) are actively monitoring and fixing the timeouts noticed yesterday and the failure rate has been much lower today. | |
| 22:33:44 | openstackgerrit | Michael Still proposed openstack/nova master: Use a pythonic delete, with a retry. https://review.openstack.org/554793 | |
| 22:51:55 | cfriesen_ | eandersson: I was off working other stuff today, didn't see your messages. If you have questions abut numa stuff, feel free to ping me. Just wondering, do you have the NUMATopologyFilter enabled in the "scheduler_default_filters" config option in nova.conf? | |
| 23:01:42 | openstackgerrit | Eric Fried proposed openstack/nova master: WIP: placement: Granular GET /allocation_candidates https://review.openstack.org/517757 | |
| 23:04:13 | mriedem | cfriesen_: i think the net is https://bugs.launchpad.net/nova/+bug/1417667/comments/45 | |
| 23:04:13 | openstack | Launchpad bug 1417667 in OpenStack Compute (nova) "migration/evacuation/resize/unshelve of instance with NUMA topology needs to recalculate NUMA topology" [Medium,In progress] - Assigned to sahid (sahid-ferdjaoui) | |
| 23:04:38 | mriedem | cfriesen_: ah you replied | |
| 23:04:48 | mriedem | ok, so i think we should probably close that bug | |
| 23:08:03 | mriedem | mikal: fyi, i'm cleaning up https://review.openstack.org/#/c/324720/ | |
| 23:11:43 | eandersson | cfriesen_, yea it's enabled | |