| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-09-12 | |||
| 20:55:21 | bauzas | I remind the default ratios : 16.0 for CPU, 1.5 for RAM and 1.0 for disk (well, the latter isn't really fully workable) | |
| 20:55:56 | mwynne | bauzas: The default for newton seems to be 0.0 for RAM | |
| 20:56:16 | openstackgerrit | Dan Smith proposed openstack/nova master: Add nova-manage db command for ironic flavor migrations https://review.openstack.org/501025 | |
| 20:56:44 | dansmith | mriedem: ^ | |
| 20:56:47 | bauzas | mwynne: that's a flag for expressing that you need to define your ratios in the compute nova.conf | |
| 20:56:56 | bauzas | mwynne: but programmatically, it'll respect 1.5 | |
| 20:57:03 | bauzas | (if 0.0 is set by defaultà) | |
| 20:57:56 | mwynne | bauzas: Ok. I've been looking at the number of free huge pages on my compute nodes, and comparing that to what "nova hypervisor-stats" says, and the math doesn't check out. | |
| 20:58:18 | mwynne | I have tons of free pages on my nodes, but that cmd says I have 4 free gb of RAM. Something doesn't seem right there. | |
| 20:58:18 | openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/502700 | |
| 20:58:59 | mwynne | (And yes I'm using a flavor with HP enabled) | |
| 20:59:13 | openstackgerrit | Merged openstack/nova master: Handle keypair not found from metadata server using cells https://review.openstack.org/476122 | |
| 20:59:35 | bauzas | mwynne: sec, you want to use huge pages ? | |
| 20:59:42 | mwynne | yes | |
| 20:59:50 | bauzas | okay, that's a separate thing | |
| 21:00:07 | mwynne | Ah, ok. Sorry.. | |
| 21:00:36 | bauzas | no worries, huge pages in Nova isn't tracked the same way that a regular RAM consumption | |
| 21:01:24 | bauzas | mwynne: https://docs.openstack.org/nova/pike/admin/huge-pages.html is the one I have in mind | |
| 21:02:03 | bauzas | mwynne: have you followed that and modified your flavors by mentioning the mem_page_size for the instance you want to create ? | |
| 21:02:21 | mwynne | yes | |
| 21:02:25 | bauzas | even if that's a Pike doc, the flavor thing is identical in Newton | |
| 21:02:42 | mwynne | Yeah, I've done that. | |
| 21:02:48 | bauzas | mwynne: ok, so you did that, you wanna boot an instance and you end up having NoValidHosts ? | |
| 21:03:09 | openstackgerrit | Merged openstack/nova master: Create allocations against forced dest host during evacuate https://review.openstack.org/499399 | |
| 21:03:19 | mwynne | Insufficient compute resources: Requested instance NUMA topology cannot fit the given host NUMA topology | |
| 21:03:36 | openstackgerrit | Merged openstack/nova master: Add recreate test for evacuate claim failure https://review.openstack.org/499874 | |
| 21:03:42 | bauzas | mwynne: I actually wonder if huge pages supports and ratios can be mixed up | |
| 21:03:53 | mwynne | bauzas: I deleted some unused vms and then I could spawn it. | |
| 21:04:01 | bauzas | in general, people using huge pages are not wanting to have overallocated instances | |
| 21:04:14 | bauzas | so they default ratios to 1.0 | |
| 21:04:44 | bauzas | from what I remember about the huge pages implementation, I know we don't really care of any overallocation | |
| 21:04:57 | bauzas | so I wouldn't be surprised if that wouldn't fit | |
| 21:05:05 | openstackgerrit | Merged openstack/nova master: Add a test to make sure failed evacuate cleans up dest allocation https://review.openstack.org/499877 | |
| 21:05:14 | mwynne | Yeah. I assumed that.. What I want to be able to do is basically this: Use heat to spin up a really big stack, consuming almost all my RAM. When I'm finished with it, just power them all off so I don't have to re-deploy each time. I was hoping that having them powered down meant I could deploy and use other vms until I want to spin them all back up again. | |
| 21:05:37 | openstackgerrit | Merged openstack/nova master: Remove dest node allocation if evacuate MoveClaim fails https://review.openstack.org/499878 | |
| 21:06:10 | melwitt | mwynne: there was a bug around that but the fix was backported to newton https://bugs.launchpad.net/nova/+bug/1635367 | |
| 21:06:11 | openstack | Launchpad bug 1635367 in OpenStack Compute (nova) ocata "Ram filter is broken since Mitaka" [High,In progress] - Assigned to Matt Riedemann (mriedem) | |
| 21:06:48 | melwitt | mwynne: are you using at least version 14.0.8? | |
| 21:06:59 | mwynne | melwitt: how can I check that? | |
| 21:07:57 | mwynne | melwitt: 14.0.7... Nooooooo! haha | |
| 21:08:34 | melwitt | mwynne: okay, hopefully if you pull down 14.0.8 it will fix your problem but I'm not 100% sure that's what's causing what you're seeing with NUMA etc | |
| 21:09:05 | bauzas | melwitt: oh good catch, I forgot it | |
| 21:09:22 | mwynne | What's the best way to update? I'm running RDO packages. | |
| 21:09:42 | bauzas | mwynne: just upgrade your packages if you're on a 14.0.z version already | |
| 21:09:47 | bauzas | and restart your services | |
| 21:10:01 | mwynne | bauzas: Ok. I figured.. Just wasn't sure if that would break stuff :S | |
| 21:10:04 | bauzas | but yeah, I just feel we don't mix up overcommits and huge pages | |
| 21:11:08 | mwynne | bauzas: Ok. I' | |
| 21:11:23 | mwynne | I'll see if updating helps. But I think you might be right about huge pages... | |
| 21:11:34 | mwynne | Thanks for all the help guys. I appreciate it :) | |
| 21:26:40 | efried | mikal FYI, https://review.openstack.org/#/c/503078/ totally doesn't work. I had a feeling... it's the difference, when we hijack the namespace, of putting our code in a new module within an existing package, versus making a new package. | |
| 21:27:14 | efried | mikal I suppose I could try structuring it as nova/virt/powervm/__init__.py <== with the code in (or at least exported from) here. | |
| 21:35:14 | openstackgerrit | Michael Still proposed openstack/nova master: Fix missed chown call https://review.openstack.org/503079 | |
| 21:35:21 | efried | mikal (and esberglu edmondsw) we'll see if this flies: https://review.openstack.org/#/c/503078/ | |
| 21:37:44 | openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/502700 | |
| 21:38:44 | med_ | did you just find that by grep'ing for dangling chowns? | |
| 21:38:51 | med_ | smells that way | |
| 21:40:29 | efried | mikal BTW, why do we have to be in the nova.privsep namespace to make this work? | |
| 21:40:41 | openstackgerrit | OpenStack Proposal Bot proposed openstack/os-vif master: Updated from global requirements https://review.openstack.org/502708 | |
| 21:41:57 | openstackgerrit | Dan Smith proposed openstack/nova master: Add nova-manage db command for ironic flavor migrations https://review.openstack.org/501025 | |
| 21:55:17 | mikal | efried: so privsep has a check for the namespadce of escalated methods, and they _must_ be in nova.privsep | |
| 21:55:30 | mikal | efried: but can't you just drop a single file into that directory as part of your install process? | |
| 21:55:57 | mikal | efried: it stops us accidentally escalating the capabilities of some random method I suppose | |
| 21:56:07 | mikal | efried: but it was an oslo implementation decision two years ago | |
| 21:56:20 | efried | mikal Unless I figure out a way to hijack the namespace, like I'm doing :) | |
| 21:56:27 | efried | mikal As for dropping a file in... | |
| 21:56:32 | efried | That sounds really ew to me. | |
| 21:56:45 | efried | Unprecedented at least in our driver. | |
| 21:56:57 | efried | If it was a conf or something, that'd be different. | |
| 22:04:32 | mikal | So, there's a privsep session in the nova track. We should make sure we dig into this then. | |
| 22:05:45 | mikal | I've explicitly added it to the agenda | |
| 22:12:00 | mriedem | dansmith: +2 on https://review.openstack.org/#/c/501025/ | |
| 22:12:17 | bauzas | I'm confused on triaging https://bugs.launchpad.net/nova/+bug/1716344, help needed | |
| 22:12:18 | openstack | Launchpad bug 1716344 in OpenStack Compute (nova) "Nova-API sometimes uses Keystone's public endpoint" [Undecided,New] | |
| 22:12:40 | bauzas | AFAICU, we get the endpoint URL by calling the service catalog, or if the service catalog is passed with the context | |
| 22:13:21 | bauzas | looks to me the bug is a possible misconfig, but I don't know which specific conf opt gets the endpoint to call for getting the service catalog, or where it gets that specific value | |
| 22:26:19 | bauzas | mriedem: looks to me a known problem, right ? https://bugs.launchpad.net/nova/+bug/1715569 | |
| 22:26:20 | openstack | Launchpad bug 1715569 in OpenStack Compute (nova) "Live migration fails with an attached non-bootable Cinder volume (Pike)" [Undecided,New] | |
| 22:28:29 | bauzas | mdbooth: does the above ^ sound a bell to you ? | |
| 22:29:23 | bauzas | anyway, let's triage it as valid and we'll see | |
| 22:40:17 | gmann | alex_xu: johnthetubaguy stephenfin did you see this, it looks cool now - https://docs.openstack.org/nova/latest/configuration/policy.html | |
| #openstack-nova - 2017-09-13 | |||
| 00:10:25 | openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/502700 | |
| 00:46:34 | takashin | ||
| 01:04:06 | openstackgerrit | Hesam Chobanlou proposed openstack/nova master: Update docs to include standardization of VM diagnostics https://review.openstack.org/500408 | |
| 03:19:46 | openstackgerrit | Ildiko Vancsa proposed openstack/nova master: Add attachment_complete call to volume/cinder.py https://review.openstack.org/493323 | |
| 03:19:47 | openstackgerrit | Ildiko Vancsa proposed openstack/nova master: Tweak connection_info translation for the new Cinder attach/detach API https://review.openstack.org/493324 | |
| 03:19:47 | openstackgerrit | Ildiko Vancsa proposed openstack/nova master: Implement new attach Cinder flow https://review.openstack.org/330285 | |
| 07:15:10 | openstackgerrit | David Rabel proposed openstack/nova master: Choose VMware datastore by the least provisioned space https://review.openstack.org/402632 | |
| 07:38:30 | rtailor | does anybody know why these three tests are failing when running with python testtools | |
| 07:38:35 | rtailor | nova.tests.unit.test_wsgi.TestWSGIServerWithSSL.test_two_servers | |
| 07:38:35 | rtailor | nova.tests.unit.test_wsgi.TestWSGIServerWithSSL.test_ssl_server nova.tests.unit.test_wsgi.TestWSGIServerWithSSL.test_app_using_ipv6_and_ssl | |
| 07:38:48 | rtailor | when I try to run it using this command. | |
| 07:38:51 | rtailor | python -m testtools.run nova.tests.unit.test_wsgi | |
| 07:44:02 | rtailor | These tests are failing with below error. | |
| 07:44:05 | rtailor | requests.exceptions.SSLError: HTTPSConnectionPool(host='127.0.0.1', port=35030): Max retries exceeded with url: / (Caused by SSLError(CertificateError("hostname '127.0.0.1' doesn't match either of 'localhost', 'ip6-localhost'",),)) | |
| 07:46:54 | rtailor | alex_xu, ^^ | |
| 07:47:15 | rtailor | I suspect this is because of urllib3 library. | |
| 08:02:28 | rtailor | openstack-nova, ^^ | |
| 08:46:42 | openstackgerrit | sahid proposed openstack/nova master: libvirt: configure trust mode for vfs https://review.openstack.org/458514 | |
| 08:46:43 | openstackgerrit | sahid proposed openstack/nova master: network: update pci request spec to handle trusted tags https://review.openstack.org/458820 | |