Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2019-07-05
19:19:40 Nick_A re: numa - we're using openstack-ansible defaults, not sure
19:21:14 Nick_A I got that from https://docs.openstack.org/arch-design/design-compute/design-compute-overcommit.html
19:21:29 dansmith no, I'm just saying there's no specific 32g limit. nova's overcommit is for landing multiple instances on a node, however ill-advised
19:21:47 openstackgerrit Matt Riedemann proposed openstack/nova master: Remove old TODO about forced_host policy check https://review.opendev.org/669474
19:22:08 dansmith a single instance larger than physical memory is silly, so yeah, no support for it
19:22:41 Nick_A right, but there is a limit based on the physical RAM preventing a single instance from being allocated above that amount. I'm curious why it allows multiple instances to do so but not a single one.
19:23:50 dansmith it allows it because it was designed that way for earlier cloud providers that did it for cost scale, but it's never a good idea for performance, obviously, as you're just using host disk for the overage
19:24:13 dansmith a single instance that is larger than the host doesn't make sense, you might as well run a smaller guest and let it do its own swapping
19:25:10 dansmith anyway, if you're doing cpu pinning you might be running up against something that requires page pinning which is getting you to the "cannot allocate memory" thing
19:25:18 dansmith I doubt it's a kernel/qemu bug
19:25:36 dansmith best bet would be to ask around monday morning when more of the folks that are familiar with that stuff are around
19:25:42 Nick_A thank you
19:25:43 dansmith sean, sfinucan, etc
19:43:47 openstackgerrit Corey Bryant proposed openstack/os-resource-classes master: Add Python 3 Train unit tests https://review.opendev.org/669479
19:44:20 openstackgerrit Corey Bryant proposed openstack/os-traits master: Add Python 3 Train unit tests https://review.opendev.org/669480
20:15:16 mriedem bauzas: how is your audit command coming? it's been a couple of weeks and this came up in the ML today http://lists.openstack.org/pipermail/openstack-discuss/2019-July/007534.html
20:35:08 openstackgerrit Matt Riedemann proposed openstack/nova master: Remove Newton-era min compute checks for server create with device tags https://review.opendev.org/669523
20:37:36 mriedem dansmith: is https://review.opendev.org/#/c/667177/ just waiting for my eye-ball diff and if we're good, fix the thing you noted and then we can move forward?
20:37:48 dansmith mriedem: yeah
21:16:46 mriedem ok comments in there now
21:17:24 mriedem also - https://review.opendev.org/#/c/668631/ - it's a good thing we didn't do the interface change in the same patch...
21:31:24 openstackgerrit Matt Riedemann proposed openstack/nova stable/pike: Init HostState.failed_builds https://review.opendev.org/669538
21:37:55 openstackgerrit Matt Riedemann proposed openstack/nova master: Remove Rocky-era min compute trusted certs compat check https://review.opendev.org/669539
22:02:18 sean-k-mooney Nick_A: im not sure if this is the issue but i do not belive we allow vms to oversubsribe resouces against itself.
22:02:41 sean-k-mooney in placment the max_unit for MEMORY_MB should be set to the total capasity of the host
22:03:10 sean-k-mooney so we will not allow vms that request more ram then the host has to be schduled to a node
22:03:19 sean-k-mooney the same is true from ram and disk
22:03:54 sean-k-mooney i havent read the full scrollback but that is the first limitation that came to mind
22:05:09 sean-k-mooney reading back
22:05:22 sean-k-mooney we reserve 512MB of ram for the host by default
22:08:04 openstackgerrit Matt Riedemann proposed openstack/nova master: Add negative test for cross-cell finish_resize failing https://review.opendev.org/643451
22:08:04 openstackgerrit Matt Riedemann proposed openstack/nova master: Refresh instance in MigrationTask.execute Exception handler https://review.opendev.org/669012
22:08:05 openstackgerrit Matt Riedemann proposed openstack/nova master: Add negative test for prep_snapshot_based_resize_at_source failing https://review.opendev.org/669013
22:08:05 openstackgerrit Matt Riedemann proposed openstack/nova master: WIP: Add confirm_snapshot_based_resize_at_source https://review.opendev.org/637058
22:08:06 openstackgerrit Matt Riedemann proposed openstack/nova master: WIP: Add ConfirmResizeTask https://review.opendev.org/637070
22:08:06 openstackgerrit Matt Riedemann proposed openstack/nova master: Add confirm_snapshot_based_resize conductor RPC method https://review.opendev.org/637075
22:08:07 openstackgerrit Matt Riedemann proposed openstack/nova master: Confirm cross-cell resize from the API https://review.opendev.org/637316
22:08:07 openstackgerrit Matt Riedemann proposed openstack/nova master: WIP: Add revert_snapshot_based_resize_at_dest compute method https://review.opendev.org/637630
22:08:08 openstackgerrit Matt Riedemann proposed openstack/nova master: Deal with cross-cell resize in _remove_deleted_instances_allocations https://review.opendev.org/639453
22:08:08 openstackgerrit Matt Riedemann proposed openstack/nova master: WIP: Add finish_revert_snapshot_based_resize_at_source compute method https://review.opendev.org/637647
22:08:09 openstackgerrit Matt Riedemann proposed openstack/nova master: WIP: Add RevertResizeTask https://review.opendev.org/638046
22:08:09 openstackgerrit Matt Riedemann proposed openstack/nova master: Add revert_snapshot_based_resize conductor RPC method https://review.opendev.org/638047
22:08:10 openstackgerrit Matt Riedemann proposed openstack/nova master: Revert cross-cell resize from the API https://review.opendev.org/638048
22:08:10 openstackgerrit Matt Riedemann proposed openstack/nova master: Confirm cross-cell resize while deleting a server https://review.opendev.org/638268
22:08:11 openstackgerrit Matt Riedemann proposed openstack/nova master: Add archive_deleted_rows wrinkle to cross-cell functional test https://review.opendev.org/651650
22:08:11 openstackgerrit Matt Riedemann proposed openstack/nova master: Add CrossCellWeigher https://review.opendev.org/614353
22:08:12 openstackgerrit Matt Riedemann proposed openstack/nova master: Add functional test for anti-affinity cross-cell migration https://review.opendev.org/661859
22:08:12 openstackgerrit Matt Riedemann proposed openstack/nova master: Support cross-cell moves in external_instance_event https://review.opendev.org/658478
22:10:32 Nick_A sean-k-mooney thanks
22:11:53 sean-k-mooney i would have to think about it some more but im guessing you are hiting one of the limit we have to make sure a single vm does not exceed the total amount of one of the resouce we have on the host
22:30:06 Nick_A yeah that's clearly why 32768 wasn't working. We were just surprised it had a limit of that sort when the RAM allocated to multiple smaller instances could still cross that threshold.
22:36:17 sean-k-mooney i think the qemu error is proably a similar similar safte check
22:37:25 sean-k-mooney the os and qemu both need some ram to work properly. so there is some overhad per host that should not be allocated to a guest unless you have enough swap space
22:37:42 sean-k-mooney but even then i generally do not recommend ram over commit at all
22:38:40 sean-k-mooney it causes more issues the in sovles as the kernel OOM killer will reap the vms first if it need to allocate memory and it can swap the vm memory to make room
22:54:08 openstackgerrit Merged openstack/nova master: libvirt: Remove MIN_LIBVIRT_PERF_VERSION https://review.opendev.org/669128
23:00:14 openstackgerrit Merged openstack/nova master: libvirt: vif: Remove MIN_LIBVIRT_MACVTAP_PASSTHROUGH_VLAN https://review.opendev.org/669176
#openstack-nova - 2019-07-06
07:33:33 openstackgerrit garyk proposed openstack/nova master: Nova compute: add in log eception to help debug failures https://review.opendev.org/669545
#openstack-nova - 2019-07-07
00:05:16 spatel sean-k-mooney: can you take a look here https://bugs.launchpad.net/nova/+bug/1835637
00:05:16 openstack Launchpad bug 1835637 in OpenStack Compute (nova) "(404) NOT_FOUND - failed to perform operation on queue 'notifications.info' in vhost '/nova' due to timeout" [Undecided,New]
00:57:46 openstackgerrit Merged openstack/nova master: Set COMPUTE_STATUS_DISABLED trait from update_provider_tree flow https://review.opendev.org/668565
16:31:53 openstackgerrit Ghanshyam Mann proposed openstack/nova master: Add test coverage of existing os-agents policies https://review.opendev.org/669578
22:05:59 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (13) https://review.opendev.org/576020
22:06:11 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (14) https://review.opendev.org/576027
22:06:25 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (15) https://review.opendev.org/576031
22:06:43 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (16) https://review.opendev.org/576299
22:06:59 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (17) https://review.opendev.org/576344
22:07:17 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (18) https://review.opendev.org/576673
22:07:34 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (19) https://review.opendev.org/576676
22:07:52 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (20) https://review.opendev.org/576689
22:08:10 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (21) https://review.opendev.org/576709
22:08:30 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/network/test_neutronv2.py (22) https://review.opendev.org/576712
22:08:51 openstackgerrit Takashi NATSUME proposed openstack/nova master: Fix cleaning up console tokens https://review.opendev.org/637716
#openstack-nova - 2019-07-08
00:39:20 openstackgerrit Sundar Nadathur proposed openstack/nova master: ksa auth conf and client for cyborg access https://review.opendev.org/631242
00:39:21 openstackgerrit Sundar Nadathur proposed openstack/nova master: WIP: Add Cyborg device profile groups to request spec. https://review.opendev.org/631243
00:39:21 openstackgerrit Sundar Nadathur proposed openstack/nova master: WIP: Create and bind Cyborg ARQs. https://review.opendev.org/631244
00:39:22 openstackgerrit Sundar Nadathur proposed openstack/nova master: WIP: Get resolved Cyborg ARQs and add PCI BDFs to VM's domain XML. https://review.opendev.org/631245
02:35:09 openstackgerrit Yongli He proposed openstack/nova master: clean up orphan instances https://review.opendev.org/627765
03:28:50 openstackgerrit Boxiang Zhu proposed openstack/nova master: Support agile samples name https://review.opendev.org/669591
03:33:53 openstackgerrit Sundar Nadathur proposed openstack/nova master: ksa auth conf and client for cyborg access https://review.opendev.org/631242
03:33:54 openstackgerrit Sundar Nadathur proposed openstack/nova master: WIP: Add Cyborg device profile groups to request spec. https://review.opendev.org/631243
03:33:54 openstackgerrit Sundar Nadathur proposed openstack/nova master: WIP: Create and bind Cyborg ARQs. https://review.opendev.org/631244
03:33:55 openstackgerrit Sundar Nadathur proposed openstack/nova master: WIP: Get resolved Cyborg ARQs and add PCI BDFs to VM's domain XML. https://review.opendev.org/631245
03:43:28 prometheanfire I'm guessing volumes showing up as attached in nova but not cinder (and not actually being attached) is a nova problem?
03:43:34 prometheanfire can't 'remove volume' it No volume with a name or ID of '3e92f9b6-1a3b-4a7e-8487-6ff253e888db' exists.
03:50:11 prometheanfire problem starts when attaching it, times out with a 504 :|
04:22:03 openstackgerrit Takashi NATSUME proposed openstack/python-novaclient master: Deprecate cells v1 and extension commands and APIs https://review.opendev.org/669597
06:16:30 openstackgerrit Arthur Dayne proposed openstack/nova-specs master: Proposal for a safer noVNC console with password authentication https://review.opendev.org/623120
06:45:02 openstackgerrit Merged openstack/nova master: Clean up test_virtapi https://review.opendev.org/667419
07:20:44 openstackgerrit wangwei1 proposed openstack/nova master: fix spelling error in nova/api/validation/__init__.py https://review.opendev.org/669244
07:22:06 openstackgerrit Boxiang Zhu proposed openstack/nova master: Add host and hypervisor_hostname flag to create server https://review.opendev.org/645520
08:41:22 openstackgerrit Merged openstack/nova master: Add VirtAPI.update_compute_provider_status https://review.opendev.org/668706
09:51:20 openstackgerrit Brin Zhang proposed openstack/nova master: Specify availability_zone to unshelve https://review.opendev.org/663851
09:57:49 openstackgerrit Miguel Ángel Herranz Trillo proposed openstack/nova stable/queens: Fix type error on call to mount device https://review.opendev.org/669629
10:16:06 moshele @sean-k-mooney: hi
10:37:25 gokhani hi team, because of power outage, Most of our compute nodes unexpectedly shut down and now I can not start our instances. Instances Power status is No State. Error log is http://paste.openstack.org/show/754107/. My environment is OpenStack Pike and Instances are on a nfs shared storage. Nova version is 16.1.6.dev2. There are more important instances on my environment. How can I rescue my istances? What would you suggest ?
11:19:25 openstackgerrit Ivaylo Mitev proposed openstack/nova master: VMware VMDK detach: get adapter type from instance VM https://review.opendev.org/653738
11:56:19 openstackgerrit Merged openstack/nova master: Correct the comment of RequestSpec's network_metadata https://review.opendev.org/667061
12:33:08 openstackgerrit Brin Zhang proposed openstack/nova master: Specify availability_zone to unshelve https://review.opendev.org/663851
12:35:24 openstackgerrit Shilpa Devharakar proposed openstack/nova master: Support filtering of hosts by forbidden aggregates https://review.opendev.org/667952

Earlier   Later