Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2019-05-24
21:36:40 melwitt ... I don't understand what is going on
21:37:11 melwitt I'm going to try on my devstack
21:38:03 kaiokmo me neither
21:40:56 melwitt ok, when I appended AggregateInstanceExtraSpecsFilter to enabled_filters in devstack it runs the filter
21:42:24 kaiokmo runs it or loads it? did you created a host aggregate and a flavor (both with the proper metadata)?
21:42:43 melwitt runs it, I added a log message right at the beginning inside the host_passes method
21:43:41 melwitt no, I didn't do anything with aggregate and flavor. the filter not running would be unrelated to aggregate/flavor AFAIK
21:44:16 melwitt I'll try it
21:44:46 kaiokmo doesn't seem to work for me. I configured nova.conf as you suggested, with enabled_filters=AggregateInstanceExtraSpecsFilter and I left available_filters commented to load all filters by default
21:45:12 kaiokmo in which tag are your nova/devstack on?
21:45:32 openstackgerrit Dustin Cowles proposed openstack/nova master: Use SDK instead of ironicclient for node.list https://review.opendev.org/656027
21:45:32 openstackgerrit Dustin Cowles proposed openstack/nova master: Introduces SDK to IronicDriver and uses for node.get https://review.opendev.org/642899
21:45:33 openstackgerrit Dustin Cowles proposed openstack/nova master: Use SDK instead of ironicclient for validating instance and node https://review.opendev.org/656028
21:45:34 openstackgerrit Dustin Cowles proposed openstack/nova master: WIP: Use SDK instead of ironicclient for add/remove instance info from node https://review.opendev.org/659691
21:45:34 openstackgerrit Dustin Cowles proposed openstack/nova master: Use SDK instead of ironicclient for setting instance id https://review.opendev.org/659690
21:46:00 melwitt I'm at a5e3054e1d6df248fc4c00b9abd7289dde160393 in train
21:47:58 melwitt when I set enabled_filters = AggregateInstanceExtraSpecsFilter I get only the one filter running
21:52:46 melwitt gonna try now with aggregate and flavor
21:53:37 kaiokmo ok, thank you. it is probably gonna work, since the filter is running
21:54:36 kaiokmo I'm at 18.0.0, deployed with OSA
22:00:09 melwitt ok, booting with matching metadata works. now I'll try no match
22:01:41 kaiokmo my knowledge about nova behaviou (api and etcetera) is limited. could this be related with the placement service or something?
22:01:42 melwitt nonmatch fails to boot
22:01:58 kaiokmo s/behaviou/behavior
22:02:11 melwitt I thought about whether placement could be involved, but that would *not* affect whether your filter runs
22:03:05 melwitt when something changes related to placement, it would a change where the host candidates coming back from placement are problematic in some way
22:03:17 melwitt placement will pre-filter hosts before they run through the nova scheduler filters
22:03:55 kaiokmo ah. I see
22:04:25 melwitt the fact that your filter isn't running at all is bizarre and I can't think of how that could be happening other than a config problem
22:14:02 melwitt kaiokmo: when the nova-scheduler service starts up, the DEBUG log will show what values it picked up for available_filters and enabled_filters. you might take a look at that to see if it yields any clues
22:14:08 openstackgerrit Merged openstack/nova master: Move get_pci_mapping_for_migration to MigrationContext https://review.opendev.org/643023
22:14:16 openstackgerrit Merged openstack/nova master: Allow driver to properly unplug VIFs on destination on confirm resize https://review.opendev.org/643024
22:14:57 melwitt for example May 24 21:46:45 ubuntu-xenial nova-scheduler[15474]: DEBUG oslo_service.service [None req-3351fca8-ca06-4931-bebb-e1f40771a478 None None] filter_scheduler.enabled_filters = ['AggregateInstanceExtraSpecsFilter']
22:15:26 melwitt filters']
22:15:26 melwitt May 24 21:46:45 ubuntu-xenial nova-scheduler[15474]: DEBUG oslo_service.service [None req-3351fca8-ca06-4931-bebb-e1f40771a478 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_
22:16:25 kaiokmo mine is filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters']
22:16:33 kaiokmo and filter_scheduler.enabled_filters = ['AggregateInstanceExtraSpecs Filter']
22:17:00 kaiokmo which seems correct
22:17:36 melwitt is the space in the middle of ['AggregateInstanceExtraSpecs Filter'] just a typo in chat or?
22:17:48 melwitt because it should not have a space
22:19:53 kaiokmo typo in chat.
22:20:04 kaiokmo for a moment I thought "omg, it can't be" :)
22:23:11 melwitt scheduler.driver = filter_scheduler should be in the log too
22:25:55 kaiokmo yeah, it is here
22:26:28 melwitt w t f
22:27:23 kaiokmo doesn't make sense for me either
22:28:01 kaiokmo been trying to get this working since yesterday.
22:30:02 melwitt yeah, I dunno what to tell you. I'd be putting prints all over the code and just try to trace it at this point
22:30:09 melwitt do you see a log like this at least? DEBUG nova.filters [None req-4d2d1a33-c0da-4285-a500-3806a3313c4d admin admin] Starting with 1 host(s)
22:30:42 melwitt that's what it says before it starts running filters
22:33:13 kaiokmo not really. only a bunch of "Lock acquired...", "Running periodic tasks...", and "Succesfully synced instances...
22:33:28 kaiokmo so, the filters are not running at all? that's not good
22:34:27 melwitt backing up, you are seeing a server successfully boot right? and it's going onto hosts you don't want?
22:35:23 melwitt if so, are you running one scheduler or multiple? at least one of them should be showing filtering related messages if debug=True in the nova-scheduler config
22:35:57 melwitt unless you are forcing to specific host or something in your nova boot command
22:39:36 kaiokmo yeah, I can boot servers but they are going to whatever host chosen by scheduler. I'm running three schedulers on separated infra nodes, behind a haproxy.
22:40:13 kaiokmo yes, I'm looking for the messages on the three of them, and replicating the same configuration.
22:40:38 melwitt O.o
22:42:03 kaiokmo this is the entire nova.conf I'm using http://paste.openstack.org/show/752060/
22:42:25 kaiokmo doesn't seem to be anything wrong with scheduler and filter_scheduler sections
22:45:19 melwitt I see a few config options whose names have changed in later releases but nothing that should be hurting
22:46:21 melwitt should also see a log message like this on at least one scheduler
22:46:25 melwitt DEBUG nova.scheduler.filter_scheduler [None req-4d2d1a33-c0da-4285-a500-3806a3313c4d admin admin] Filtered
22:49:02 kaiokmo none of the sort. nothing like "nova.scheduler.filter_scheduler"
22:53:35 melwitt is your deployment custom patched or anything?
22:56:14 tonyb dansmith: thanks! and sorry
23:07:11 openstackgerrit Merged openstack/nova master: Move patch_exists() to nova.test.TestCase for reuse https://review.opendev.org/660500
23:39:48 openstackgerrit Adam Spiers proposed openstack/nova master: Move selective patching of open() to nova.test for reuse https://review.opendev.org/661266
23:46:05 openstackgerrit Adam Spiers proposed openstack/nova master: Provide HW_CPU_AMD_SEV trait when SEV is supported https://review.opendev.org/638680
23:47:23 openstackgerrit Adam Spiers proposed openstack/nova master: Reduce logging of host hypervisor capabilities to DEBUG level https://review.opendev.org/661379
23:49:21 openstackgerrit Adam Spiers proposed openstack/nova master: Add element to libvirt guest XML for AMD SEV https://review.opendev.org/636318
23:52:52 openstackgerrit Adam Spiers proposed openstack/nova master: Extract SEV-specific bits on host detection https://review.opendev.org/636334
23:58:49 openstackgerrit Merged openstack/nova master: Skip novnc tests in multi-cell job until bug 1830417 is fixed https://review.opendev.org/661371
23:58:50 openstack bug 1830417 in devstack "NoVNCConsoleTestJSON.test_novnc fails in nova-multi-cell job since 5/20" [Undecided,In progress] https://launchpad.net/bugs/1830417 - Assigned to melanie witt (melwitt)
#openstack-nova - 2019-05-25
00:54:43 openstackgerrit Merged openstack/nova master: [Docs] Fix minor typo https://review.opendev.org/660696
02:54:06 openstackgerrit Eric Fried proposed openstack/nova master: Move selective patching of open() to nova.test for reuse https://review.opendev.org/661266
06:45:33 openstackgerrit Lee Yarwood proposed openstack/nova master: block_device: Optionally recreate attachments when refreshing connection_info https://review.opendev.org/579004
11:06:41 openstackgerrit Boxiang Zhu proposed openstack/nova master: Add valid compute nodes with host and/or node in api layer https://review.opendev.org/661237
17:37:01 openstackgerrit Guo Jingyu proposed openstack/nova master: Define and catch QemuGuestAgentNotRunning for set-password failure https://review.opendev.org/661466
22:30:23 kaiokmo melwitt: sorry for the delay. by the way, thank you for all your help
22:31:28 kaiokmo melwitt: nope. it's literally a fork from stable/rocky as it were 1 week ago
23:30:39 openstackgerrit Michael Bayer proposed openstack/nova master: Don't rely on SQLAlchemy collections magically initializing __dict__ https://review.opendev.org/661472
#openstack-nova - 2019-05-26
06:25:38 openstackgerrit Boxiang Zhu proposed openstack/nova master: Add host and hypervisor_hostname flag to create server https://review.opendev.org/645520
11:40:21 openstackgerrit garyk proposed openstack/nova master: Ensure that metadata proxy raises correct exception https://review.opendev.org/661480
18:04:07 openstackgerrit Adrian Chiris proposed openstack/nova stable/stein: Allow driver to properly unplug VIFs on destination on confirm resize https://review.opendev.org/661495
18:04:07 openstackgerrit Adrian Chiris proposed openstack/nova stable/stein: Move get_pci_mapping_for_migration to MigrationContext https://review.opendev.org/661494
19:47:24 openstackgerrit Adrian Chiris proposed openstack/nova stable/rocky: Move get_pci_mapping_for_migration to MigrationContext https://review.opendev.org/661499
19:47:25 openstackgerrit Adrian Chiris proposed openstack/nova stable/rocky: Allow driver to properly unplug VIFs on destination on confirm resize https://review.opendev.org/661500
21:29:03 openstackgerrit David Hill proposed openstack/nova master: Reschedule instance only if image properties changed in rebuild_instance. https://review.opendev.org/661503
21:30:58 openstackgerrit Merged openstack/nova stable/rocky: Pass on region when we don't have a valid ironic endpoint https://review.opendev.org/656525
21:56:12 openstackgerrit David Hill proposed openstack/nova master: Reschedule instance only if image properties changed in rebuild_instance. https://review.opendev.org/661503
22:02:00 openstackgerrit David Hill proposed openstack/nova master: Reschedule instance only if image properties changed in rebuild_instance. https://review.opendev.org/661503
22:17:58 openstackgerrit David Hill proposed openstack/nova master: Reschedule instance only if image properties changed in rebuild_instance. https://review.opendev.org/661503
22:27:00 openstackgerrit David Hill proposed openstack/nova master: Reschedule instance only if image properties changed in rebuild_instance. https://review.opendev.org/661503
#openstack-nova - 2019-05-27
00:04:45 openstackgerrit David Hill proposed openstack/nova master: Reschedule instance only if image properties changed in rebuild_instance. https://review.opendev.org/661503
00:07:12 openstackgerrit David Hill proposed openstack/nova master: Reschedule instance only if image properties changed in rebuild_instance. https://review.opendev.org/661503
00:20:06 openstackgerrit David Hill proposed openstack/nova master: Reschedule instance only if image properties changed in rebuild_instance. https://review.opendev.org/661503
00:21:18 openstackgerrit David Hill proposed openstack/nova master: Reschedule instance only if image properties changed. https://review.opendev.org/661503
00:25:15 openstackgerrit David Hill proposed openstack/nova master: Reschedule instance only if image properties changed. https://review.opendev.org/661503
00:27:05 openstackgerrit David Hill proposed openstack/nova master: Reschedule instance only if image properties changed. https://review.opendev.org/661503

Earlier   Later