| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-08-06 | |||
| 07:15:51 | quiquell | What it means ? | |
| 07:16:04 | quiquell | 2018-08-03 22:57:32.138 26 ERROR nova.scheduler.client.report [req-e207e96f-2e1c-4648-afc7-be5c51d396ef 0dd904c9905d4ab7962c306a23e8e4ff 6825b026e19a450283f76bcc85f30a43 - default default] Failed to retrieve allocation candidates from placement API for filters: RequestGroup(use_same_provider=False, resources={CUSTOM_BAREMETAL:1}, traits=[], aggregates=[]) | |
| 07:16:06 | quiquell | Got 400: {"errors": [{"status": 400, "request_id": "req-8b3d0e7f-0238-4290-99f9-4a3df8213231", "code": "placement.undefined_code", "detail": "The server could not comply with the request since it is either malformed or otherwise incorrect.\n\n Invalid resource class in resources parameter: No such resource class CUSTOM_BAREMETAL. ", "title": "Bad Request"}]}. | |
| 07:30:03 | alex_xu | quiquell: 'CUSTOM_BAREMETAL' is custom trait, you must create it by the placement api before you refer it. In the ironic case, nova-manager will create that custom trait for ironic virt driver. | |
| 07:30:29 | alex_xu | quiquell: check the nova-manager log, sounds like nova-manager doesn't startup correctly http://logs.openstack.org/95/583195/18/check/tripleo-ci-centos-7-containers-multinode/769edac/logs/undercloud/var/log/containers/nova/nova-compute.log.txt.gz#_2018-08-03_23_06_47_764 | |
| 07:30:41 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Define irrelevant-files for tempest-full-py3 job https://review.openstack.org/589039 | |
| 07:30:46 | alex_xu | quiquell: also zero node return by the ironic driver http://logs.openstack.org/95/583195/18/check/tripleo-ci-centos-7-containers-multinode/769edac/logs/undercloud/var/log/containers/nova/nova-compute.log.txt.gz#_2018-08-03_23_06_47_882 | |
| 07:31:17 | alex_xu | quiquell: sorry, s/nova-maanger/nova-compute/ | |
| 07:31:49 | alex_xu | quiquell: that means nova-compute doesn't reach to the code to create that CUSTOM_BARETAL for the ironic virt driver | |
| 07:32:17 | alex_xu | quiquell: also sorry, CUSTOM_BARETAL is custom resource class, it is not custom trait....really typo too much wrong words... | |
| 07:32:33 | quiquell | alex_xu: Do we have any log about virt driver to check why it returns 0 ? | |
| 07:34:48 | alex_xu | quiquell: i guess there isn't too much, probably needs to check ironic log to see whether ironic works correctly | |
| 07:43:29 | gmann | giblet: should we mark these bug fixed/invalid now (fixed by zuul) - https://bugs.launchpad.net/nova/+bug/1745405 https://bugs.launchpad.net/nova/+bug/1745431 | |
| 07:43:29 | openstack | Launchpad bug 1745405 in OpenStack Compute (nova) "tempest-full job triggered for irrelevant changes" [Undecided,In progress] - Assigned to Balazs Gibizer (balazs-gibizer) | |
| 07:43:30 | openstack | Launchpad bug 1745431 in OpenStack Compute (nova) "neutron-grenade job is triggered for irrelevant changes " [Undecided,In progress] - Assigned to Balazs Gibizer (balazs-gibizer) | |
| 07:59:44 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Add tempest-slow job to run the tempest slow tests https://review.openstack.org/567697 | |
| 09:18:51 | openstackgerrit | Sylvain Bauza proposed openstack/nova master: Pass allocations to virt drivers when resizing https://review.openstack.org/589085 | |
| 09:40:43 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: Cleanup comp_node, res_prov, services, aggregate_hosts during cell deletion https://review.openstack.org/546660 | |
| 10:06:44 | cdent | gibi: another good thing to get in: https://review.openstack.org/#/c/587772/ | |
| 10:10:51 | gibi | gmann: marked both bug invalid in nova. Thanks for the notice | |
| 10:10:55 | gibi | cdent: looking... | |
| 10:18:59 | openstackgerrit | Lee Yarwood proposed openstack/nova master: fixtures: Track volume attachments within CinderFixtureNewAttachFlow https://review.openstack.org/587013 | |
| 10:19:00 | openstackgerrit | Lee Yarwood proposed openstack/nova master: Add regression test for bug#1784353 https://review.openstack.org/587014 | |
| 10:19:01 | openstackgerrit | Lee Yarwood proposed openstack/nova master: compute: Recreate volume attachments during a reschedule https://review.openstack.org/587071 | |
| 10:19:05 | lyarwood | dansmith: morning, nothing urgent but could you take a look at ^ specifically a question raised by mriedem on a previous patchset - https://review.openstack.org/#/c/587071/4/nova/compute/manager.py | |
| 10:19:33 | gibi | cdent: +2 | |
| 10:20:09 | openstackgerrit | Lee Yarwood proposed openstack/nova master: compute: Recreate volume attachments during a reschedule https://review.openstack.org/587071 | |
| 10:22:09 | cdent | thanks gibi | |
| 10:25:00 | gmann | gibi: thanks | |
| 11:59:28 | mardim | hello guys | |
| 11:59:34 | mardim | I have one question | |
| 12:00:24 | mardim | I have this libvirt xml cpu topology | |
| 12:00:27 | mardim | <cpu mode='host-passthrough' check='none'> | |
| 12:00:27 | mardim | <topology sockets='1' cores='2' threads='2'/> | |
| 12:00:27 | mardim | </cpu> | |
| 12:01:02 | mardim | Then I tried to spinup a cirros instance with 2 vcpus and hw:cpu_policy='dedicated', hw:cpu_thread_policy='isolate' | |
| 12:01:24 | mardim | But the instance is in error state because I get no valid host was found | |
| 12:01:52 | mardim | Apparently scheduler cannot pin and isolate the processes of the instance | |
| 12:01:58 | mardim | but I do not know why | |
| 12:02:11 | mardim | here are some scheduler logs which might help | |
| 12:02:41 | mardim | cpu_usage": 4, "memory_usage": 64, "cpuset": [0, 1, 2, 3], "pinned_cpus": [0, 1], "siblings": [[0, 1], [2, 3]], | |
| 12:03:03 | mardim | do you have any clue what is the problem ? | |
| 12:03:15 | mardim | Thanks !!! | |
| 12:38:28 | openstackgerrit | Lee Yarwood proposed openstack/nova master: fixtures: Track volume attachments within CinderFixtureNewAttachFlow https://review.openstack.org/587013 | |
| 12:38:29 | openstackgerrit | Lee Yarwood proposed openstack/nova master: Add regression test for bug#1784353 https://review.openstack.org/587014 | |
| 12:38:30 | openstackgerrit | Lee Yarwood proposed openstack/nova master: compute: Recreate volume attachments during a reschedule https://review.openstack.org/587071 | |
| 13:10:46 | mdbooth | I'm trying to make 'python setup.py test' in the osc-placement repo exclude functional tests. Does anybody have any ideas where to start looking? | |
| 13:11:22 | mdbooth | It seems to be pbr voodoo, so... any advice short of rtfs appreciated :) | |
| 13:16:37 | cdent | mdbooth: sorry, I've got no clues. I've not been much involved in osc-placement's birth | |
| 13:16:39 | efried | mdbooth: --test-path=... | |
| 13:17:17 | mdbooth | efried: Is that passed to testr? | |
| 13:17:46 | mdbooth | https://docs.openstack.org/pbr/latest/user/using.html#testing This suggests it might be tox.ini, although there's a deprecation notice | |
| 13:18:11 | efried | mdbooth: have we not switched osc-placement to stestr yet? | |
| 13:18:56 | mdbooth | efried: pbr is the darkest most arcane magik | |
| 13:19:03 | mdbooth | I have no idea :) | |
| 13:19:05 | cdent | are you building rpms mdbooth, and thus forced through setup.py? | |
| 13:19:11 | mdbooth | cdent: Yes | |
| 13:19:15 | efried | mdbooth: I would run to mtreinish if it were me. | |
| 13:19:26 | mdbooth | Well not *forced*. It's just a script, I can run whatever I want. | |
| 13:19:53 | mdbooth | But everything else runs setup.py test, so I'd prefer to make that work for consistency | |
| 13:19:58 | cdent | you might also try efried's suggestion with a --<space> before the --test-path | |
| 13:20:15 | mdbooth | What is the argument to --test-path? | |
| 13:20:45 | efried | not having the repo in front of me, I would guess ./osc_placement/tests/unit | |
| 13:21:25 | mdbooth | efried: Ah, ok. | |
| 13:24:44 | mdbooth | Eurgh... It doesn't work and I'm way too hot and I just want to lie in an ice bucket and weep until it all goes away. | |
| 13:40:51 | mdbooth | So I have a behaviour difference here between the CI environment and locally. CI runs 'python2 setup.py test' and it does All The Things(tm). Locally it does nothing: http://paste.openstack.org/show/727412/ | |
| 13:41:35 | mdbooth | CI: (search for 'python2 setyp.py test') https://logs.rdoproject.org/81/15181/3/check/legacy-rdoinfo-DLRN-check/83a6ba9/buildset/centos-rpm-master/repos/95/77/9577cd899541b4c2a5b9fa74a59f4c346bd5addf_dev/rpmbuild.log | |
| 13:42:02 | mdbooth | Any idea what environment factors affect setup.py test? | |
| 13:50:36 | efried | n-sch meeting in 10 minutes in #openstack-meeting-alt | |
| 13:51:21 | dansmith | lyarwood: mriedem I left comments on that review.. definitely seems like obligatory pings to cinder for every build is a less-than-awesome change, and would rather see it be something we do on reschedule if we need | |
| 13:51:51 | dansmith | also, queried about whether or not the GET is enough. I guess I would expect there are some attachment states that can't be reversed blindly by the boot process? | |
| 13:52:59 | lyarwood | dansmith: ack thanks | |
| 13:55:45 | openstackgerrit | sahid proposed openstack/nova master: hardware: fix memory check usage for small/large pages https://review.openstack.org/532168 | |
| 13:56:00 | openstackgerrit | Lee Yarwood proposed openstack/nova master: DNM/WIP compute: Reduce likelihood of bdm creation race during attach https://review.openstack.org/589164 | |
| 13:59:47 | mriedem | dansmith: lyarwood: that's where i'm leaning - re-create attachments in conductor build_instances if we're rescheduling | |
| 13:59:56 | dansmith | yeah | |
| 14:00:03 | dansmith | t'would make more sense to me to do that | |
| 14:00:48 | lyarwood | mriedem / dansmith ; kk, tbh I've spent very little time looking around within conductor and just assumed it wouldn't be the right place, I'll try to move things over now and respin. | |
| 14:04:59 | mdbooth | OS_TEST_PATH | |
| 14:07:58 | efried | mdbooth: \o/ nice one | |
| 14:08:29 | mdbooth | Although I can't see why rpmbuild isn't using the default | |
| 14:14:58 | mdbooth | mriedem: Wow, brave. | |
| 14:15:42 | mriedem | already mostly done | |
| 14:15:54 | mdbooth | Any good nuggets? | |
| 14:16:46 | mriedem | mdbooth: i'll post a summary with a link to my spreadsheet in the ML once i'm done | |
| 14:16:55 | mriedem | there are definitely some things we can upstream to nova | |
| 14:17:21 | mriedem | given it was a snapshot based on pike, there are also several bug fixes they have backported so not really forks, just cherry picks we don't have in stable/pike | |
| 14:17:40 | mriedem | and other bug fixes that weren't reported upstream | |
| 14:17:56 | mriedem | e.g. https://review.openstack.org/#/c/588689/ | |
| 14:18:05 | mriedem | and https://review.openstack.org/#/c/588657/ | |
| 14:18:26 | mdbooth | Nice | |
| 14:18:32 | mdbooth | Ah, so you do at least have a git repo | |
| 14:18:43 | mdbooth | You're not just staring at a massive unified diff | |
| 14:18:54 | mriedem | i am | |
| 14:18:55 | mriedem | https://github.com/starlingx-staging/stx-nova/commit/71acfeae0d1c59fdc77704527d763bd85a276f9a | |
| 14:19:07 | mriedem | oh yeah i do have the actual git repo cloned | |
| 14:19:11 | mriedem | so i can search things for context | |
| 14:19:14 | mriedem | but i'm mostly starting with the diff | |
| 14:20:04 | mriedem | i'm also starting to glaze over things toward the end here out of sheaer fatigue | |
| 14:20:06 | mriedem | *sheer | |