| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-04-02 | |||
| 11:05:31 | NewBruce | so, i filled that with a bunch of extra debugs - if im migrating from compute28 -> compute29 (both OSA and successful) | |
| 11:05:32 | NewBruce | 2019-02-12 13:09:33.458 59488 INFO nova.network.neutronv2.api [req-8e14a273-fc18-461e-a2de-b8bad835dcd8 a3bee416cf67420995855d602d2bccd3 a564613210ee43708b8a7fc6274ebd63 - default default] [BRUCE](A-8-2): _setup_migration_port_profile: host_id = cc-compute29-kna1 | |
| 11:12:15 | jaypipes | stephenfin: you around? I'm having a hell of time trying to run tests in nova now that tox requirements have changed. | |
| 11:12:38 | jaypipes | stephenfin: nothing I seem to do will get me out of the hell that is this: [jaypipes@uberbox nova]$ tox -efunctional | |
| 11:12:38 | jaypipes | ERROR: tox version is 2.5, required is at least 3.1.1 | |
| 11:12:57 | jaypipes | I've sudo -H pip install -U pip tox, I've apt purge'd python-tox | |
| 11:13:12 | jaypipes | and still /usr/local/bin/tox persists and is pointing somewhere old | |
| 11:13:27 | jaypipes | and I have no idea why this crap has to just suddenly break :) | |
| 11:18:05 | jaypipes | stephenfin: cdent has graciously helped me. needed to `sudo -H pip uninstall tox && sudo -H pip install tox && reload bash...` | |
| 11:32:08 | sean-k-mooney | jaypipes: ya i was just going to say that you proably need to uninstall first | |
| 11:32:46 | sean-k-mooney | i had the same issue more or less to as i started with tox form my package mangaer and need to swap to pip later | |
| 12:03:07 | stephenfin | jaypipes: Good to hear you got sorted. FWIW, the current guidelines suggest not using 'sudo pip install' since it's way too likely to break distro packages. You need to prepend (or append, I don't recall the order) '~/.local/bin' to PATH then 'pip install --local' | |
| 12:03:57 | stephenfin | jaypipes: fwiw, I was reluctant to merge the patches that required tox 3.1.1+ but I think we decided the benefits outweighed the costs | |
| 12:08:46 | sean-k-mooney | that said it depend on what the thing is that im installing | |
| 12:08:58 | sean-k-mooney | stephenfin: can i get you input on http://logs.openstack.org/33/647733/2/check/nova-tox-functional/72500de/testr_results.html.gz | |
| 12:09:40 | sean-k-mooney | our functional notification tests are asserting behavior of the payloads as json dicts | |
| 12:10:16 | sean-k-mooney | 1st this feals wrong at first glacne to call these fucntional test but i have not looked at the code to see how they work so ill put that aside for a minut | |
| 12:11:23 | sean-k-mooney | should i a.) update these to use the new version of the object b.) convert them to do assertion using the objects or c.) force them to use the old version somehow? | |
| 12:13:40 | sean-k-mooney | by the way these are semi valid failures | |
| 12:15:33 | sean-k-mooney | as i am updating the allowed values in a field in the image metadata object but unlike everywhere else in nova we appearend version bump composed object in this specific case. | |
| 12:15:36 | sean-k-mooney | https://review.openstack.org/#/c/647733/ | |
| 12:21:23 | jaypipes | thx stephenfin | |
| 12:26:14 | sean-k-mooney | jaypipes: by the way i dont know if you have time to revew the last two patches in the sriov migrtion blueprint https://review.openstack.org/#/q/topic:bp/libvirt-neutron-sriov-livemigration+(status:open) | |
| 12:26:39 | jaypipes | sean-k-mooney: hmm, my favorite topics, merged into one. | |
| 12:26:48 | sean-k-mooney | it would be nice to get that squared away before the ptg | |
| 12:27:00 | sean-k-mooney | haha all that is missing is numa | |
| 12:28:26 | jaypipes | and FPGAs. | |
| 12:29:41 | sean-k-mooney | live migration with numa affined fpga exposed by sriov passthough... at some point it just gets easier to move the damb server | |
| 12:30:24 | sean-k-mooney | it is the one of the up sides of ironic | |
| 12:30:35 | artom | Or you know, register a new corporation and buy them new machines. | |
| 12:32:17 | sean-k-mooney | im just going to pop out to grab lunch so ill brb | |
| 12:37:11 | openstackgerrit | Artem Vasilyev proposed openstack/nova master: systemd detection result caching nit fixes https://review.openstack.org/649229 | |
| 12:42:14 | stephenfin | sean-k-mooney: They look like valid errors to me. I'm guessing we should update the notification samples but gibi_off or mriedem are probably the people to ask | |
| 12:58:55 | mriedem | cdent: question inline https://review.openstack.org/#/c/649068/ | |
| 13:14:08 | kashyap | Can anyone remind me again, has upstream Git master opened for Train, yet? (/me is dazed after PTO) | |
| 13:14:50 | sean-k-mooney | yes | |
| 13:14:55 | sean-k-mooney | like a week or two ago | |
| 13:15:03 | kashyap | Thanks | |
| 13:15:09 | sean-k-mooney | it opens after RC1 but we dont then to merge big thing for a few weeks after | |
| 13:17:29 | gibi_off | sean-k-mooney: for notifications we only emit the latest version only | |
| 13:17:41 | gibi_off | sean-k-mooney: so please update the samepl file according to the change in the object | |
| 13:18:00 | gibi_off | sean-k-mooney: the tests are functional ast they call the nova API and assert if notifications are received | |
| 13:18:52 | sean-k-mooney | gibi_off: ok but would they not avoid this issue if they parsed the notificaion into a python object and then checked that | |
| 13:19:16 | sean-k-mooney | gibi_off: also if your off today your doing it wrong :) but thanks ill update it | |
| 13:19:41 | kashyap | efried: When you get a moment, since Train has forked, might want to put this through: https://review.openstack.org/#/c/641981/ | |
| 13:20:24 | efried | kashyap: done, thanks for the reminder. | |
| 13:21:08 | gibi_off | sean-k-mooney: the parsed object would have different version | |
| 13:21:42 | gibi_off | sean-k-mooney: also nova cannot assume how the notifications are parsed by the consumer so we assert the json we emmit | |
| 13:21:51 | sean-k-mooney | ah good points | |
| 13:22:08 | kashyap | efried: Tack! | |
| 13:22:42 | kashyap | (Swedish for "thanks", if people don't want to look it up :D) | |
| 13:25:10 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/stein: Add functional regression test for bug 1669054 https://review.openstack.org/649319 | |
| 13:25:11 | openstack | bug 1669054 in OpenStack Compute (nova) "RequestSpec.ignore_hosts from resize is reused in subsequent evacuate" [Medium,In progress] https://launchpad.net/bugs/1669054 - Assigned to Matt Riedemann (mriedem) | |
| 13:25:11 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/stein: Do not persist RequestSpec.ignore_hosts https://review.openstack.org/649320 | |
| 13:36:40 | jaypipes | mnaser: around? can you please execute both of the queries in this pastebin and show me the output please? http://paste.openstack.org/show/748718/ | |
| 13:37:28 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/rocky: Add functional regression test for bug 1669054 https://review.openstack.org/649325 | |
| 13:37:29 | openstack | bug 1669054 in OpenStack Compute (nova) stein "RequestSpec.ignore_hosts from resize is reused in subsequent evacuate" [Medium,In progress] https://launchpad.net/bugs/1669054 - Assigned to Matt Riedemann (mriedem) | |
| 13:37:29 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/rocky: Do not persist RequestSpec.ignore_hosts https://review.openstack.org/649326 | |
| 13:49:18 | yonglihe | mriedem: alex_xu: patch splited, and new unit test added. and... i need fix 2 of them. https://review.openstack.org/#/c/627765/13. thanks. | |
| 13:51:38 | alex_xu | yonglihe: sorry for not reach it for a while, will try tomorrow | |
| 13:52:07 | yonglihe | thanks, great news for me. | |
| 13:53:03 | efried | kashyap: I actually knew that :) | |
| 13:53:31 | kashyap | efried: Nice. Then I can try a few more phrases later on, then :D | |
| 13:54:23 | efried | In Swedish? That would be pretty much the extent of it for me. Hit me with some other languages though | |
| 13:55:06 | efried | kashyap: full disclosure, I wasn't sure of the spelling. The same pronunciation has the same meaning (but slightly different spellings) in Swedish, Danish, and Norwegian. | |
| 13:55:50 | kashyap | efried: Yeah, you're right -- they're all North Germanic languages | |
| 13:56:14 | kashyap | So to put the spelling thing to rest: Tack (Swedish), Takk (Norwegian), and Tak (Danish) :D | |
| 13:57:28 | ygk_12345 | hi all | |
| 13:58:14 | ygk_12345 | i having issues with spinning up vms on a compute node. they are forever in the scheduling state | |
| 13:58:37 | ygk_12345 | it is rocky setup OSA | |
| 14:04:23 | kashyap | ygk_12345: Hi, as noted in PM, I think you might get better responses on the more generic #openstack channel, where more admins / operators might hang out. | |
| 14:05:11 | efried | mriedem: Here's an interesting one: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Background%20on%20this%20error%20at%3A%20http%3A%2F%2Fsqlalche.me%2Fe%2Frvf5%5C%22 | |
| 14:05:11 | efried | (e.g. http://logs.openstack.org/50/638150/7/check/openstack-tox-py27/345d1d1/testr_results.html.gz) | |
| 14:05:11 | efried | Something happens every day around 1am that makes sqla race like hell. | |
| 14:12:38 | artom | sean-k-mooney, hah, midair collision :) In any case, thanks for the sanity check | |
| 14:12:40 | artom | sean-k-mooney++ | |
| 14:12:48 | artom | Doh, wrong channel | |
| 14:15:12 | ygk_12345 | any nova expert here ? | |
| 14:15:25 | ygk_12345 | tried in #openstack channel but no one could help me | |
| 14:17:37 | efried | ygk_12345: Have you had a look in the logs yet? | |
| 14:17:55 | ygk_12345 | efried: yes | |
| 14:18:20 | ygk_12345 | efried: it doesn't seem to indicate that the build started | |
| 14:18:22 | ygk_12345 | efried: http://paste.openstack.org/show/748717/ | |
| 14:18:37 | ygk_12345 | efried: it is in the scheduling state forever | |
| 14:20:35 | efried | ygk_12345: What about the n-sch and/or n-cpu logs? Anything appear to be hanging/repeating in there? | |
| 14:20:56 | ygk_12345 | efried: nothing this is the log I got so far | |
| 14:21:59 | ygk_12345 | efried: I see this "claim resources in the placement API for instance c2093503-d2d0-4401-8956-6a68a7d6e0dc claim_resources /openstack/venvs/nova-18.1.5/lib/python2.7/site-packages/nova/scheduler/utils.py:934" | |
| 14:22:00 | openstackgerrit | Chris Dent proposed openstack/nova master: Don't report 'exiting' when mapping cells https://review.openstack.org/649340 | |
| 14:25:14 | efried | ygk_12345: that was in the n-sch log presumably. Nothing after that? | |
| 14:25:16 | cdent | ygk_12345: did you discover hosts in your cells? | |
| 14:25:31 | ygk_12345 | cdent: efried yes | |
| 14:25:52 | ygk_12345 | cdent: how to validate it ? | |
| 14:25:59 | ygk_12345 | cdent: regarding cells ? | |
| 14:27:28 | openstackgerrit | Stephen Finucane proposed openstack/nova-specs master: Standardize CPU resource tracking https://review.openstack.org/555081 | |
| 14:27:35 | cdent | listing your hypervisors | |
| 14:27:45 | cdent | I think you need to look at your n-cpu logs | |
| 14:27:48 | ygk_12345 | cdent: all the hypervisors are enabled | |
| 14:27:54 | mriedem | efried: i think that's this http://status.openstack.org/elastic-recheck/#1793364 | |
| 14:28:06 | ygk_12345 | cdent: where to look at the n-cpu logs ? | |
| 14:28:54 | cdent | ygk_12345: it depends on how you installed your openstack, but somewhere you have a nova-compute process, on the host which is or manage your hypervisor | |