| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-07-26 | |||
| 20:32:09 | melwitt | one for single cell and one for multicell | |
| 20:34:19 | sdague | jlvillal / vdrok ironic is still failing after the devstack change, on the hypervisor count never exceeding 0 | |
| 20:34:35 | sdague | is that the same issue you were dealing with, or a different one | |
| 20:34:47 | sdague | http://logs.openstack.org/58/487458/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/01e5dfe/ | |
| 20:36:33 | jlvillal | sdague: I'll be honest and admit I don't know what exactly is going on. vdrok has been driving this issue. | |
| 20:37:08 | jlvillal | sdague: And it is 23:36 at night where he is... | |
| 20:37:15 | bauzas | jangutter: question, are we 100% sure the VIF object we're getting is always having a profile information if it's an Agilio VNIC type ? https://review.openstack.org/#/c/483459/17/nova/network/os_vif_util.py@319 | |
| 20:37:43 | bauzas | jangutter: I think it's a reasonable assumption but I want to be sure we're not getting a stupid KeyError exception | |
| 20:38:42 | jangutter | bauzas: It should, or the claim would fail earlier. The only two VNIC types we use are in the SR-IOV list. | |
| 20:40:27 | sdague | jlvillal: ok, the test results hadn't returned yet, so I just figured I'd give an early heads up | |
| 20:40:53 | jlvillal | sdague: Thanks, doesn't look like the test job likes those changes. Based on all the failures | |
| 20:40:56 | sdague | we're about 17 minutes away from the devstack patch passing | |
| 20:41:07 | jlvillal | Ugh | |
| 20:41:09 | sdague | jlvillal: yeh, I don't know what the previous issue was actually | |
| 20:42:46 | jlvillal | sdague: I'm telling people about it over in #openstack-ironic. Reaction not so good ;) | |
| 20:44:11 | dansmith | sdague: jlvillal that's the one yeah | |
| 20:44:29 | dansmith | jlvillal: for the record, I did ask a week ago and things were good in ironic land dependent on the change :) | |
| 20:45:14 | jlvillal | dansmith: I thought we tested it before and it worked. | |
| 20:45:32 | sdague | dansmith: http://logs.openstack.org/58/487458/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/01e5dfe/logs/devstacklog.txt.gz#_2017-07-26_19_51_43_735 | |
| 20:45:43 | dansmith | jlvillal: that's what was reported yeah, but it turns out that was only the grenade one not the multinode regular job | |
| 20:45:57 | sdague | any idea why nova might not register resources in the new patch? | |
| 20:46:19 | catintheroof | Hi, does anyone has a good guide on how to configure live migration on ocata ? doing the same that worked as of mitaka, doesnt anymore | |
| 20:46:21 | dansmith | yes, there's a dependent one that you need | |
| 20:46:22 | dansmith | hang on | |
| 20:46:25 | jlvillal | sdague: So what patch is about to land? And is that what will cause ironic to break? | |
| 20:46:31 | jangutter | bauzas: I got this from the scheduler: Insufficient compute resources: Requested instance NUMA topology together with requested PCI devices cannot fit the given host NUMA topology; Claim pci failed. _phew_ | |
| 20:46:54 | dansmith | https://review.openstack.org/#/c/487458/ | |
| 20:47:08 | openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Set Adapter interface defaults in conf https://review.openstack.org/487581 | |
| 20:47:08 | dansmith | oh | |
| 20:47:12 | dansmith | your run is from that | |
| 20:47:20 | jlvillal | yeah] | |
| 20:47:43 | dansmith | yeah let me look through a sec hang on | |
| 20:47:52 | sdague | http://logs.openstack.org/58/487458/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/01e5dfe/logs/screen-n-cpu.txt.gz#_Jul_26_19_40_24_440198 that doesn't look good | |
| 20:48:32 | jlvillal | +1 on not looking good | |
| 20:49:11 | mriedem | that's the flavor migrate stuff i think | |
| 20:49:18 | dansmith | nova.conf is still pointing at cell0 | |
| 20:49:37 | mriedem | https://review.openstack.org/#/c/484949/ | |
| 20:50:04 | mriedem | yup, also shows up in n-cpu logs in the ironic job on that nova change http://logs.openstack.org/49/484949/14/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/69b18d7/logs/screen-n-cpu.txt.gz?level=TRACE | |
| 20:50:07 | mriedem | edleafe: ^ | |
| 20:50:11 | mriedem | so a different problem | |
| 20:50:40 | dansmith | oh, | |
| 20:50:45 | dansmith | the logic is reversed | |
| 20:51:52 | sdague | dansmith: oh, ok, that's hopeful | |
| 20:51:59 | sdague | so it just needs to be the other way around? | |
| 20:52:03 | dansmith | yeah | |
| 20:52:04 | dansmith | pushed a change and rechecked | |
| 20:52:05 | dansmith | yeah | |
| 20:52:12 | dansmith | because I was still in inverted flag mode in my brain head | |
| 20:52:15 | dansmith | jlvillal: ^ | |
| 20:52:23 | jlvillal | dansmith: Thanks! | |
| 20:53:24 | mriedem | sdague: shouldn't we see https://review.openstack.org/#/c/487458/ pass before approving the devstack change? | |
| 20:53:27 | sdague | dansmith: ok, I pre +Aed your new change. I'm going to be dropping off shortly for the day | |
| 20:54:03 | dansmith | okay | |
| 20:54:04 | sdague | mriedem: maybe, the question is whether anyone will be around to do that. | |
| 20:54:12 | mriedem | i guess we can proxy to mtreinish | |
| 20:54:20 | sdague | so, I can do this thing, and assuming life is good, it goes in. | |
| 20:54:28 | mriedem | yeah otherwise we'll bug mtreinish | |
| 20:54:31 | sdague | if things suck, just hit the rebase button | |
| 20:54:36 | sdague | to prevent it from landing | |
| 20:54:42 | dansmith | sdague: you can throw one of us on devstack core and pinky swear not to do anything else | |
| 20:55:02 | sdague | if anyone else wants to be devstack core, I'll sign you right up :) | |
| 20:55:07 | dansmith | haha | |
| 20:55:11 | mriedem | not it | |
| 20:55:15 | sdague | honestly mriedem if you want that bit you can have it | |
| 20:55:22 | sdague | you poke enough there | |
| 20:55:23 | dansmith | sounds less glamorous when you put it that way | |
| 20:55:26 | jlvillal | +1 for more devstack cores :) | |
| 20:58:28 | mriedem | here is the bug for the 500 on n-cpu startup with ironic https://bugs.launchpad.net/nova/+bug/1706772 | |
| 20:58:29 | openstack | Launchpad bug 1706772 in OpenStack Compute (nova) "InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver" [High,Confirmed] | |
| 21:03:50 | openstackgerrit | Jay Pipes proposed openstack/nova master: claim resources in placement API during schedule() https://review.openstack.org/483566 | |
| 21:03:50 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: account for move operations in claim https://review.openstack.org/487589 | |
| 21:04:06 | jaypipes | dansmith, bauzas, mriedem: ^^ | |
| 21:05:04 | mriedem | looking | |
| 21:08:43 | mtreinish | mriedem: you need me to review something? | |
| 21:08:45 | melwitt | mriedem: do we not need a spec for adding new policy rules? I would have thought we do https://review.openstack.org/#/c/449288 | |
| 21:09:08 | mtreinish | I was just sitting in a corner inhaling lead fumes, but I can take a break from that | |
| 21:09:20 | melwitt | lol | |
| 21:09:20 | mriedem | mtreinish: not yet | |
| 21:10:06 | jaypipes | mtreinish: nice. :) | |
| 21:10:09 | mriedem | melwitt: it's not an api change so i don't think a spec is neeed | |
| 21:10:10 | mriedem | *needed | |
| 21:10:21 | mriedem | melwitt: plus i think we did one or more of these same granularity policy things in ocata, | |
| 21:10:32 | melwitt | mriedem: okay, cool. thanks, I learned a thing | |
| 21:10:34 | mriedem | the key is it must be backward compatible with an existing policy json i think | |
| 21:10:54 | mriedem | so an operator would need to opt into the more granular rules | |
| 21:11:19 | melwitt | right. I think they are taking care of that in the patch | |
| 21:11:23 | melwitt | cool | |
| 21:15:06 | openstackgerrit | melanie witt proposed openstack/nova master: deprecate ``wsgi_log_format`` config variable https://review.openstack.org/486623 | |
| 21:24:33 | bauzas | jaypipes: just a question about https://review.openstack.org/#/c/487589/1/nova/scheduler/client/report.py | |
| 21:25:15 | bauzas | jaypipes: when we self-heal by the RT, we remove allocations that are not related to the existing instances, right? | |
| 21:25:34 | mriedem | jaypipes: issues in https://review.openstack.org/#/c/487589 | |
| 21:27:39 | dansmith | bauzas: that's what I said in my comment | |
| 21:27:48 | jaypipes | bauzas: when the move_claim() completes on the destination host, it will overwrite the allocations to only be the ones on the destination host, yes. I think that's what you're asking? | |
| 21:27:58 | jaypipes | mriedem: blasted? | |
| 21:28:10 | dansmith | jaypipes: no | |
| 21:28:26 | dansmith | jaypipes: he's asking about regular RT healing on the source node while the migration is going on, erasing the double claim | |
| 21:28:57 | bauzas | dansmith: my question is about if either the source or the target RT removes the allocations for the moving instance given the instance.host is not related to it | |
| 21:29:00 | dansmith | jaypipes: which was in my comment about the plan.. we need to make sure we don't heal over that | |
| 21:29:10 | openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Set Adapter interface defaults in conf https://review.openstack.org/487581 | |
| 21:29:14 | dansmith | bauzas: instance.host will be related to the source until it completes | |