| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-10-24 | |||
| 15:29:48 | mriedem | melwitt: just a few things in your host_status policy patch https://review.opendev.org/#/c/679181/ | |
| 15:30:41 | melwitt | thanks | |
| 15:33:03 | melwitt | I'll try to adjust the sleep thing like you suggested. I had based it on this https://github.com/openstack/nova/blob/master/nova/tests/functional/test_server_group.py#L420 after having some trouble setting the down time lower. but I didn't try the sleep 0.5 thing. but, as I'm typing this, I think we have a way of advancing time in tests with oslo.timeutils. so that would be an ideal way to make this better. I'm gonna see if I can find | |
| 15:33:03 | melwitt | how to do that | |
| 15:33:57 | melwitt | and if that works, I can propose a change to improve test_server_group as well since it's a 10 second slow thing too | |
| 15:34:19 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Use admin neutron client to gather port resource requests https://review.opendev.org/691005 | |
| 15:42:50 | mriedem | ah yeah i forgot about the oslo timeutils stuff | |
| 15:48:25 | mriedem | novaclient 16.0.0 extension list removal also breaks osc https://github.com/openstack/python-openstackclient/blob/45af14ca72b44c03f14189ac61a29253faf03bd7/openstackclient/common/extension.py#L94 | |
| 15:48:26 | mriedem | weee | |
| 16:46:50 | KeithMnemonic | mriedem , melwitt can i ask you some more about the osc thing from yesterday. the simple fix mriedem is not resolving it. i seems to be as you said with how find_resource does the search. but trying to capture/analyze this is ran into something that is probably obvious here but not to me. I can curl compute/servers/detail?deleted=True and get a list of deleted, if I add in the marker to the same curl i get | |
| 16:46:51 | KeithMnemonic | a 401 Unauthroized. any thoughts on why that happens? | |
| 16:47:14 | KeithMnemonic | same token,.... | |
| 16:47:40 | KeithMnemonic | only diff id &marker= . for non deleted it also works with the same token | |
| 16:47:53 | KeithMnemonic | and a marker | |
| 17:05:52 | KeithMnemonic | i figured that part out | |
| 17:15:02 | mriedem | idk off the top of my head why you'd get a 401 in that case | |
| 17:35:28 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: Helper to start computes with different HostInfos https://review.opendev.org/686832 | |
| 17:35:29 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: Functional tests for NUMA live migration https://review.opendev.org/672595 | |
| 17:35:30 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: NUMA LM: Add func test for bug 1845146 https://review.opendev.org/687404 | |
| 17:35:30 | openstack | bug 1845146 in OpenStack Compute (nova) train "NUMA aware live migration failed when vCPU pin set" [High,Fix committed] https://launchpad.net/bugs/1845146 - Assigned to Dan Smith (danms) | |
| 17:38:58 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: NUMA LM: Add func test for bug 1845146 https://review.opendev.org/687404 | |
| 17:38:58 | openstack | bug 1845146 in OpenStack Compute (nova) train "NUMA aware live migration failed when vCPU pin set" [High,Fix committed] https://launchpad.net/bugs/1845146 - Assigned to Dan Smith (danms) | |
| 17:45:08 | openstackgerrit | Eric Fried proposed openstack/os-resource-classes master: Stop testing with py2 https://review.opendev.org/690996 | |
| 17:45:16 | openstackgerrit | Eric Fried proposed openstack/os-traits master: Stop testing with py2 https://review.opendev.org/690997 | |
| 17:59:57 | KeithMnemonic | mriedem i figures out the 401, user error, but your simple fix is not so simple it seems | |
| 18:08:46 | henriqueof | I tried migrating a instance and reverting back now the instance is in error state, how can I recover it? | |
| 18:37:42 | KeithMnemonic | mriedem, the issue is how find_resource works, even if you pass in deleted it does not find it correctly | |
| 19:16:57 | melwitt | #thanks nova api-ref, for existing <3 | |
| 19:16:59 | openstackstatus | melwitt: Added your thanks to Thanks page (https://wiki.openstack.org/wiki/Thanks) | |
| 19:50:06 | mriedem | melwitt: can you hit these few stable/train changes? https://review.opendev.org/#/q/status:open+project:openstack/nova+branch:stable/train one is a regression fix (which makes 2 since train GA) so i'll probably do a release next week | |
| 19:50:21 | melwitt | sure | |
| 19:51:54 | mriedem | thanks | |
| 20:20:48 | openstackgerrit | melanie witt proposed openstack/nova master: Add new policy rule for viewing host status UNKNOWN https://review.opendev.org/679181 | |
| 20:21:50 | melwitt | my functional test magnum opus ^ | |
| 20:24:54 | openstackgerrit | melanie witt proposed openstack/nova master: Add new policy rule for viewing host status UNKNOWN https://review.opendev.org/679181 | |
| 20:27:22 | openstackgerrit | Dustin Cowles proposed openstack/nova master: Provider Config File: Function to further validate and retrieve configs https://review.opendev.org/676029 | |
| 20:27:23 | openstackgerrit | Dustin Cowles proposed openstack/nova master: Provider Config File: Merge provider configs to provider tree https://review.opendev.org/676522 | |
| 20:29:29 | efried | gyee: We can talk in #openstack-doc if you like (about sphinx-feature-classification) | |
| 20:36:19 | mriedem | easy bug fix here https://review.opendev.org/#/c/682622/ | |
| 20:37:12 | mriedem | gibi: just a few things for your patches to enable evacuate with ports + resource requests | |
| 20:37:42 | mriedem | i can be convinced to address those in a follow up if you want | |
| 20:54:15 | efried | melwitt: what was decided about https://blueprints.launchpad.net/nova/+spec/nova-manage-db-purge-task-log ? | |
| 20:54:32 | efried | wishlist bug? | |
| 20:54:37 | efried | So I can kill the bp? | |
| 20:59:11 | efried | nova meeting in #openstack-nova in one minute | |
| 21:00:08 | mriedem | i'll be there boss! | |
| 21:06:20 | gyee | efried, you have a pretty look traceback I presume? :-) | |
| 21:06:56 | efried | gyee: I'll have to unwind my test env to reproduce it, but it wasn't terribly hard. At that point I can... throw you a tarball? | |
| 21:08:17 | gyee | sure | |
| 21:09:20 | mriedem | efried: i was going to request reviews on https://review.opendev.org/#/q/topic:bug/1824435+status:open in the meeting, | |
| 21:09:27 | mriedem | it's a bug fix for an upgrade issue since i think rocky | |
| 21:09:38 | mriedem | *stein | |
| 21:11:01 | efried | looking | |
| 21:20:59 | efried | melwitt, mriedem: +A | |
| 21:21:08 | efried | I remember when we looked at this in April | |
| 21:21:15 | efried | good sleuthing, melwitt | |
| 21:24:44 | mriedem | now to start the backport train to train | |
| 21:32:59 | melwitt | efried: I was planning to ask in the meeting and then blanked and missed it, but some of my team mates were wondering what's the plan for the ptg with making decisions/moving things forward between the in-person attendees and those who are not able to attend? is there going to be an announcement or guideline on the ML? | |
| 21:34:05 | efried | melwitt: I don't anticipate any realtime coordination being possible. I had a vague plan to start picking pieces out of the etherpad and creating ML threads for them. But so far there's... not a lot there. | |
| 21:34:13 | melwitt | efried: I'm gonna try a wishlist bug, so you can kill the bp for now. I'll resurrect it if someone yells at me later | |
| 21:34:31 | efried | ack, iirc that's more or less what we decided last week. | |
| 21:35:22 | efried | melwitt: done | |
| 21:36:57 | melwitt | ok | |
| 21:45:56 | zigo | Heya over here! | |
| 21:46:18 | zigo | When upgrading to train, Octavia kept spawning instances that all went into error. | |
| 21:46:56 | zigo | It's all recovered, but now, I get a lot of instances which are all in error, and when I try to delete them I get: | |
| 21:46:56 | zigo | Failed to delete allocations for consumer 4a795a7d-3d1a-4b90-a5ce-54326ac7f26a. Error: Internal Server Error (HTTP 409) (Request-ID: req-feb5662b-1538-4d87-bb51-0812c8e31bbf) | |
| 21:47:06 | zigo | How can I tell nova to "just do it" ... :) | |
| 21:52:46 | mriedem | is placement up? | |
| 21:52:55 | mriedem | not sure why a 409 would be an internal server error | |
| 21:53:25 | mriedem | zigo: ^ | |
| 21:54:09 | zigo | mriedem: I believe placement is *now* up, but wasn't, or shutdown during the build of these VMs in error, or even, that some record got lost in my galera nightmare ... | |
| 21:54:27 | mriedem | ok if placement is up now can you delete those servers? | |
| 21:55:19 | zigo | Oh, weird, now it looks like working ... | |
| 21:55:23 | zigo | Sorry for the noise. | |
| 21:55:50 | mriedem | yeah, need placement up to delete the server that failed to build because we're tracking resource allocations for that server against some compute node in placement | |
| 21:55:51 | zigo | Maybe *one* of my placement-api server is having difficulties... | |
| 21:55:59 | mriedem | if you just force it you screw up the resource tracking in plcaement | |
| 21:56:21 | zigo | Right. | |
| 21:56:28 | zigo | I'll investigate further ... | |
| 21:59:43 | melwitt | efried: would you expect things to go something like this, 1) efried creates ML threads for topics, 2) ppl weigh in on replies, 3) ptg in-person discussion happens, 4) ptg in-person ppl reply on ML threads, 5) further ML replies from all and work toward agreement on ML? | |
| 22:03:35 | zigo | Yeah, looks like my placement-api on controler #3 is always doing HTTP 500 ... :) | |
| 22:04:14 | efried | melwitt: yeah, something like that | |
| 22:05:07 | efried | where realistically based on past experience I don't expect 2 or 4 or 5 to happen, and anything discussed in 3 will get completely reversed as soon as certain people are paying attention. | |
| 22:05:21 | efried | which is why I haven't been super motivated to start the process. | |
| 22:05:38 | efried | also, efried doesn't have to be the one to initiate 1 | |
| 22:05:46 | efried | so if you have something you want to air, I encourage you to do that. | |
| 22:09:23 | melwitt | efried: understood, thanks. I'll let my team know and encourage them to start ML threads if they want to kick off some discussion | |
| 22:10:43 | efried | Cool. I guess it wouldn't hurt for me to send a primer email to that effect as well. | |
| 22:11:08 | mriedem | i promise i won't certain people it up | |
| 22:11:40 | mriedem | my reply to all post-ptg decisions will be "lol lgtm!" | |
| 22:20:58 | openstackgerrit | Merged openstack/nova stable/train: Revert "vif: Resolve a TODO and update another" https://review.opendev.org/690126 | |
| 22:21:04 | openstackgerrit | Merged openstack/nova stable/train: Add functional regression test for bug 1849409 https://review.opendev.org/690710 | |
| 22:21:04 | openstack | bug 1849409 in OpenStack Compute (nova) train "openstack server list --deleted --limit -1 hangs" [High,In progress] https://launchpad.net/bugs/1849409 - Assigned to Matt Riedemann (mriedem) | |
| 22:29:02 | efried | melwitt: http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010363.html | |
| 22:29:39 | efried | mriedem: a naked +1 will suffice. | |
| 22:29:51 | melwitt | efried: cool, thank you | |
| 22:33:37 | mriedem | naked what now? | |
| 22:35:18 | mriedem | melwitt: speaking of your teammates, lee would probably be grateful if you took a look at this simple bug fix https://review.opendev.org/#/c/682622/ | |
| 22:35:51 | melwitt | mriedem: already reviewing it brah! | |