Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2020-02-07
10:34:40 stephenfin gibi++ Thanks /o\ :)
10:34:44 gibi no problem
10:34:48 stephenfin I'd been staring at that for an hour
10:34:50 gibi the error message was deeply missleading
10:35:01 stephenfin Yuuup. Bad coincidence :)
10:35:27 gibi yepp
10:50:40 openstackgerrit Stephen Finucane proposed openstack/nova master: Remove universal wheel configuration https://review.opendev.org/706466
11:02:26 openstackgerrit Brin Zhang proposed openstack/nova master: Add new default roles in os-instance-actions policies https://review.opendev.org/706470
11:05:12 lyarwood stephenfin: sorry missed that, still need me to take a look?
11:05:25 stephenfin lyarwood: Nope, we sussed it
11:05:45 lyarwood wonderful
11:06:47 openstackgerrit Stephen Finucane proposed openstack/nova master: WIP: Use neutronclient's port binding APIs https://review.opendev.org/706295
14:19:04 openstackgerrit Huachang Wang proposed openstack/nova-specs master: Use PCPU and VCPU in one instance https://review.opendev.org/668656
14:30:35 huaqiang stephenfin:sean-k-mooney:alex_xu spec https://review.opendev.org/668656 is updated, hope you guys have time to review it before freezing day
14:49:09 stephenfin gibi: Comments left on https://review.opendev.org/#/c/704759/
14:49:23 stephenfin huaqiang: Ack. I'll hit that next Tuesday (spec review day)
14:55:07 huaqiang stephenfin: appreciate!
14:56:24 gibi stephenfin: thanks. I will check
15:01:58 openstackgerrit Brin Zhang proposed openstack/nova master: Add new default roles in os-instance-actions policies https://review.opendev.org/706470
15:05:53 openstackgerrit Martin Midolesov proposed openstack/nova master: Implementing graceful shutdown. https://review.opendev.org/666245
15:22:18 openstackgerrit Brin Zhang proposed openstack/nova master: Add SYSTEM_READER role to servers actions API https://review.opendev.org/706179
15:26:33 kashyap efried: Want to have a stab at this spec? Already approved previously; and has a +2: https://review.opendev.org/#/c/693844/
15:29:18 Sundar dansmith, gibi, sean-k-mooney, efried: About https://review.opendev.org/#/c/706083/, this is a refactor that affects pci requests, numa topology etc. that are not related to the Cyborg patch. I see that some of you are noncommittal and, in any case, probably needs further discussion. The Cyborg series is already long in the tooth; if we add this
15:29:19 Sundar up the main series.
15:29:19 Sundar general refactor, keeping that entire context in our minds will only prolong our efforts and strain. Plus, some of us are hitting time constraints. What do you think of considering the series as it is now, and feel free to add refactors on top of that later? Both of them could even go concurrently, but the discussions on the refactor need not hold
15:31:52 Sundar Just to be clear, I am not objecting to the refactoring. I am fine either way and can contribute to the reviews.
15:33:25 sean-k-mooney Sundar: im currently planing to redeploy with the code you pushed yesterday.
15:33:37 Sundar sean-k-mooney: Thanks.
15:33:45 sean-k-mooney i found that with the previous version i was unable to delete the cyborg vm
15:34:01 sean-k-mooney the conductor was not able to delete the arp binding
15:34:33 sean-k-mooney i was able to manually do it but could still not delete the nova vm
15:34:46 sean-k-mooney ill see if i hit the same issue with the new version and let you know
15:35:41 Sundar I see. In the worst case, for development purposes only, once could delete the ARQs using curl.
15:36:00 sean-k-mooney yes but you still cannot delte the nova vm
15:36:01 Sundar Sure. You are also updating the Cyborg side, right?
15:36:07 sean-k-mooney yep
15:36:31 sean-k-mooney i delete all my repos and confirm it pulle the correct version if i also set CYBORG_REPO and CYBORG_BRANCH
15:37:04 Sundar Could you expand on what you mean by Nova VM? Different from a devstack all-in-1 setup?
15:37:43 sean-k-mooney i mean if i do openstack server delete <uuid of vm with fake cyborg device> then you cant delete it
15:37:58 gibi Sundar: I agree that such refactor could move the focus away from the goal to merge the cyborg integration code to nova. And I understand the time pressure here. I'm fine doing the refactor on top of the series
15:38:23 sean-k-mooney the conductor got an unexpected reponce code form cyborg and the delete failed
15:38:56 gibi Sundar: I'm reviewing the series as we speak
15:39:56 sean-k-mooney Sundar: this could be related to the error handeling you and dansmith were talking about. i did not dig into it as it was late when i tried to delete the vm
15:40:20 sean-k-mooney Sundar: im going to recreate teh env with the latest version and see if the issue is still there
15:54:36 Sundar gibi: Thanks
15:55:18 Sundar sean-k-mooney: Please let me know how it goes. I may get on phone calls once in a while but I'll be around all morning PST.
15:58:39 efried Sundar: The refactor is already "on top" of the series, not folded in the middle. It shouldn't block anything else.
15:58:54 efried (It's on top of a patch that's in the middle, but it's its own tip)
15:59:22 efried I just put it out there to get agreement with dansmith about what the refactor should look like, and to satisfy myself that it could be done without too much trouble, so that I could be okay with the preceding patch as it is.
15:59:37 efried kashyap: ack, in queue
16:00:09 kashyap Thank you.
16:03:44 sean-k-mooney efried: which patch is the refactor https://review.opendev.org/#/c/706083/1 you dont mean https://review.opendev.org/#/c/704227/11 right
16:03:59 sean-k-mooney im planning to deploy https://review.opendev.org/#/c/704227/11
16:04:00 efried the former
16:04:05 sean-k-mooney cool
16:05:52 mriedem dansmith: +2 on your hidden=null fix in case efried or melwitt want to approve
16:07:52 spatel sean-k-mooney: hey! i have few more question related NUMA, I did lots of testing with erlang and have pretty good result with numa tuning
16:08:09 sean-k-mooney thats good to hear
16:08:27 sean-k-mooney so memory seams to be your bottleneck then
16:08:35 spatel when i create vm with 16vcpu core just running on single numa node then result is freaking good
16:08:37 dansmith mriedem: thanks
16:09:00 spatel but if i create vm with 32vCPU and set numa_node=2 in flavor in that case result is 70% worst
16:09:49 spatel now question is how do i tell openstack to pin down vCPU with pCPU 1-0-1 ?
16:10:44 spatel I do have hw:cpu_policy=dedicated policy but its randomly mapping vCPU <--> pCPU
16:11:09 spatel sean-k-mooney: what do you suggest here?
16:11:43 spatel In short i want to make my VM fully NUMA map like bare metal has.
16:14:26 sean-k-mooney spatel: so it look like the erlang applciation is not numa aware
16:14:56 spatel sean-k-mooney: but if same erlang application i am running on bare metal it does work and result is good
16:14:59 sean-k-mooney meaning it is internally not numa affinitising its memory allocations
16:16:11 sean-k-mooney spatel: wehn you set hw:cpu_policy deicated it does a 1:1 mapping between cores on a virtual numa node to the a host numa node
16:16:24 spatel i thought if somehow openstack pin vcpu0 <--> pcpu0 , vcpu1 <--> pcpu1 so on... that would be great
16:16:30 sean-k-mooney so its not random it is numa aware
16:16:42 sean-k-mooney spatel: no it does not by design
16:17:05 spatel sean-k-mooney: look at this current mapping - http://paste.openstack.org/show/789225/
16:17:11 sean-k-mooney but it will map all fo the cores in one geust numa node to the a singel numa node on the host
16:17:45 sean-k-mooney thats takeing a long time to load for some reason
16:18:47 sean-k-mooney paste.openstack.org is down for me it seams
16:19:21 lyarwood https://review.opendev.org/#/c/701430/ - trying to get my head around the required api samples for a microversion that changes behaviour but nothing in the request or response, does anyone know what I would need to add here?
16:19:30 sean-k-mooney ok it finally loaded
16:20:10 sean-k-mooney spatel: how many cores to you have on the host
16:20:54 sean-k-mooney im assuming the are 16 core cpus and you have hypter treading enabled?
16:22:22 sean-k-mooney spatel: can you provide the host capablities xml and the full guest xml
16:22:42 spatel Give me few min.. i am on phone..
16:24:14 sean-k-mooney spatel: ok that xml fragment does not really look correct.
16:36:46 efried dansmith: I can push https://review.opendev.org/#/c/706331/ if you don't plan to reword that reno.
16:37:03 dansmith efried: it makes sense to me and nobody else has suggestions right?
16:38:21 efried dansmith: let me take a real swing at a reword. If I can't come up with something I like, I'll push it.
16:41:10 efried dansmith: do db migrations happen automatically as part of the upgrade process, or do users have to trigger them manually? (Or does it depend on the distro?)
16:41:24 dansmith efried: depends a lot
16:46:01 efried dansmith: done, see what you think.
16:46:29 efried dansmith: for me, the distinction of "apply the fix" versus "install a version that includes the fix" is where the confusion lies.
16:47:11 dansmith I totes don't get the substantive difference between your sentences and mine, but as such I'll be glad to change it.. just a sec
16:48:18 efried mriedem: if you're around -- does my suggestion improve anything IYO?
16:48:44 openstackgerrit Dan Smith proposed openstack/nova master: Fix instance.hidden migration and querying https://review.opendev.org/706331
16:48:46 efried It becomes hard to see anymore having discussed it to death
16:49:11 efried dansmith: coulda added the link while you were at it :P
16:49:19 dansmith guh, will fix
16:49:27 dansmith working on the patch above this so I wanted to get back to that
16:50:17 openstackgerrit Dan Smith proposed openstack/nova master: Fix instance.hidden migration and querying https://review.opendev.org/706331
16:50:26 dansmith efried: please check before I roll my tree forward again :)

Earlier   Later