| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-cyborg - 2019-09-18 | |||
| 07:17:55 | openstackgerrit | chenker proposed openstack/cyborg master: P6: Fix pep8 error in cyborg/agent and cyborg/db https://review.opendev.org/679193 | |
| 07:31:46 | openstackgerrit | chenker proposed openstack/cyborg master: P7: Fix pep8 error in cyborg/objects and cyborg/image https://review.opendev.org/679526 | |
| 07:43:22 | openstackgerrit | chenker proposed openstack/cyborg master: P7: Fix pep8 error in cyborg/objects and cyborg/image https://review.opendev.org/679526 | |
| 07:47:44 | openstackgerrit | chenker proposed openstack/cyborg master: P8: Fix pep8 error in cyborg/tests and add post_mortem_debug.py https://review.opendev.org/679538 | |
| 07:59:14 | openstackgerrit | chenker proposed openstack/cyborg master: P8: Fix pep8 error in cyborg/tests and add post_mortem_debug.py https://review.opendev.org/679538 | |
| 08:01:13 | openstackgerrit | YumengBao proposed openstack/cyborg master: [wip]api part https://review.opendev.org/682820 | |
| 08:01:13 | openstackgerrit | YumengBao proposed openstack/cyborg master: [WIP] P6.0: conductor writes device_profile update to db https://review.opendev.org/679406 | |
| 08:23:15 | openstackgerrit | chenker proposed openstack/cyborg master: P7: Fix pep8 error in cyborg/objects and cyborg/image https://review.opendev.org/679526 | |
| 08:25:11 | openstackgerrit | chenker proposed openstack/cyborg master: P8: Fix pep8 error in cyborg/tests and add post_mortem_debug.py https://review.opendev.org/679538 | |
| 09:09:55 | openstackgerrit | chenker proposed openstack/cyborg master: Fix the hardcoding of user role using sdk_adapter approach https://review.opendev.org/682565 | |
| 09:11:24 | openstackgerrit | chenker proposed openstack/cyborg master: Fix the hardcoding of user role using sdk_adapter approach https://review.opendev.org/682565 | |
| 14:39:23 | openstackgerrit | chenchunxiu proposed openstack/cyborg master: Fix arq api errors in delete and unbind https://review.opendev.org/682913 | |
| 14:41:29 | openstackgerrit | chenchunxiu proposed openstack/cyborg master: Fix arq api errors in delete and unbind https://review.opendev.org/682913 | |
| #openstack-cyborg - 2019-09-19 | |||
| 01:23:12 | openstackgerrit | Shogo Saito proposed openstack/cyborg master: Fix ARQ delete API issue https://review.opendev.org/683013 | |
| 01:57:25 | openstackgerrit | Xinran WANG proposed openstack/cyborg master: bug fixing: let FPGA driver report correct traits when no SRIOV enabled https://review.opendev.org/680953 | |
| 02:42:20 | openstackgerrit | YumengBao proposed openstack/cyborg master: conductor writes device_profile update to db https://review.opendev.org/679406 | |
| 03:00:50 | chenke | Hi | |
| 03:01:01 | shaohe_feng | hi all | |
| 03:01:11 | chenke | hi maxiaoha | |
| 03:01:15 | wangzhh | Hi all. Hi shaohe. | |
| 03:01:59 | Yumeng | hi all | |
| 03:02:28 | Sundar | Hi all | |
| 03:02:43 | Sundar | #startmeeting openstack-cyborg | |
| 03:02:44 | openstack | Meeting started Thu Sep 19 03:02:43 2019 UTC and is due to finish in 60 minutes. The chair is Sundar. Information about MeetBot at http://wiki.debian.org/MeetBot. | |
| 03:02:45 | openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | |
| 03:02:47 | openstack | The meeting name has been set to 'openstack_cyborg' | |
| 03:02:59 | Sundar | #topic Who's here | |
| 03:03:02 | Sundar | o/ | |
| 03:03:08 | chenke | o/ | |
| 03:03:20 | Yumeng | #info Yumeng | |
| 03:03:26 | s_shogo | #info s_shogo | |
| 03:03:32 | wangzhh | #info wangzhh | |
| 03:03:40 | changzhi | #info changzhi | |
| 03:03:49 | chenke | #info chenke | |
| 03:04:00 | Sundar | Hi chenke, Yumeng, s_shogo, wangzhh. Welcome changzhi | |
| 03:04:03 | shaohe_feng | #info shaohe_feng | |
| 03:04:10 | Sundar | Hi shaohe | |
| 03:04:17 | Sundar | #topic Status | |
| 03:04:41 | Sundar | First, thank you all for an active Train cycle. We have hit feature feeze a week ago | |
| 03:05:00 | Sundar | SO also did other projects. | |
| 03:05:41 | Sundar | The good news: Cyborg side of the Nova integration is pretty much done. We just need to clean up the way we invoke other services | |
| 03:06:07 | chenke | Great | |
| 03:06:24 | wangzhh | Cool | |
| 03:06:33 | Sundar | Not so good news: Our Nova patches did not enough reviews from Nova developers, and so did not make the cut. | |
| 03:07:24 | Sundar | Part of the problem is that, Cyborg patches were open for a long time, so Nova developers did not see it as ready, though we could put up a VM with Cyborg + Nova patches | |
| 03:08:16 | Sundar | Also, there was a longstanding request to show tempest CI working. That completed exactly in the milestone week. That was too late to get sustained reviews. | |
| 03:08:23 | shaohe_feng | We know intigration is a big effort | |
| 03:08:45 | shaohe_feng | Sundar: you d a lot of effort. Thanks | |
| 03:09:42 | chenke | It is understandable the patch in nova be merged slowly. | |
| 03:09:51 | Sundar | NP, thanks Shaohe. I am optimistic about U because I think we are close. and I have re-proposed the Nova spec. This time, tempest and most things are merged. Things that attratc croos-project attention, like tempest, privsep, sdk_adapter stuff, etc. are all done or making good progress | |
| 03:10:36 | Sundar | Hope to get the Nova patches in the runway very early in the cycle. The more we wait, the more things get bogged down among the tons of other reviews. | |
| 03:11:28 | Sundar | That said, we have a few more things to wrap up in Train :) | |
| 03:12:12 | Sundar | First, remove the hardcoding of 'dvstack-admin'. Thanks, chenker and all for addressing that :) | |
| 03:12:47 | Sundar | Second, v1 API is deprecated but still supported in Train. But it is not working because we removed all v1 from devstack. I should re-enable it, I think | |
| 03:13:28 | xinranwang | #info xinranwang | |
| 03:13:31 | Sundar | SHaohe's async bind, privsep, rbac are important | |
| 03:13:36 | xinranwang | Hi all | |
| 03:14:05 | Sundar | I think all the pep8/flake fixes from chenker/zhurong are looking good and will probably merge this week | |
| 03:14:33 | Sundar | Can you all think of anything else? | |
| 03:14:44 | Yumeng | Sundar: and please don't forget update device_profile db by conductor:https://review.opendev.org/#/c/679406/ | |
| 03:14:48 | Yumeng | just updated | |
| 03:15:06 | shaohe_feng | Sundar remain some slot for me to introduce the async jobs, so other's can easily to review it. | |
| 03:15:17 | shaohe_feng | Thanks | |
| 03:15:25 | Yumeng | and this gpu fix :https://review.opendev.org/#/c/675059/ I tested in my devstack env, it works | |
| 03:15:57 | Sundar | Ah yes, that too, Yumeng :) There are quite a few patches up there, including https://review.opendev.org/680953. | |
| 03:16:26 | Sundar | Sure, let's knock off as much as we can. Was just listing the ones critical to complete in Train | |
| 03:16:35 | openstackgerrit | Merged openstack/cyborg master: P5: Fix pep8 error in cyborg/accelerator https://review.opendev.org/679175 | |
| 03:16:54 | Sundar | shaohe_feng: Sure | |
| 03:17:15 | Sundar | Folks, anything else before we dive into Shaohe's async bind? | |
| 03:18:01 | s_shogo | I'm starting test&validation task, with real machine , begin with common functions, independet from specific accelerators. | |
| 03:18:11 | s_shogo | If extracted some bugs or erros, report that or post patches till the Train release. | |
| 03:19:36 | Sundar | Sure, s_shogo. I think the client effort can be aimed early in U release, since the Train release milestone for clients is past | |
| 03:19:41 | Sundar | I have some questions on RBAC: https://review.opendev.org/#/c/678177/ . In https://review.opendev.org/#/c/678177/3/cyborg/common/policy.py@83, should it be allow rule? ANybody can create an ARQ and thereby bind that ARQ, and so program an FPGA? | |
| 03:21:11 | s_shogo | Sundar: OK, I'll do the client&sdk task continuously, to the U release. | |
| 03:22:26 | Sundar | wangzhh: What do you think? | |
| 03:22:33 | xinranwang | should we complete v2 API in T? | |
| 03:23:09 | wangzhh | Sundar, it should be allowed and recheck it in the method if it is a program action or not. | |
| 03:23:29 | Sundar | wangzhh: ok | |
| 03:23:51 | Sundar | xinranwang: Only devices API remains. We are supposed to merge only bug fixes, I think. So, it will probably go to U. Is anything else remaining? | |
| 03:25:30 | Sundar | OK, 35 min remaining. Let's move to async bind. | |
| 03:25:41 | Sundar | #topic Async bind | |
| 03:25:54 | Sundar | Shaohe, take it away! | |
| 03:26:05 | shaohe_feng | Now let's we start to introduce async bind. Any questions can fafter the introduction. | |
| 03:26:12 | shaohe_feng | Briefly put, bind is to find a suitable device(maybe PCI, or MDEV) on the right host for a server instance to use. | |
| 03:26:18 | shaohe_feng | So what's the suitable device, we need a spec to describe it. | |
| 03:26:25 | shaohe_feng | On v1 we discribe the device directly on nova flavor extra spec, and cyborg parser the spec, Xinran implement this work. | |
| 03:26:32 | shaohe_feng | On v2, after the PTG discussion, we define it in cyborgs owen Device Pofile. And Sundar implement it. | |
| 03:26:43 | shaohe_feng | I have no chance to attend PTG for discussion, More details please talk with Sundar. | |
| 03:26:50 | shaohe_feng | Thans Xinran and Sundar's effor. | |
| 03:26:59 | shaohe_feng | Before we introduce async bind, let's know some implement(rules) in the current code firstly. | |
| 03:27:08 | shaohe_feng | profile group in order to get the expected devices. | |
| 03:27:08 | shaohe_feng | 1. The AtachHandler in ExtARQ is not a list, so only one AtachHandler(one devcie for ARQ) | |
| 03:27:19 | shaohe_feng | Now Our cyborg ARQ API bind API is sync, be we define it as async, so need to improve. | |
| 03:27:28 | shaohe_feng | So what we changed: | |
| 03:27:43 | shaohe_feng | 1. Use a thread pool to start the async job. | |
| 03:27:49 | shaohe_feng | In cyborg spec, sundar suggests use concurrent, yes it is a python stand lib. See python office link: | |
| 03:27:57 | shaohe_feng | https://docs.python.org/3/library/concurrent.futures.html | |
| 03:28:05 | shaohe_feng | Also we can greening it by greenlet. patched it by eventlet. | |
| 03:28:11 | shaohe_feng | utures = eventlet.import_patched('concurrent.futures') # 'greening' futures, | |
| 03:28:13 | openstackgerrit | Merged openstack/cyborg master: P6: Fix pep8 error in cyborg/agent and cyborg/db https://review.opendev.org/679193 | |