| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-cyborg - 2018-04-18 | |||
| 14:59:14 | zhipeng | oh yes exactly | |
| 15:03:14 | zhipeng | btw the first week of may I will be traveling to KubeCon EU | |
| 15:03:25 | zhipeng | and will socialize cyborg with the k8s community | |
| 15:03:37 | Li_Liu | g8t | |
| 15:03:38 | zhipeng | if you guys have any design ideas, plz feel free to share it | |
| 15:03:50 | zhipeng | at the moment I only had discussion with Sundar | |
| 15:04:03 | zhipeng | and looks like a CRD controller might be the patch | |
| 15:04:06 | shaohe_feng_ | EU, which country? | |
| 15:04:07 | zhipeng | path... | |
| 15:04:11 | zhipeng | Danmark | |
| 15:04:31 | Li_Liu | interested to see their reactions on Cyborg | |
| 15:04:55 | zhipeng | yes if we were to propose an incubation project something like kube-cyborg | |
| 15:05:06 | zhipeng | would be a very intersting idea :P | |
| 15:05:33 | zhipeng | anyways, still two weeks away, feel free to chime in | |
| 15:05:55 | shaohe_feng_ | zhipeng: sounds good | |
| 15:06:42 | zhipeng | okey if no AoB | |
| 15:06:48 | zhipeng | let's conclude the meeting todday | |
| 15:06:50 | zhipeng | today | |
| 15:06:54 | Coco | ok | |
| 15:06:58 | zhipeng | thx everyone for participating | |
| 15:07:05 | zhipeng | #endmeeting | |
| 15:07:08 | openstack | Meeting ended Wed Apr 18 15:07:05 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | |
| 15:07:09 | openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_cyborg/2018/openstack_cyborg.2018-04-18-14.00.html | |
| 15:07:10 | openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_cyborg/2018/openstack_cyborg.2018-04-18-14.00.txt | |
| 15:07:11 | openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_cyborg/2018/openstack_cyborg.2018-04-18-14.00.log.html | |
| 15:08:59 | openstackgerrit | Merged openstack/python-cyborgclient master: Initialize cyborgclient repository https://review.openstack.org/560400 | |
| #openstack-cyborg - 2018-04-19 | |||
| 18:00:35 | openstackgerrit | Merged openstack/cyborg master: Implemented the Objects and APIs for vf/pf https://review.openstack.org/552734 | |
| #openstack-cyborg - 2018-04-20 | |||
| 07:03:02 | openstackgerrit | jiapei proposed openstack/cyborg master: Fix package import error https://review.openstack.org/562954 | |
| #openstack-cyborg - 2018-04-21 | |||
| 00:47:31 | openstackgerrit | melissaml proposed openstack/python-cyborgclient master: Trivial: Update pypi url to new url https://review.openstack.org/563352 | |
| #openstack-cyborg - 2018-04-23 | |||
| 00:34:54 | openstackgerrit | Sundar Nadathur proposed openstack/cyborg master: Specification for Cyborg Agent-Driver API. https://review.openstack.org/561849 | |
| 00:54:50 | openstackgerrit | Sundar Nadathur proposed openstack/cyborg master: Specification for Cyborg/Nova interaction for scheduling. https://review.openstack.org/554717 | |
| #openstack-cyborg - 2018-04-24 | |||
| 04:39:50 | openstackgerrit | Li Liu proposed openstack/cyborg master: Added cyborg fpga programming spec https://review.openstack.org/559395 | |
| #openstack-cyborg - 2018-04-25 | |||
| 02:25:15 | openstackgerrit | Li Liu proposed openstack/cyborg master: Added bitstream metadata standardization spec https://review.openstack.org/558265 | |
| 13:59:19 | Li_Liu | #info Li Liu | |
| 13:59:21 | zhipeng | #startmeeting openstack-cyborg | |
| 13:59:22 | openstack | Meeting started Wed Apr 25 13:59:21 2018 UTC and is due to finish in 60 minutes. The chair is zhipeng. Information about MeetBot at http://wiki.debian.org/MeetBot. | |
| 13:59:23 | openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | |
| 13:59:25 | openstack | The meeting name has been set to 'openstack_cyborg' | |
| 13:59:34 | zhipeng | #topic Roll Call | |
| 13:59:41 | zhipeng | #info Howard | |
| 13:59:45 | NokMikeR | #info Mike | |
| 13:59:48 | Sundar | #info Sundar | |
| 14:00:16 | Sundar | Hi Howard and Mike | |
| 14:00:27 | NokMikeR | Hello Sundar, Howard et all. | |
| 14:00:37 | circ-user-c3hdH | #info Helloway | |
| 14:00:40 | zhipeng | Hello everyone :) | |
| 14:00:49 | Li_Liu | #info Li Liu | |
| 14:01:10 | Li_Liu | Hi guys | |
| 14:03:15 | shaohe_feng_ | #info shaohe | |
| 14:03:27 | shaohe_feng_ | hi all | |
| 14:03:48 | zhipeng | hi | |
| 14:04:45 | zhipeng | let's start then | |
| 14:05:01 | zhipeng | #topic KubeCon EU ResMgmt WG preparation | |
| 14:05:09 | zhipeng | #link https://docs.google.com/document/d/1j3vrG6BgE0hUDs2e-1ZUegKN4W4Adb1B6oJ6j-4kyPU/edit?usp=sharing | |
| 14:05:29 | xinran_ | Hi all | |
| 14:05:36 | zhipeng | so i think I mentioned that for this year's planning I want to be able to align what we have done here | |
| 14:05:41 | zhipeng | with the k8s community | |
| 14:06:09 | zhipeng | KubeCon EU is around the corner next week, and it would be a great place to start participating | |
| 14:06:27 | edleafe | #info edleafe | |
| 14:06:28 | zhipeng | Sundar could you help share some status about the resource mgmt wg in k8s ? | |
| 14:06:36 | Sundar | Sure | |
| 14:06:49 | Li_Liu | that's great | |
| 14:07:05 | Sundar | We started participating last year, with a document describing the FPGA structure and use cases | |
| 14:07:42 | Sundar | The main thing to note is that the FPGA structural model -- with regions, accelerators, local memory etc. -- is the same independent of orch framework -- openStack, K8s etc | |
| 14:08:21 | Sundar | Also, the use cases defined in the Cyborg/Nova spec stay the same -- FPGA as a Service, Accelerated Function as a Service, etc. | |
| 14:08:25 | Sundar | The main difference is in the set of mechanisms available | |
| 14:09:05 | Sundar | In OpenSTack, we have the notion of nested Resource Providers (nRPs), which provides a natural tree structure that matches many device topologies | |
| 14:09:44 | Sundar | The data models and resource handling in K8s is still evolving | |
| 14:10:46 | Sundar | What we have now is the device plugin mechanism: there is standard API by which kubelet can invoke a plugin for a category of devices | |
| 14:11:41 | Sundar | The plugin advertises a resource name, e.g. intel.com/fpga-a10, and lists the devices corresponding to that. There is also a provision to update that list over time, and to report the health of each device | |
| 14:12:09 | Sundar | Based on this information, when a pod spec asks fora resource, the standard K8s scheduler picks a node and informs the kubelet on that node | |
| 14:12:35 | Sundar | The kubelet then invokes another API on the device plugin to allocate a device of the requested type and prepare it | |
| 14:13:22 | Sundar | After that, the kubelet invokes a container runtime (e.g. Docker) through the CRI with an OCI runtime spec | |
| 14:14:05 | Sundar | This basic mechanism does not include the nested structure of FPGAs, and we have been discussing how to fit that in | |
| 14:14:35 | Sundar | However, there are many options: we can use Custom Resource Definitions (CRDs) https://kubernetes.io/docs/concepts/api-extension/custom-resources/#customresourcedefinitions | |
| 14:14:36 | zhipeng | and vGPU as well I suppose ? | |
| 14:15:11 | Sundar | Howard, yes, I think vGPUs, esp.of different types, will also require further consideration | |
| 14:15:52 | Sundar | CRDs are eseentially custom resource classes: we can instantiate resources for a CRD. | |
| 14:16:33 | Sundar | There are also two ongoing proposals for including resource classes: | |
| 14:16:51 | Sundar | The first one is: https://docs.google.com/document/d/1qKiIVs9AMh2Ua5thhtvWqOqW0MSle_RV3lfriO1Aj6U/edit# | |
| 14:17:28 | Sundar | An alternative proposal for resource classes is at: https://docs.google.com/document/d/1666PPUs4Lz56TqKygcy6mXkNazde-vwA7q4e5H92sUc/edit# | |
| 14:18:04 | Sundar | Thei stated goals and non-goals are not exactly the same. | |
| 14:18:05 | Li_Liu | We don't have access two those 2 google docs.. | |
| 14:18:38 | Sundar | Li_Liu, these are supposed to be public dos -- please ask for access | |
| 14:18:41 | Sundar | *docs | |
| 14:18:50 | Li_Liu | ok, just did | |
| 14:19:26 | zhipeng | Sundar there is a PR on Resource API | |
| 14:19:45 | zhipeng | this is correlates to jiaying's or vish's ? | |
| 14:19:45 | Sundar | IMHO, lot of the discussion comes from GPU background. For FPGAs, we are trying to get alignment within Intel first | |
| 14:20:37 | Sundar | Zhipeng, Jiaying's proposal came first -- but I need to look at the PR before confirming | |
| 14:21:34 | zhipeng | okey :) | |
| 14:21:54 | Sundar | So, in short, our task is to find a way of handling FPGAs, without having the benefit of a tree-structured data model, but handling the same FPGA structures and usage models | |
| 14:21:57 | NokMikeR | is the vGPU is vendor specific? ie tied to a particular driver implementation? | |
| 14:23:03 | Li_Liu | Sundar, does the k8s community have any plans to add the tree-structure data model in the near future? | |
| 14:23:05 | Sundar | NokMikeR, the discussions I have seen have been centered on Nvidia's vGPU types, though not necessarily phrased in vendor-specific terms | |
| 14:23:15 | NokMikeR | in other words how do you differentie the features on one vGPU vs another if the underlying features in the real gpu are different - or are they abstracted somehow? | |
| 14:23:20 | Sundar | Li_Liu, None that I am aware of. | |
| 14:24:14 | NokMikeR | Sundar: ok thought so re: nvid gpus. | |
| 14:24:35 | Sundar | NokMikeR, in OpenStack, the answer is clearer: the device itself exposes different vGPU types as traits, and their capacities as units of a generic accelerator RC | |
| 14:25:44 | Sundar | Cyborg needs to handle GPUs and FPGAs of course. But, IMHO, there is enough attention on GPUs :) It is FPGAs that need further thought :) | |