| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-cyborg - 2017-11-15 | |||
| 15:45:05 | zhipeng | yes because the current support for Nova is good enough | |
| 15:45:08 | zhipeng | to set it up | |
| 15:45:11 | masuberu | ok | |
| 15:45:18 | masuberu | what about overhead? | |
| 15:45:36 | zhipeng | what type of overhead you are thinking about ? | |
| 15:45:38 | masuberu | is it going to have much overhead due to virtualization? | |
| 15:45:50 | zhipeng | i think that depends | |
| 15:46:05 | zhipeng | how you setup the workload between VM and FPGA | |
| 15:46:37 | masuberu | ok, is there anything I can read about that? because I don't know much to be honest | |
| 15:46:46 | zhipeng | for example if you gonna have FPGA do all the GATK heavy lifting and VM just for running a data pipe application | |
| 15:46:53 | masuberu | and I want to get the most of this project | |
| 15:47:04 | zhipeng | i don't think there will be much overhead | |
| 15:47:05 | masuberu | I don't know for how long I can have the FPGAs | |
| 15:47:54 | masuberu | lets say we decide to run on the numa nodes, then I can even enable cpu afinity | |
| 15:48:10 | masuberu | to make sure process use local memory | |
| 15:48:16 | masuberu | but that is a different story | |
| 15:48:31 | zhipeng | yes | |
| 15:48:48 | masuberu | I am more worry about the lack of documentation about openstack+FPGAs | |
| 15:49:16 | zhipeng | you can just go through the nova pci support docs | |
| 15:49:16 | masuberu | also we have another project coming to run GPUs for machine learning stuff | |
| 15:49:39 | masuberu | but that will come in 3-4 months time | |
| 15:49:46 | masuberu | ok | |
| 15:49:50 | zhipeng | cool :) | |
| 15:50:00 | masuberu | another thing I normally deploy openstack using kolla... | |
| 15:50:10 | masuberu | kolla-ansible, not sure if that will be an issue | |
| 15:50:14 | zhipeng | crushil | |
| 15:50:29 | zhipeng | any thoughts on making cyborg kolla-able ? :P | |
| 15:51:01 | crushil | zhipeng, My coworker who presented for us is kolla-kubernetes core | |
| 15:51:12 | masuberu | nice | |
| 15:51:13 | crushil | I'm working with him to get Cyborg kollafied | |
| 15:51:24 | zhipeng | masuberu there you go :) | |
| 15:51:24 | masuberu | that's cool | |
| 15:51:32 | zhipeng | we have everyone you need in cyborg :P | |
| 15:51:36 | crushil | It's already on my plate for a future sprint | |
| 15:51:52 | masuberu | I am quite flexible we can do whatever we want with this nodes as they are running nothing | |
| 15:52:19 | zhipeng | masuberu just give a howler any time you have an issue on this channel | |
| 15:52:45 | zhipeng | core members are always logged in , so as long as any of us are awake, we will respond :) | |
| 15:52:47 | crushil | Btw you should play with this tool https://review.openstack.org/#/c/487972/. I will be integrating Cyborg into this tool | |
| 15:53:13 | zhipeng | you could also just send email to the openstack-dev mailinglist, or openstack-ops | |
| 15:55:07 | masuberu | I think I know rwellum | |
| 15:55:33 | masuberu | ok | |
| 15:56:02 | masuberu | by the way GATK4 is just a jar file | |
| 15:56:10 | masuberu | very simple to install and run | |
| 15:57:04 | masuberu | is it possible to share an FPGU with multiple instances? | |
| 15:57:25 | masuberu | or do I need to assign 1 FPGU card per vm? | |
| 15:57:31 | LiLiu_ | if the FPGA has multiple PFs/VFs, then yes | |
| 15:58:08 | LiLiu_ | It really depends on how the IP is developed | |
| 15:58:45 | masuberu | ok, and the FPGUs has cores? | |
| 15:59:29 | LiLiu_ | nope | |
| 15:59:44 | masuberu | I mean can I break the resources of a FPGU card and assign it to multiple vms? | |
| 15:59:50 | LiLiu_ | FPGA can be virtualized and shared by multiple VMs | |
| 16:00:01 | LiLiu_ | you are right | |
| 16:00:40 | masuberu | for example with memory and cpus I can "define" flavors, can I do same with FPGUs? | |
| 16:01:08 | LiLiu_ | yup | |
| 16:01:31 | LiLiu_ | That's one of the most common ways of managing FPGA in Openstack | |
| 16:01:46 | masuberu | like for instance 0.3Teraflops for one instance and 0.7Teraflops to another | |
| 16:01:49 | masuberu | ok | |
| 16:02:08 | LiLiu_ | That's totally doable | |
| 16:02:21 | masuberu | do you have experience with openhpc? | |
| 16:02:40 | LiLiu_ | I don | |
| 16:02:47 | masuberu | we run rocks cluster but the development is quite slow, I am wondering whether openhpc would be better option | |
| 16:02:50 | masuberu | ok | |
| 16:02:55 | LiLiu_ | but I know someone in my team might do | |
| 16:03:32 | masuberu | ok, thats ok, let try and focus on these tests comparing GATK4 on FPGUs vs Apache Spark | |
| 16:03:49 | masuberu | maybe this type of tests doesn't even makes sense, we will see | |
| 16:04:22 | masuberu | so I will get the cards tomorrow and connected to the servers | |
| 16:04:56 | LiLiu_ | sure | |
| 16:05:04 | masuberu | and from there if anyone know any document about how to integrate nova with fpgus or if there is any document/tool within cyborg project just let me know | |
| 16:06:44 | LiLiu_ | before cyborg is ready to use, I think the most naive way is just use PCI passthrough | |
| 16:07:17 | masuberu | sure | |
| 16:13:31 | crushil | zhipeng, Don't forget to close the meeting | |
| 16:13:50 | zhipeng | of course :) | |
| 16:14:01 | zhipeng | if nothing else, we had a great discussion today | |
| 16:14:07 | zhipeng | the meeting is adjourned | |
| 16:14:22 | zhipeng | and I will let everyone know the new ZOOM meeting time | |
| 16:14:28 | zhipeng | #endmeeting | |
| 16:14:30 | openstack | Meeting ended Wed Nov 15 16:14:28 2017 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | |
| 16:14:31 | openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_cyborg/2017/openstack_cyborg.2017-11-15-15.00.html | |
| 16:14:32 | openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_cyborg/2017/openstack_cyborg.2017-11-15-15.00.txt | |
| 16:14:34 | openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_cyborg/2017/openstack_cyborg.2017-11-15-15.00.log.html | |
| 16:22:04 | masuberu | thank you all | |
| 16:22:28 | masuberu | and sorry I hijack the whole meeting, I guess you probably had other things to talk | |
| 16:22:47 | masuberu | it is 3.22am here so I am going to sleep now | |
| 16:23:30 | masuberu | please feel free to send me an email if any idea pops up manuel.sb@garvan.org.au or masber@hotmail.com | |
| 16:23:35 | masuberu | nite | |
| 16:26:56 | zhipeng | nite :) | |
| 16:50:23 | jkilpatr | did we start at 10am this time? I was off by an hour :( | |
| #openstack-cyborg - 2017-11-17 | |||
| 14:17:43 | zhipeng | jkilpatr ttk2[m] i've written a coarse draft for my idea mentioned last team meeting | |
| 14:17:48 | zhipeng | https://etherpad.openstack.org/p/cyborg-feature-tag | |
| 14:19:26 | ttk2[m] | zhipeng: so lets say we do this and people can schedule based on types, is their application now responsible fo rhandling supporting all the different types of accerlators they may get with the same request? | |
| 14:19:35 | ttk2[m] | I guss you can narrow it down | |
| 14:20:04 | ttk2[m] | deep learning + cuda X support = get different types of gpu's but the code alway sworks | |
| 14:24:55 | zhipengh[m] | That is another important part if the equation needs to be solved | |
| 14:25:19 | zhipengh[m] | But for HPC and NFV, it should work without too much trouble | |
| 14:26:12 | zhipengh[m] | For preloaded FPGA programs | |
| 14:29:38 | ttk2[m] | well yes, provided we handle compatibility checking behind the scenes some. | |
| 15:35:24 | zhipengh[m] | ttk2: the main point here is about scalability. Name and type won't get us far for accelerator, that is the fundamental problem for us | |
| 15:36:02 | ttk2[m] | how so? too specific? | |
| 15:37:12 | zhipengh[m] | Yep, especially for FPGA | |
| #openstack-cyborg - 2017-11-22 | |||
| 03:04:39 | zhuli | Rushil, Justin around? | |