Earlier  
Posted Nick Remark
#openstack-cyborg - 2019-04-24
03:11:11 Coco_gao 10min if no other people join, because we all familar with the project status.
03:11:26 Coco_gao Sundar, agree with yikun
03:11:38 Sundar yikun: ok. The main topics in my mind are: Train Goals, Networked FPGAs, mapping names to UUIDs, new drivers/devices (incl. Ascend)
03:11:39 Coco_gao Better to classify
03:12:15 wangzhh Yikun, do you need more time for topic #line 58?
03:12:16 Sundar Some of them are cross-cutting across these categories, esp. first 2
03:12:52 yikun wangzhh: checking...
03:13:56 yikun wangzhh: bitstream management? So what's the "more time" mean? you mean the more time to discuss in PTG?
03:14:42 wangzhh Yep, I saw you leave comment 'expand the bitstream to more generic level'. So...
03:14:50 Sundar yikun, all: In my mind, bitstream mgmt means Cyborg provides APIs to parse metadata for bitstreams, validate and upload in Glance. What else do you have in mind?
03:15:37 Sundar I think firmware update etc. are usually done as part of host config, with pupper/ansible/...
03:15:54 Sundar *puppet
03:16:12 yikun wangzhh: ok, make sense, it is just some idea for "Do not provide specific API for specific type driver."
03:16:49 wangzhh Got it.
03:16:51 ikuo_o Sundar: I'm thinking bitstream md5 checksum to check integrity.
03:16:55 Coco_gao I thought there were a generic Driver in code, but we don't use that or inherit from that.
03:17:51 Sundar ikuo_o: That is up to the vendor stack, because they may use different checksums, authentication/decryption schemes, or even do it in hardware in some cases
03:18:13 Coco_gao About the bug, do we need specific time for that?
03:18:14 wangzhh Coco, Yep, but, actually, it is out of date. Should be improved as our new design.
03:18:22 yikun Coco_gao: yes, https://github.com/openstack/cyborg/blob/master/cyborg/accelerator/drivers/generic_driver.py
03:18:49 Coco_gao Thanks, yikun. The generic driver is too old.
03:18:55 Sundar Have you all looked at the driver API in Line 396 https://review.opendev.org/#/c/608624/4/specs/stein/approved/cyborg-api-wflows-for-instance-ops.rst ? The can_handle API can be dropped but can you review the rest?
03:20:07 yikun So these APIs is belong to the generic_driver.py?
03:20:55 Sundar Anyways, I'll take a first stab like this: 30 min each for Train Goals, Networked FPGAs, mapping names to UUIDs, new drivers/devices, NTT's discussion. That is 2.5 hours. Now we can add more time to some of these topics and fit more on Friday
03:20:56 Coco_gao Sundar, OK
03:21:32 yikun Sundar: sounds good
03:21:33 Sundar May be new devices needs more time
03:22:13 ikuo_o Thanks, Sundar!
03:22:53 Sundar ikuo_o: Welcome :)
03:23:03 Coco_gao I need some time in Friday to dicuss the dirty data caused by conductor diff.
03:23:29 Sundar Coco_gao: Good. Conductor diff: 15-30 min?
03:23:37 Coco_gao That's good
03:23:51 Sundar PCI slot change on reboot -- why is it any different than Nova's PCI subsystem?
03:25:34 Coco_gao I will make sure with shaohe, and see if we need to discuss that.
03:25:51 Sundar wangzhh, Coco_gao: any performance countres planned for GPUs? I am thinking just report driver-reported perf counters from agent to a collectd plugin. From there, it can be consumed by telemetry/ceilometer, prometheus, ....
03:25:53 Coco_gao Right now , we can skip that
03:26:04 Sundar Coco_gao: ok
03:27:45 yikun Who is the owner of L42 idea? I plus some info on it
03:28:24 Sundar yikun: do you mean SmartNIC?
03:28:33 yikun "Performance/health monitoring for GPUs or any other devices?"
03:30:01 wangzhh Whuuu, difficult to monitor it now, because when we passthrough the GPU in the vm. Host will lost control of this device. I'll consider about that.
03:30:36 Sundar yikun: I responded too. I would like to find an owner.
03:31:00 ikuo_o I'm not the owner but the function seems useful.
03:31:08 wangzhh Does FPGA or other devices have the same scenario?
03:31:10 Sundar wangzhh: yea, same problem for FPGAs, but we should have the PF in the host from where we can get shell counters.
03:31:45 Sundar Besides, we also have dependence on the vendor stack
03:32:04 Sundar yikun: Does Ascend support SR-IOV?
03:32:27 wangzhh Sundar, Yep. Depend on vendor stack.
03:33:58 Sundar If Ascend supports SR-IOV, and we can get performance counters from its PF, we have a potential use case. Otherwise, we'll focus on other practical things and then come to this.
03:35:14 yikun Sundar: ascend 310 don't support sr-iov yet
03:35:25 Sundar Then shall we deprioritize this topic for PTG?
03:36:00 xinranwang ascend support entire pci passthrough right
03:36:05 yikun yes
03:36:26 yikun passthrough is supported.
03:36:44 wangzhh Sundar, Depend on the priorities and our time.
03:36:46 yikun Sundar: I think we still can add this topic in PTG
03:37:16 Sundar OK, I only said de-prioritized. So, if there's time after topics, sure
03:37:46 Sundar Driver support for Movidius - who owns this?
03:38:05 yikun Shaohe?
03:38:06 xinranwang Sundar: i think is Shaohe
03:38:08 Coco_gao Coco
03:38:37 Sundar RISC-V?
03:39:06 Coco_gao We use Movidius in the Edge.
03:39:32 yikun Movidius is a USB device, right?
03:39:33 Sundar Coco_gao: Cool. Maybe both you and Shaohe can drive it?
03:39:42 Coco_gao Yes
03:40:38 Coco_gao It's USB right now, in order to use it, we need to install openvino
03:40:44 Sundar I should a topic for post-PTG plans. That's important. Merge pilot with master, add FPGA CI, etc. are important for Nova intgration
03:41:03 Coco_gao Sundar, agree
03:41:17 Coco_gao the most important thing is nova integration
03:41:28 yikun Sundar: thanks for your hard work, and the pilot is the most import one.
03:41:38 yikun * important
03:42:46 Sundar Xinranwang is looking at tempest plugins for Cyborg CI, right? I can help her. Anybody else wants to help? It will be a set of CI test cases. So, could be lots of work.
03:43:25 xinranwang yes, that's also a part of post ptg plan
03:44:11 wangzhh I can take part of these if it is not emergency.
03:44:49 Sundar wangzhh: It is not an emergency, but until we get the CI going, Nova will probably not merge.
03:45:35 Sundar Please see https://etherpad.openstack.org/p/ptg-train-xproj-nova-cyborg
03:45:52 xinranwang does nova guys require to have CI done before they merge?
03:46:03 Yumeng I can also join once there is time.
03:46:33 Yumeng btw, my visa is still on administrative processing. only 4days to go. I'm highly probably not be able to attend the summit and ptg. the new project update looks great for me!
03:46:36 xinranwang thanks wangzhh Yumeng
03:46:38 Sundar xinranwang: Please see that link.
03:47:27 Sundar Yumeng: That's tough. We'll keep you updated
03:47:44 Sundar Thanks for the slides review
03:48:01 Yumeng but I will join remotely, will we have remote access just like last ptg did?
03:48:12 xinranwang Sundar: ok, will look into it. Thanks
03:48:43 Sundar Yumeng: I'll check and get back
03:48:59 Yumeng Sundar:ok. thanks
03:49:31 xinranwang nice to have remote access, I can join remotely also :)
03:50:00 Sundar @all, shall I take a stab at time assignments based on the above, and you can add your comments if you want changes?
03:52:36 Sundar Silence means yes, I think :)
03:52:48 ikuo_o It's ok.
03:53:08 Sundar OK, cool. I'll update and ping you all
03:53:24 Sundar #topic Tomorrow's Zoom meeting
03:54:01 Sundar I will present the PTG demo. This is highly important to get consensus across projects. Please attend and provide your feedback.
03:54:21 ikuo_o I will attend the meeting.
03:54:22 Sundar Should we take up anything else tomorrow?
03:54:31 Sundar ikuo_o: Thanks
03:55:14 ikuo_o I'm preparing material for PTG, but nothing for tomorrow.
03:55:30 Sundar Cool.

Earlier   Later