Presentation
Building Efficient Clouds for HPC, Big Data, and Deep Learning Middleware and Applications
BoF Organizer/Speakers
Event Type
Birds of a Feather
AI/Machine Learning/Deep Learning
Clouds and Distributed Computing
Containerized HPC
Networks
System Software & Runtime Systems
TimeWednesday, June 27th1:45pm - 2:45pm
LocationPikkolo
DescriptionSignificant growth has been witnessed during the last few years in HPC clusters with multi-/many-core processors, accelerators, and high-performance interconnects (e.g., InfiniBand/Omni-Path/RoCE). To alleviate the cost burden, sharing HPC cluster resources to end users through virtualization is becoming more attractive. The recently introduced Single Root I/O Virtualization (SR-IOV) technique for InfiniBand and High-Speed Ethernet provides native I/O virtualization capabilities and is changing the landscape of HPC virtualization. In this context, the proposed BoF will organize several talks and discussions with the audience on the following aspects.
Goal: Involving all the speakers and the audience to identify the most critical challenges facing the community in building efficient clouds with virtual machines and containers for running HPC, Big Data, and Deep Learning middleware and applications on modern HPC and data center architectures with high-performance interconnects, SR-IOV, accelerators, and storage technologies.
Topic: Discussions on the opportunities and technical challenges of designing high-performance HPC/Big Data/Deep Learning runtime over cloud environments. Demonstration on how high-performance solutions can be designed to run HPC, Big Data, and Deep Learning workloads (like MPI, Hadoop, Spark, TensorFlow) in clouds. Soliciting all kinds of feedback from the audience to come up with a roadmap for the next 5 - 10 years about how to efficiently handle these grand challenges associated with building efficient HPC clouds.
Speakers in this BoF include:
- Burak Yenier, UberCloud
- Christian Kniep, Docker GmbH
- Tor Skie, Univ. of Oslo, Norway
- Dhabaleswar K. (DK) Panda, The Ohio State University
WebURL: http://web.cse.ohio-state.edu/~lu.932/bofs/cloud-isc2018
Goal: Involving all the speakers and the audience to identify the most critical challenges facing the community in building efficient clouds with virtual machines and containers for running HPC, Big Data, and Deep Learning middleware and applications on modern HPC and data center architectures with high-performance interconnects, SR-IOV, accelerators, and storage technologies.
Topic: Discussions on the opportunities and technical challenges of designing high-performance HPC/Big Data/Deep Learning runtime over cloud environments. Demonstration on how high-performance solutions can be designed to run HPC, Big Data, and Deep Learning workloads (like MPI, Hadoop, Spark, TensorFlow) in clouds. Soliciting all kinds of feedback from the audience to come up with a roadmap for the next 5 - 10 years about how to efficiently handle these grand challenges associated with building efficient HPC clouds.
Speakers in this BoF include:
- Burak Yenier, UberCloud
- Christian Kniep, Docker GmbH
- Tor Skie, Univ. of Oslo, Norway
- Dhabaleswar K. (DK) Panda, The Ohio State University
WebURL: http://web.cse.ohio-state.edu/~lu.932/bofs/cloud-isc2018
BoF Organizer/Speakers
