Loading…
Shanghai, China
June 24–26, 2019
Click here for more information and registration

Simultaneous translation will be provided for all keynote and breakout sessions.
我们将为所有主题演讲和分组会议提供同声传译服务。

To view the Chinese version of this schedule please go here.
请点击此处查看中文版本。

Venue + Sponsor Showcase Map
场馆 + 赞助商展示区地图
Tuesday, June 25 • 16:00 - 16:35
Large Scale Distributed Deep Learning on Kubernetes Clusters - Yuan Tang, Ant Financial & Yong Tang, MobileIron

Sign up or log in to save this to your schedule and see who's attending!

Feedback form is now closed.
The focus of this talk is the deployments of large scale distributed deep learning with Kubernetes. The usage of operators to manage and automate training processes for machine learning are discussed. We share our experiences and compare two open source Kubernetes operators, tf-operator and mpi-operator in this talk. Both operators manage training jobs for TensorFlow but they have different distribution strategies, which lead to different performance results with respect to the utilization ratio among CPU, GPU, and network.

Deep learning tasks are both network and GPU intensive such that a proper optimization for orchestration is very important. There could easily be an imbalance leads to idle compute capacity which is too expensive for GPU nodes (compared with CPUs). We will share our experiences with the hope to provide helpful insight for better economics with machine learning tasks.

Speakers
avatar for Yong Tang

Yong Tang

Director of Engineering, MobileIron
Yong Tang is the Director of Engineering at MobileIron working on cloud infrastructure. He contributes to different container and machine learning projects for the open source community. He is a maintainer of CoreDNS and Docker/Moby projects, and had multiple talks in KubeCon before... Read More →
avatar for Yuan Tang

Yuan Tang

Senior Software Engineer, Ant Financial
Yuan is currently a senior software engineer at Ant Financial, building AI infrastructure and AutoML platform. He's a committer of TensorFlow, XGBoost, Apache MXNet, maintainer of several Kubeflow projects, and author of numerous open source softwares. He's also the author of best-selling... Read More →



Tuesday June 25, 2019 16:00 - 16:35
620