About Me
I am currently a Professor at the School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen. Prior to that, I was a Research Assistant Professor at the Department of Computer Science & Engineering, The Hong Kong University of Science and Technology. I obtained a Ph.D. degree in computer science at the Department of Computer Science, Hong Kong Baptist University in 2020, an M.Sc. degree in computer science at the School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen in 2013, and a B.Eng. degree in software engineering at the School of Software Engineering, South China University of Technology in 2010.
My current research focus is distributed machine learning systems, aiming to build efficient systems of training and inference of deep neural networks.
News
- 30/04/2025: Two papers (ScheInfer and SQ-DeAR) have been accepted by Euro-Par 2025.
- 27/03/2025: Two papers have been accepted by ICDCS 2025.
- 06/12/2024: Our paper “SP-MoE: Expediting Mixture-of-Experts Training with Optimized Pipelining Planning” has been accepted by INFOCOM 2025.
- 03/10/2024: Our paper “FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models” has been accepted by ASPLOS 2025.
- 21/09/2024: I am awarded as one of Outstanding Contributors to Ascend Research Innovation.
- 16/09/2024: I have been ranked 2024 World’s Top 2% Scientists released by Stanford University.
- 11/06/2024: Two papers have been accepted by ICPP 2024.
- 15/04/2024: Our paper “Scheduling Deep Learning Jobs in Multi-Tenant GPU Clusters via Wise Resource Sharing” has been accepted by IEEE/ACM IWQoS 2024.
- 16/01/2024: Our paper “FedImpro: Measuring and Improving Client Update in Federated Learning” has been accepted by ICLR 2024.
- 10/01/2024: Our paper “ScheMoE: An Extensible Mixture-of-Experts Distributed Training System with Tasks Scheduling” has been accepted by EuroSys 2024.
- More…
Work Experience
- 10/2023-present: Professor, HITSZ.
- 09/2022-09/2023: Assistant Professor, HITSZ.
- 09/2020-08/2022: Research Assistant Professor, HKUST.
- 04/2019-05/2020: Deep Learning Intern, NVIDIA.
- 02/2014-03/2016: Senior Research Assistant, Hong Kong Baptist University.
- 02/2013-02/2014: Research Assistant, Hong Kong Baptist University.
Research Interests (Publications)
- Distributed machine learning systems
- GPU computing
- Parallel and distributed systems
- Deep learning
Teaching
- Instructor at HITSZ
- 2025 Spring Semester: Computer Systems (CSAPP)
- 2024 Fall Semester: Parallel Processing and Computer Architecture
- 2024 Fall Semester: Computer Architecture
- 2024 Spring Semester: Computer Systems (CSAPP)
- 2023 Fall Semester: Parallel Processing and Computer Architecture
- 2023 Fall Semester: Computer Architecture
- 2023 Spring Semester: Computer Systems (CSAPP)
- Instructor at HKUST
- Teaching Assistant at HKBU
- 2019 Spring Semester, IT Forum
- 2018 Fall Semester, Software Engineering
- 2018 Spring Semester, Advanced Programming for Software Development
- 2018 Spring Semester, Data Communications and Networking
- 2017 Fall Semester, Enterprise Networking and Cloud Computing
- 2017 Spring Semester, Cloud Computing
- 2016 Fall Semester, Mobile Computing
- 2016 Fall Semester, iMake Apps
Professional Activities
- Organization
- Poster Co-chair of IEEE/ACM International Symposium on Quality of Service (IWQoS 2024).
- Co-chair of 5th International Workshop on Embedded and Mobile Deep Learning, co-located with ACM MobiSys 2021, https://emdl21.github.io/.
- Program Committee Member for Conferences
- IWQoS ‘25, KDD ‘25, ICDCS ‘25
- ICLR ‘24, AAAI ‘24, NeurIPS ‘23, IJCAI ‘23, AAAI ‘23, HiPC ‘22, ICML ‘22, IJCAI ‘22, AAAI ‘22, DSS ‘20, ICC Workshop ‘21, IJCAI ‘21, ICDCS ‘21, HiPC ‘21, ICPADS ‘21, HPCC ‘21, DSS ‘21
- Reviewer for Journals
- ACM Computing Surveys (CSUR)
- IEEE Network Magazine
- IEEE Transactions on Mobile Computing (TMC)
- IEEE Transactions on Cloud Computing (TCC)
- IEEE Transactions on Parallel and Distributed Systems (TPDS)
- IEEE Transactions on Network Science and Engineering (TNSE)
- IEEE Transactions on Industrial Informatics (TII)
- IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
- IEEE Journal on Selected Areas in Communications (JSAC)
- Journal of Parallel and Distributed Computing (JPDC)
- IEEE Acess
- MDPI Sensors
Awards and Prizes
- 2024, Outstanding Contributors to Ascend Research Innovation (昇腾科研创新卓越贡献者). [Link]
- 2021, Best Paper Award of IEEE INFOCOM 2021. [Link]
- 2020, Yakun Scholarship Scheme for Mainland Postgraduate Students, Hong Kong Baptist University. [Link]
- 2018-2020, RPg Performance Award Scheme, Hong Kong Baptist University. [Link]
- 2018, Best Paper Award of IEEE DataCom 2018. [Link]
- 2018, Teaching Assistant Performance Award, Hong Kong Baptist University. [Link]
- 2017, Alibaba Tianchi Healthcare AI Competition, Ranked 7th out of 2887. [Link]
- 2012, Graduate National Scholarship, Harbin Institute of Technology. [Link]
- 2010, First Prize of the Second National CUDA Programming Competition, NVIDIA. [Link]
- 2009, Outstanding Prize of the First National CUDA Programming Competition, NVIDIA. [Link]
- 2007-2010, National Scholarship and Merit Student, South China University of Technology.
Technical Skills
- General: C/C++, Python, and Linux Shell.
- Parallel and Distributed Systems: CUDA, OpenCL, SSE, OpenMP, MPI, and Horovod.
- Deep Learning Frameworks: PyTorch, TensorFlow, and Caffe.