High Performance
Computing for
Artificial Intelligence

Where performance meets effiency, we are the HPC-AI Lab @NUS.
Who WE Are
We are a cutting-edge lab that integrates high performance computing seamlessly with deep learning. Topics of research interests encompass Machine Learning, High Performance Computing, Machine Learning Systems, Parallel and Distributed Systems, and AI Applications (e.g. CV, NLP, Biology). HPC-AI Lab @NUS is directed by Presidential Young Professor Yang You.
Explore News
arrow_forward

NEWS

Our papers are accepted to ICLR 2024!

Explore Publications
arrow_forward

OpenMoE project release!

Explore Project
arrow_forward

SELECTED PUBLICATIONS

View Paper
arrow_outward

InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruning

ICLR 2024 (Oral)
View Paper
arrow_outward

Hanayo: Harnessing Wave-like Pipeline Parallelism for Enhanced Large Model Training Efficiency

SC 2023
View Paper
arrow_outward

To Repeat or Not To Repeat: Insights from Scaling LLM under Token-Crisis

NeurIPS 2023

PEOPLE

LAB OPENINGS