High Performance
Computing for
Artificial Intelligence

Where performance meets effiency, we are the HPC-AI Lab @NUS.
Who WE Are
We are a cutting-edge lab that integrates high performance computing seamlessly with deep learning. Topics of research interests encompass Machine Learning, High Performance Computing, Machine Learning Systems, Parallel and Distributed Systems, and AI Applications (e.g. CV, NLP, Biology). HPC-AI Lab @NUS is directed by Presidential Young Professor Yang You.
Explore News
arrow_forward

NEWS

Neural Network Diffusion

Explore Project
arrow_forward

OpenDiT: An Easy, Fast and Memory-Efficient System for DiT Training and Inference

Explore Project
arrow_forward

SELECTED PUBLICATIONS

View Paper
arrow_outward

InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruning

ICLR 2024 (Oral)
View Paper
arrow_outward

Hanayo: Harnessing Wave-like Pipeline Parallelism for Enhanced Large Model Training Efficiency

SC 2023
View Paper
arrow_outward

To Repeat or Not To Repeat: Insights from Scaling LLM under Token-Crisis

NeurIPS 2023

PEOPLE

LAB OPENINGS

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse varius enim in eros elementum tristique. Duis cursus, mi quis viverra ornare, eros dolor interdum nulla, ut commodo diam libero vitae erat. Aenean faucibus nibh et justo cursus id rutrum lorem imperdiet. Nunc ut sem vitae risus tristique posuere.