Benson Guo

Benson Guo

PhD Student

University of Waterloo

Biography

I’m a Computer Science PhD student at the University of Waterloo, advised by Khuzaima Daudjee and supported by the NSERC CGS-D scholarship.

My research focuses on improving scalability and efficiency of LLM training in cloud environments. I’ve also worked on LLM inference, computer vision, and reinforcement learning, and I’m broadly interested in building large scale systems for the next generation of AI workloads. During my PhD, I’ve completed research internships at Microsoft Research, Apple, and Waabi.

I earned my Bachelor’s degree in Computer Science from the University of Waterloo in 2019. As an undergraduate, I interned at Uber ATG, Jane Street, LinkedIn, Yahoo, and OMERS Capital Markets.

Interests

  • ML Systems
  • Distributed Systems
  • Cloud Computing
  • Reinforcement Learning

Education

  • PhD in Computer Science, 2019 - 2025

    University of Waterloo

  • Bachelor of Computer Science, 2015 - 2019

    University of Waterloo

Experience

 
 
 
 
 

Research Intern, Gray Systems Lab

Microsoft

May 2024 – Aug 2024 Seattle, WA
• Modeled distributed SQL query scheduling with linear programming to evaluate scheduler optimality
• Developed and patented a scheduling algorithm, achieving up to 40% reduction in runtime in simulations
 
 
 
 
 

ML Intern, LLM Training

Apple

May 2023 – Aug 2023 Seattle, WA
• Implemented memory & speed optimizations within PyTorch fully sharded data parallelism for training LLMs
• Worked with internal client to optimize 13B LLM pre-training, achieving a 2x speedup on a 512-GPU cluster
 
 
 
 
 

Research Intern, Closed-Loop Training

Waabi

Sep 2021 – Apr 2022 Toronto, ON
• Developed a deep Q-learning based reinforcement learning algorithm for autonomous driving that converged 3x faster and succeeded at up to 2x more driving scenarios versus state-of-the-art baselines
• Work was patented and published at ECCV 2022
 
 
 
 
 

Research Intern, Self-Driving Vehicle Lab

Uber ATG

May 2019 – Aug 2019 Toronto, ON
• Engineered a novel sensor-fusion algorithm combining radar, LiDAR, and camera data, boosting DNN object-detection precision and reducing velocity-estimation error by 15% • Work was patented and published at ECCV 2020
 
 
 
 
 

Software Developer Intern, Trading Systems

Jane Street Capital

Sep 2018 – Dec 2018 New York, NY
Writing libraries for trading systems.
 
 
 
 
 

Systems & Infrastructure Intern, Distributed Graph Database

LinkedIn

Jan 2018 – Apr 2018 Sunnyvale, CA
Developing traffic analysis tools for a graph database.
 
 
 
 
 

Software Developer Intern, Backend Mail

Yahoo

May 2017 – Aug 2017 Sunnyvale, CA
Constructing workflows for processing mail metadata.
 
 
 
 
 

Software Developer Intern, Portfolio Analytics

OMERS Capital Markets

May 2016 – Aug 2016 Toronto, ON
Building a web platform for portfolio analysis & visualization.