Weiming Ren

I am a second year Ph.D. student at the Cheriton School of Computer Science, University of Waterloo, supervised by Prof. Wenhu Chen. I am also affiliated with the Vector Institute. My research interests include developing novel algorithms for controllable video generation, image and video editing, and image restoration, as well as designing efficient model architectures and data curation pipelines to enhance large multimodal models (LMMs) for image and video understanding.

Before starting my Ph.D., I received my master’s degree from the Department of Computer Science, University of Toronto, where I was a student in the MSc. in Applied Computing program. I was also a research intern at Samsung AI Centre Toronto, supervised by Dr. Iqbal Mohomed. I received my bachelor’s degrees from Beijing Institute of Technology and the Australian National University.

My Email: w2ren [at] uwaterloo [dot] ca

news

Feb 26, 2025 VISTA has been accepted by CVPR 2025.
Feb 13, 2025 I will be joining the Meta Monetization team as a Research Scientist Intern in summer 2025.
Jan 22, 2025 OmniEdit has been accepted by ICLR 2025.

publications

  1. Arxiv 2025
    Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers
    Weiming Ren, Wentao Ma, Huan Yang, Cong Wei, Ge Zhang, and Wenhu Chen
    Arxiv Preprint 2025
    arXiv Website
  2. CVPR 2025
    VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by Video Spatiotemporal Augmentation
    Weiming Ren, Huan Yang, Jie Min, Cong Wei, and Wenhu Chen
    IEEE/CVF Conference on Computer Vision and Pattern Recognition 2025
    arXiv Website
  3. ICLR 2025
    OmniEdit: Building Image Editing Generalist Models Through Specialist Supervision
    Cong Wei, Zheyang Xiong, Weiming Ren, Xinrun Du, Ge Zhang, and Wenhu Chen
    International Conference on Learning Representations 2025
    arXiv Website
  1. NeurIPS 2024
    MMLU-Pro: A More Robust and Challenging Multi-task Language Understanding Benchmark
    Yubo Wang, Xueguang Ma, Ge Zhang, Yuansheng Ni, Abhranil Chandra, Shiguang Guo, Weiming Ren, Aaran Arulraj, Xuan He, Ziyan Jiang, and others
    NeurIPS Dataset and Benchmark Track (Spotlight) 2024
    arXiv Website
  2. TMLR 2024
    Video Diffusion Models: A Survey
    Andrew Melnik, Michal Ljubljanac, Cong Lu, Qi Yan, Weiming Ren, and Helge Ritter
    Transactions on Machine Learning Research (TMLR) 2024
    arXiv Website
  3. TMLR 2024
    AnyV2V: A Plug-and-Play Framework For Any Video-to-Video Editing Tasks
    Max Ku*, Cong Wei*, Weiming Ren*, Harry Yang, and Wenhu Chen
    *: Equal Contribution
    Transactions on Machine Learning Research (TMLR) 2024
    arXiv Website
  4. COLM 2024
    StructLM: Towards Building Generalist Models for Structured Knowledge Grounding
    Alex Zhuang, Ge Zhang, Tianyu Zheng, Xinrun Du, Junjie Wang, Weiming Ren, Stephen W Huang, Jie Fu, Xiang Yue, and Wenhu Chen
    Conference on Language Modeling (COLM) 2024
    arXiv Website
  5. TMLR 2024
    ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generation
    Weiming Ren, Harry Yang, Ge Zhang, Cong Wei, Xinrun Du, Stephen Huang, and Wenhu Chen
    Transactions on Machine Learning Research (TMLR) 2024
    arXiv Website
  6. CVPR 2024
    MMMU: A Massive Multi-Discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI
    Xiang Yue, Yuansheng Ni, Kai Zhang, Tianyu Zheng, Ruoqi Liu, Ge Zhang, Samuel Stevens, Dongfu Jiang, Weiming Ren, Yuxuan Sun, and others
    IEEE/CVF Conference on Computer Vision and Pattern Recognition (Oral) 2024
    arXiv Website
    1. MLHC 2022
      HiCu: Leveraging Hierarchy for Curriculum Learning in Automated ICD Coding
      Weiming Ren, Ruijing Zeng, Tongzi Wu, Tianshu Zhu, and Rahul G Krishnan
      Machine Learning for Healthcare Conference 2022
      arXiv Code Spotlight Presentation

    experiences

    Samsung AI Center Toronto, Canada
    Research Intern - Sep. 2024 to March. 2025
    Advisor: Dr. Iqbal Mohomed, Dr. Alex Levinshtein
    01.ai, Beijing
    Research Intern - Aug. 2023 to Feb. 2025
    Advisor: Dr. Huan Yang
    Samsung AI Center Toronto, Canada
    Research Intern - May. 2022 to Apr. 2023
    Advisor: Dr. Iqbal Mohomed

    education

    University of Waterloo, Canada
    Ph.D. in Computer Science - Sep. 2023 to present
    University of Toronto, Canada
    Master of Science in Applied Computing - Sep. 2021 to Dec. 2022
    Australian National University, Australia
    Bachelor in Advanced Computing (Honours) - Jul. 2019 to Jun. 2021
    Beijing Institute of Technology, China
    Bachelor of Science in Computer Science and Technology - Sep. 2017 to Jun. 2021