Tianpei Gu

Research Scientist, Roblox · Santa Clara, California

I work on generative models, currently focused on real-time video generation and world models.

Interests: video generation · world models · agentic systems

You can’t compete with someone who is having fun.

    Figure 1. My room. A tiny world model. It’s 10:00 am in Santa Clara.

    ↑ ↓ ← → move Baykertap to move Bayker

    Abstract

    I like turning ideas into working systems, from the data to the model, and building tools that are both useful and beautiful.

    My research has evolved from human motion and video generation toward interactive worlds. More recently, I’ve also been exploring agentic systems and how they might change the way we do research and engineering.

    1Introduction

    Hey there, I’m Tianpei. I’ve worked on AI research at very different scales, from early-stage startups to large research organizations. One thing I’ve learned is that the most interesting problems rarely fit neatly into a single role. Sometimes the answer is a new model, sometimes it’s better data or infrastructure, and sometimes it’s simply a tool that makes everyone’s work easier. I enjoy figuring out what matters and building it.

    At Morpheus, I built the research data infrastructure from scratch for a team working on real-time video generation. At ByteDance, I worked on real-time human video generation, and on data systems that supported model research at a much larger scale. These experiences taught me that good infrastructure isn’t separate from research — it shapes which experiments are possible, how quickly we can iterate, and how well we can understand what our models are actually learning.

    I learn best by building. I enjoy turning papers into experiments, trying unfamiliar tools, and creating things that make complicated workflows simpler. Sometimes that means training a model; other times it means building an application or a tool that I wish already existed.

    Some of my favorite experiences have been working with small teams where people trust each other to take on difficult problems and figure things out. I value that kind of trust and independence.

    2Research

    Much of my earlier research focused on people: how they move, express themselves, and interact through speech and video. Over time, that interest has expanded toward worlds that can respond to our actions, remain coherent over time, and support real-time interaction. I find the intelligence behind these interactions just as interesting as the visual generation itself.

    Working on generative models has also shaped how I think about data. Choosing what a model learns from is a research decision. When a model fails, I often find it useful to ask what kind of experience it might be missing, and whether changing the data would be a better experiment than changing the architecture. I think there’s a lot of interesting research to be done here.

    More recently, I’ve been building AI-agent systems to help with my own research and engineering. What interests me isn’t just having agents write code, but figuring out how to give them the context, tools, feedback, and autonomy they need to carry out more complex work. Building these systems has made me increasingly curious about recursive self-improvement — how far can we go when AI systems start improving the processes used to develop themselves?

    Alongside these interests, I keep coming back to my personal “mom benchmark”: could someone like my mom find a reason to use this? I want to build things people find useful, enjoyable, or worth coming back to. I don’t have a fixed picture of what generative models will become in everyday life. Part of the appeal is building things people can actually try, and learning from what they want to do.

    3Experience

    Table 1. Experience.
    OrganizationRoleLocationDates
    RobloxResearch ScientistSan MateoJun 2026 – present
    Real-time video generation and interactive world models, from model development to inference.
    Morpheus AI acquired by RobloxMember of Technical StaffSanta ClaraJan 2026 – Jun 2026
    Built research data systems from scratch, spanning data processing, training interfaces, and internal research tools.
    ByteDanceResearch ScientistSan JoseNov 2024 – Jan 2026
    Real-time audiovisual generation and large-scale multimodal research data systems.
    KreaMachine Learning EngineerSan FranciscoApr 2024 – Nov 2024
    Video model training and data infrastructure.
    LexicaFounding EngineerSan FranciscoJun 2023 – Apr 2024
    Image generation models, large-scale training data, and multimodal annotation systems.

    4Education

    Table 2. Education.
    InstitutionDegreeYears
    University of California, Los AngelesMaster2021–2022
    University of MarylandBachelor2017–2021

    5Service

    Table 3. Peer review, 2022–2026.
    VenueYears
    CVPR2022, 2023, 2024, 2025, 2026
    NeurIPS2025
    ICCV2023, 2025
    ECCV2022, 2024
    ACCV2024
    AAAI2025
    IEEE TIP2023

    6Selected Publications* Equal contribution

    1. [1]

      Lynx: Towards High-Fidelity Personalized Video Generation

      Shen Sang*, Tiancheng Zhi*, Tianpei Gu, Jing Liu, Linjie Luo

    2. [2]

      X-Streamer: Unified Human World Modeling with Audiovisual Interaction

      You Xie, Tianpei Gu, Zenan Li, Chenxu Zhang, Guoxian Song, Xiaochen Zhao, Chao Liang, Jianwen Jiang, Hongyi Xu, Linjie Luo

    3. [3]

      X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latents

      Guoxian Song, Hongyi Xu, Xiaochen Zhao, You Xie, Tianpei Gu, Zenan Li, Chenxu Zhang, Linjie Luo

    4. [4]

      X-Actor: Emotional and Expressive Long-Range Portrait Acting from Audio

      Chenxu Zhang, Zenan Li, Hongyi Xu, You Xie, Xiaochen Zhao, Tianpei Gu, Guoxian Song, Xin Chen, Chao Liang, Jianwen Jiang, Linjie Luo

    5. [5]

      Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompaniment

      Li Siyao, Tianpei Gu, Zhitao Yang, Zhengyu Lin, Ziwei Liu, Henghui Ding, Lei Yang, and Chen Change Loy

    6. [6]

      Bailando++: 3D Dance GPT With Choreographic Memory

      Li Siyao, Weijiang Yu, Tianpei Gu, Chunze Lin, Quan Wang, Chen Qian, Chen Change Loy, and Ziwei Liu

    7. [7]

      Deep Geometrized Cartoon Line Inbetweening

      Li Siyao, Tianpei Gu, Weiye Xiao, Henghui Ding, Ziwei Liu, and Chen Change Loy

    8. [8]

      Stochastic Trajectory Prediction via Motion Indeterminacy Diffusion

      Tianpei Gu*, Guangyi Chen*, Junlong Li, Chunze Lin, Yongming Rao, Jie Zhou, and Jiwen Lu

    9. [9]

      Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memory

      Li Siyao, Weijiang Yu, Tianpei Gu, Chunze Lin, Quan Wang, Chen Qian, Chen Change Loy, and Ziwei Liu

    10. [10]

      Person Re-Identification via Attention Pyramid

      Guangyi Chen, Tianpei Gu, Jiwen Lu, Jin-An Bao, and Jie Zhou

    ABayker

    Outside work, I enjoy cooking, playing Dota 2, and trying out new technologies. I also have a cat named 贝壳, or Bayker in English. Below are a few photos of him; you can find more on Instagram and Xiaohongshu.

    Figure 2. Bayker, photographed.

    Figure 3. See y’all at the top.
    1 / 11