Talent.com
Research Scientist - World Modeling
Research Scientist - World ModelingInstitute of Foundation Models • Sunnyvale, CA, US
Research Scientist - World Modeling

Research Scientist - World Modeling

Institute of Foundation Models • Sunnyvale, CA, US
14 days ago
Job type
  • Full-time
Job description

Job Description

Job Description

About the Institute of Foundation Models

We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.

As part of our team, you’ll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub for high-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AI pioneers.

The Role

We are the AllWorld Team under the Institute of Foundation Model (IFM) at MBZUAI . At AllWorld, we are pioneering the development of the PAN (Physical, Agentic, and Networked) world models —the next-generation foundation models to unlock machine intelligence beyond lingual.

Our mission is to tackle the fundamental challenges of world modeling and establish a new paradigm for next-generation machine reasoning . We are looking for passionate individuals who share our vision and are eager to push the boundaries of AI together.

Key Responsibilities

  • Develop the foundational world model to accurately simulate the physical world.
  • Collaborate with engineering and data teams to tackle key challenges in training the world model on large-scale clusters.
  • Develop metrics and evaluation benchmarks to better assess model performance.
  • Design and implement a scalable and efficient data annotation pipeline to ensure high-quality labeled data for training and evaluation.
  • Optimize inference efficiency to enable real-time interaction.

Areas of Focus

  • Scalable Training Systems : Develop and optimize infrastructure for training multimodal LLMs and video diffusion models at massive scale.
  • Efficient Data Pipelines : Build scalable video data pipelines and annotation frameworks to support high-quality training data.
  • Inference Optimization : Enhance inference efficiency through optimization and distillation techniques to enable real-time interaction.
  • Visual Tokenization : Develop methods for discretizing visual features into tokens for improved model representation.
  • Quantitative Evaluation : Establish rigorous benchmarks to assess physical accuracy, controllability, and intelligence.
  • Scaling Laws for Video Pretraining : Investigate scaling law principles to guide efficient video pre-training strategies.
  • Academic Qualifications

  • MSc or PhD in Machine Learning or Computer Science, or equivalent industry experience.
  • Professional Experience

  • Experience in large-scale model training (LLMs or Diffusion Models) on large clusters.
  • Hands-on experience with state-of-the-art video generative models (e.g., Sora, Veo2, MovieGen, CogVideoX, etc.).
  • Experiences in building and optimizing large-scale video data pipelines.
  • Experience in accelerating diffusion model inference for improved efficiency.
  • Exceptional problem-solving and troubleshooting skills to tackle complex technical challenges.
  • Strong systems and engineering expertise in deep learning frameworks such as PyTorch.
  • Strong communication and collaboration skills for effective cross-functional teamwork.
  • Ability to navigate ambiguity and drive projects in rapidly evolving research areas.
  • Research contributions to top-tier conferences or journals (e.g., ICML, ICLR, NeurIPS, ACL, CVPR, COLM, etc.), with published work in relevant domains.
  • Visa Sponsorship

    This position is eligible for visa sponsorship.

    Benefits Include

  • Comprehensive medical, dental, and vision benefits
  • Bonus
  • 401K Plan
  • Generous paid time off, sick leave and holidays
  • Paid Parental Leave
  • Employee Assistance Program
  • Life insurance and disability
  • Create a job alert for this search

    Research Scientist • Sunnyvale, CA, US

    Related jobs
    Research Scientist, Long Video Generation

    Research Scientist, Long Video Generation

    Hedra • San Francisco, CA, United States
    Full-time
    Hedra is a pioneering generative media company backed by top investors at Index, A16Z, and Abstract Ventures.We're building Hedra Studio, a multimodal creation platform capable of control, emotion,...Show more
    Last updated: 30+ days ago • Promoted
    Research Engineer / Research Scientist, Alignment

    Research Engineer / Research Scientist, Alignment

    OpenAI • San Francisco, CA, United States
    Full-time
    Research Engineer / Research Scientist, Alignment | OpenAI.Research Engineer / Research Scientist, Alignment.Apply now (opens in a new window). The Alignment team at OpenAI is dedicated to ensuring ...Show more
    Last updated: 14 days ago • Promoted
    Research Scientist, World Models for Autonomous Vehicles

    Research Scientist, World Models for Autonomous Vehicles

    Toyota Research Institute • Los Altos, CA, US
    Full-time
    At Toyota Research Institute (TRI), we’re on a mission to improve the quality of human life.We’re developing new tools and capabilities to amplify the human experience.To lead this tran...Show more
    Last updated: 14 days ago • Promoted
    Senior Scientist I (PK / PD Modeling)

    Senior Scientist I (PK / PD Modeling)

    AbbVie • South San Francisco, CA, US
    Full-time
    AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkab...Show more
    Last updated: 30+ days ago • Promoted
    Research Scientist (diffusion)

    Research Scientist (diffusion)

    Genmo • San Francisco, CA, United States
    Full-time
    We are Genmo, a research lab dedicated to building open, state-of-the-art models for video generation towards unlocking the right brain of AGI. Join us in shaping the future of AI and pushing the bo...Show more
    Last updated: 30+ days ago • Promoted
    Research Scientist

    Research Scientist

    Menlo Ventures • San Francisco, CA, United States
    Full-time
    Behind our name : Like fire, AI holds the potential for both immense benefit and significant risk.Just as mastering fire transformed human history, we believe the safe and intentional development of...Show more
    Last updated: 9 days ago • Promoted
    Research Scientist, Model Architectures

    Research Scientist, Model Architectures

    Zyphra • Palo Alto, CA, US
    Full-time
    Research Scientist, Model Architectures.Zyphra’s AI Architecture Research Team.This will involve designing and rigorously testing novel model architectures and training methodologies, with a ...Show more
    Last updated: 30+ days ago • Promoted
    Research Scientist, LLM

    Research Scientist, LLM

    HMBL • Mountain View, CA, US
    Full-time
    HMBL is your premiere Talent Partner and Executive Search Solution.We were founded on the fact that technical recruiting is most fruitful via partnership than it is transactional.We partner the m...Show more
    Last updated: 14 days ago • Promoted
    Research Scientist - 3D

    Research Scientist - 3D

    World Labs • San Francisco, CA, United States
    Full-time
    Research Scientist specializing in 3D Models.This role is ideal for someone passionate about developing and implementing. D scenes and objects, ranging from intricate details to expansive environmen...Show more
    Last updated: 30+ days ago • Promoted
    Research Scientist, Latent State Inference for World Models

    Research Scientist, Latent State Inference for World Models

    Toyota Research Institute • Los Altos, CA, US
    Full-time
    At Toyota Research Institute (TRI), we’re on a mission to improve the quality of human life.We’re developing new tools and capabilities to amplify the human experience.To lead this tran...Show more
    Last updated: 14 days ago • Promoted
    Modeling / Interpretability Research Scientist (1 Year Fixed Term)

    Modeling / Interpretability Research Scientist (1 Year Fixed Term)

    Stanford University • Stanford, California, US
    Temporary
    The Enigma Project (enigmaproject.Department of Ophthalmology at Stanford University School of Medicine, dedicated to understanding the computational principles of natural intelligence using the to...Show more
    Last updated: 30+ days ago • Promoted
    Principal AI Research Scientist

    Principal AI Research Scientist

    Cerebro • San Francisco, CA, United States
    Full-time
    Get AI-powered advice on this job and more exclusive features.This range is provided by Cerebro.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more....Show more
    Last updated: 16 days ago • Promoted
    Research Scientist, World Models

    Research Scientist, World Models

    Waabi • San Francisco, CA, United States
    Full-time
    Waabi, founded by AI pioneer and visionary Raquel Urtasun, is an AI company building the next generation of self-driving technology. With a world class team and an innovative approach that unleashes...Show more
    Last updated: 2 days ago • Promoted
    Research Scientist - Generative Modeling

    Research Scientist - Generative Modeling

    World Labs • San Francisco, CA, United States
    Full-time
    Research Scientist specializing in generative modeling and diffusion models.This role is ideal for someone who is an expert at pre-training or post-training of large-scale diffusion models for imag...Show more
    Last updated: 30+ days ago • Promoted
    Staff Scientist - World Model

    Staff Scientist - World Model

    Institute of Foundation Models • Sunnyvale, CA, US
    Full-time
    About the Institute of Foundation Models.We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next...Show more
    Last updated: 14 days ago • Promoted
    Research Scientist - NLP

    Research Scientist - NLP

    Institute of Foundation Models • Sunnyvale, CA, US
    Full-time
    About the Institute of Foundation Models.We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next...Show more
    Last updated: 14 days ago • Promoted
    Research Scientist - Machine Learning

    Research Scientist - Machine Learning

    Extropic • San Francisco, CA, United States
    Full-time
    Extropic’s hardware massively accelerates certain kinds of probabilistic inference.Our ML team works on the science of training models in the thermodynamic paradigm, and we are looking for senior r...Show more
    Last updated: 4 days ago • Promoted
    Machine Learning Research Scientist / Research Engineer, Post-Training

    Machine Learning Research Scientist / Research Engineer, Post-Training

    Scale AI, Inc. • San Francisco, CA, United States
    Full-time
    Scale works with the industry's leading AI labs to provide high quality data and accelerate progress in GenAI research.We are looking for Research Scientists and Research Engineers with expertise i...Show more
    Last updated: 30+ days ago • Promoted