Talent.com
Engineering Manager II, AI Model Foundations

Engineering Manager II, AI Model Foundations

BoxRedwood City, CA, US
27 days ago
Job type
  • Full-time
Job description

Engineering Manager II, Ai Model Foundations

Box (NYSE : BOX) is the leader in Intelligent Content Management. Our platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform business workflows with enterprise AI. We help companies thrive in the new AI-first era of business. Founded in 2005, Box simplifies work for leading global organizations, including AstraZeneca, JLL, Morgan Stanley, and Nationwide. Box is headquartered in Redwood City, CA, with offices across the United States, Europe, and Asia.

By joining Box, you will have the unique opportunity to continue driving our platform forward. Content powers how we work. It's the billions of files and information flowing across teams, departments, and key business processes every single day : contracts, invoices, employee records, financials, product specs, marketing assets, and more. Our mission is to bring intelligence to the world of content management and empower our customers to completely transform workflows across their organizations. With the combination of AI and enterprise content, the opportunity has never been greater to transform how the world works together and at Box you will be on the front lines of this massive shift.

Artificial Intelligence is transforming how organizations work with content. Box AI brings powerful large language models to the Box Content Cloud so customers can uncover insights, extract metadata, automate workflows, get answers to critical questions, and create content securely. The Model Foundations team sits at the core of this vision by defining how we rigorously evaluate LLMs and Box AI Agents for enterprise-grade quality, reliability, and trust.

We're looking for an Engineering Manager to lead Model Foundations. You'll build the methodology, datasets, and processes that measure model performance across real-world enterprise scenarios, partner closely with leading model providers, and collaborate with Box executives and platform teams to turn evaluation into product improvement. Your work will directly shape how Box AI advances for thousands of customers around the world.

What You'll Do

  • Lead and mentor a team of ML engineers to design, build, and operationalize an evaluation framework for Box AI Agents and foundational LLMs.
  • Define representative enterprise datasets and metrics; develop grading approaches that assess accuracy, safety, grounding, and usability.
  • Pioneer and evangelize LLM evaluation methodology tailored to enterprise content management use cases.
  • Collaborate with AI Platform teams to translate evaluation results into roadmap decisions and measurable agent improvements.
  • Partner with model providers (e.g., OpenAI, Google, Anthropic) to share findings and influence model capabilities for enterprise needs.
  • Track AI research and industry trends to continuously evolve our evaluation strategy and tooling.
  • Work with senior leadership (CEO, CTO) to set priorities and a clear one-year roadmap for Model Foundations.
  • Manage and coordinate the team's on-call rotation to ensure timely and effective incident response, actively participate in escalated on-call incidents to provide leadership and support, and drive improvements by addressing recurring issues to minimize disruptions.

Who You Are

  • 7+ years in machine learning or applied AI, including 2+ years managing engineers with a track record of coaching, hiring, and performance development.
  • Practical experience evaluating and / or deploying ML systems at scale; you've designed metrics, datasets, or pipelines that informed product decisions.
  • Strong analytical problem solver who works confidently with large, complex datasets and ambiguous problem spaces.
  • Proficient in at least one programming language (e.g., Python, C++, Java, or R) and familiar with modern ML frameworks (e.g., PyTorch, TensorFlow, scikit-learn, NumPy, pandas).
  • Excellent communicator who collaborates effectively across product, research, and platform teams and with external partners.
  • Bachelor's degree in Computer Science or a related field (or equivalent practical experience).
  • Preferred : Experience with LLMs and RAG; depth in IR / NLP / query understanding; familiarity with Vertex AI, AWS Bedrock / SageMaker; exposure to Kubernetes-based systems.
  • Preferred : Proven roadmap planning where short-term wins ladder into a long-term vision.
  • Box lives its values, with community and in-person collaboration being a core part of our culture. Boxers are expected to work from their assigned office a minimum of 3 days per week. Your Recruiter will share more about how we work and company culture during the hiring process.

    At Box, we believe unique and diverse experiences benefit our culture, our products, our customers, our company, and our world. We aim to recruit a passionate, high-performing workforce that reflects the world we live in. If you are head-over-heels about this role but unsure if you meet all the requirements, we encourage you to apply!

    Equal Opportunity

    We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation. Box strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees. Inclusiveness is core to our culture at Box, and we strive to ensure you get the most from your interview experience.

    Box makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please complete this form.

    Notice to applicants in Los Angeles : Box, Inc and its related branches will consider for employment, qualified applicants with criminal histories in a manner consistent with the Los Angeles Fair Chair Ordinance. The Fair Chance Ordinance is provided here.

    Notice to applicants in San Francisco : Box, Inc and its related branches will consider for employment, qualified applicants with criminal histories in a manner consistent with the San Francisco Fair Chair Ordinance. The Fair Chance Ordinance is provided here.

    For details on how we protect your information when you apply, please see our Personnel Privacy Notice. If you are a California-resident, please read our California Applicant & Candidate Privacy Notice here.

    Box is committed to fair and equitable compensation practices. Actual base salary (or OTE if commissionable role) is dependent upon factors such as : knowledge, skill level, experience, and work location. This role is also eligible for equity and benefits. For more information on benefits, check out our healthcare benefits and additional Box Benefits + Perks.

    United States Pay Range

    $231,000 - $288,500 USD

    Create a job alert for this search

    Engineering Manager Ai • Redwood City, CA, US

    Related jobs
    • Promoted
    Engineering Manager - AI Reliability

    Engineering Manager - AI Reliability

    Menlo VenturesSan Francisco, CA, United States
    Full-time
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...Show moreLast updated: 2 days ago
    Senior Engineering Manager - Machine Learning and AI

    Senior Engineering Manager - Machine Learning and AI

    RipplingSan Francisco, California, United States, 94104
    Full-time
    Rippling gives businesses one place to run HR, IT, and Finance.It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and co...Show moreLast updated: 3 days ago
    • Promoted
    Engineering Manager, Managed AI

    Engineering Manager, Managed AI

    Epoch BiodesignSan Francisco, CA, United States
    Full-time
    Crusoe is building the World’s Favorite AI-first Cloud infrastructure company.We’re pioneering vertically integrated, purpose-built AI infrastructure solutions trusted by Fortune 500 companies to p...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Engineering Manager, Applied Machine Learning

    Senior Engineering Manager, Applied Machine Learning

    StravaSan Francisco, CA, United States
    Full-time
    Senior Engineering Manager, Applied Machine Learning.Strava is the app for active people.With over 150 million athletes in more than 185 countries, Strava is where connection, motivation, and perso...Show moreLast updated: 18 days ago
    • Promoted
    Engineering Manager - AI Reliability

    Engineering Manager - AI Reliability

    AnthropicSan Francisco, CA, United States
    Full-time
    Engineering Manager - Serving Infrastructure at Anthropic.Lead one of our Reliability Engineering teams responsible for large language model serving, focusing on reliability metrics and using moder...Show moreLast updated: 30+ days ago
    • Promoted
    Manager II, Machine Learning Engineering, Core Engineering

    Manager II, Machine Learning Engineering, Core Engineering

    PinterestSan Francisco, CA, United States
    Full-time
    Pinterest helps Pinners discover and do what they love.Core Engineering touches every surface the Pinner sees across the app and forms the front-and-center of the Pinterest experience for 500M+ Pin...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineering Manager, AI Networking Menlo Park, CA • AI Infrastructure +1 more • Engine[...]

    Software Engineering Manager, AI Networking Menlo Park, CA • AI Infrastructure +1 more • Engine[...]

    MetaMenlo Park, CA, United States
    Full-time
    Software Engineering Manager, AI Networking.Meta is seeking a highly motivated and experienced Software Engineering Manager to join our team. As an engineering manager you will support, enable and e...Show moreLast updated: 30+ days ago
    • Promoted
    Engineering Manager - Autonomy

    Engineering Manager - Autonomy

    BoosterSan Mateo, CA, United States
    Full-time
    Skydio is the leading US drone company and the world leader in autonomous flight, the key technology for the future of drones and aerial transportation. The Skydio team combines deep expertise in ar...Show moreLast updated: 30+ days ago
    • Promoted
    Product Saftey Engineering Manager

    Product Saftey Engineering Manager

    TUV Rheinland of North AmericaPleasanton, CA, US
    Full-time
    Joining TÜV Rheinland means working for one of the world’s leading testing, inspection, and certification service providers with more than 25,000 employees globally.Our employees are our...Show moreLast updated: 15 days ago
    • Promoted
    Principal Product Manager - Agentic AI

    Principal Product Manager - Agentic AI

    Five9San Ramon, CA, US
    Full-time
    Join us in bringing joy to customer experience.Five9 is a leading provider of cloud contact center software, bringing the power of cloud innovation to customers worldwide.Living our values everyday...Show moreLast updated: 30+ days ago
    • Promoted
    Engineering Manager, API / Platform, Foundation San Francisco, CA

    Engineering Manager, API / Platform, Foundation San Francisco, CA

    StravaSan Francisco, CA, United States
    Full-time
    Strava is the app for active people.With over 150 million athletes in more than 185 countries, Strava is where connection, motivation, and personal bests thrive. No matter your activity, gear, or go...Show moreLast updated: 16 days ago
    • Promoted
    Manager of Product Engineering, Applied AI

    Manager of Product Engineering, Applied AI

    Menlo VenturesSan Francisco, CA, United States
    Full-time
    Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group ...Show moreLast updated: 4 days ago
    • Promoted
    Manager of Product Engineering, Applied AI

    Manager of Product Engineering, Applied AI

    AnthropicSan Francisco, CA, United States
    Full-time
    Manager of Product Engineering, Applied AI.Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a...Show moreLast updated: 4 days ago
    • Promoted
    Engineering Manager, Machine Learning Operations

    Engineering Manager, Machine Learning Operations

    PitchbookSan Francisco, CA, United States
    Full-time
    At PitchBook, we are always looking forward.We continue to innovate, evolve, and invest in ourselves to bring out the best in everyone. We’re deeply collaborative and thrive on the excitement, energ...Show moreLast updated: 30+ days ago
    • Promoted
    Engineering Manager- Machine Learning Infrastructure

    Engineering Manager- Machine Learning Infrastructure

    Plaid IncSan Francisco, CA, United States
    Full-time
    Plaid is evolving into an AI-first company, where data and machine learning are the key enablers of smarter, more secure insight products built on top of Plaid’s vast financial data network.The Mac...Show moreLast updated: 19 days ago
    • Promoted
    Senior Engineering Manager, Deep Learning

    Senior Engineering Manager, Deep Learning

    Hayden AISan Francisco, CA, United States
    Full-time
    At Hayden AI, we are on a mission to harness the power of computer vision to transform the way transit systems and other government agencies address real-world challenges.From bus lane and bus stop...Show moreLast updated: 13 days ago
    • Promoted
    Engineering Manager II, Rider Personalization

    Engineering Manager II, Rider Personalization

    UberSan Francisco, CA, United States
    Full-time
    As Manager for the Rider Intelligence team, you will join a team dedicated to using cutting-edge machine learning and AI to create an app experience that feels intuitive and personalized for millio...Show moreLast updated: 2 days ago
    • Promoted
    • New!
    Engineering Manager, Mulitimodal (API)

    Engineering Manager, Mulitimodal (API)

    OpenAISan Francisco, CA, United States
    Full-time
    OpenAI's mission is to ensure that artificial general intelligence (AGI) benefits all of humanity.Our API is the industry's most widely adopted AI platform, empowering startups, indie developers, a...Show moreLast updated: 11 hours ago
    • Promoted
    Engineering Manager - Robotics and Automation for iPhone & iPad

    Engineering Manager - Robotics and Automation for iPhone & iPad

    Apple Inc.Cupertino, CA, United States
    Full-time
    Engineering Manager - Robotics and Automation for iPhone & iPad.Cupertino, California, United States Hardware.As the team manager, you will guide the efforts, focus and priorities of a team of crea...Show moreLast updated: 30+ days ago
    • Promoted
    Machine Learning Engineering Manager, GAI Search Ranking

    Machine Learning Engineering Manager, GAI Search Ranking

    MoveworksMountain View, CA, United States
    Full-time
    As the leader of a team of talented search relevance engineers, your objective will be to measure and improve the ranking and relevance of our AI-powered enterprise search applications.Since these ...Show moreLast updated: 14 days ago