Talent.com
Member of Technical Staff, Model Evaluation
Member of Technical Staff, Model EvaluationxAI • Palo Alto, CA, US
Member of Technical Staff, Model Evaluation

Member of Technical Staff, Model Evaluation

xAI • Palo Alto, CA, US
30+ days ago
Job type
  • Full-time
Job description

Job Description

Job Description

About xAI

xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company's mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

Tech Stack

  • Python
  • JAX and XLA
  • Rust / C++
  • Spark

Focus

  • Provide complete assessment of models.
  • Deep dive into model training and data to identify the weakness point revealed in evaluation.
  • Communicate with modeling and data team to come up with plans to improve model quality.
  • Ideal Experience

  • Model assessment and evaluation task development (including public and in-house benchmarking).
  • Collect data and synthesize data for new evals.
  • Build infrastructure and framework for easy-to-use model evaluation, familiarity with inference frameworks like SGlang and vLLM.
  • Location

    The role is based in the Bay Area [San Francisco and Palo Alto]. Candidates are expected to be located near the Bay Area or open to relocation.

    Annual Salary Range

    $180,000 - $440,000 USD

    Benefits

    Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

    xAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

    Create a job alert for this search

    Member of Technical Staff Model Evaluation • Palo Alto, CA, US

    Similar jobs
    Member of Technical Staff, Evaluation

    Member of Technical Staff, Evaluation

    Boson AI • Santa Clara, CA, US
    Full-time
    Boson AI is an early-stage startup building large language tools for everyone to use.Our founders (Alex Smola,Mu Li), and a team of Deep Learning, Optimization, NLP, AutoML and Statistics scientist...Show more
    Last updated: 30+ days ago • Promoted
    Staff Machine Learning Engineer

    Staff Machine Learning Engineer

    Axiado • San Jose, CA, US
    Full-time
    Axiado is an AI-enhanced security processor company redefining the control and management of every digital system.The company was founded in 2017, and currently has 150+ employees.At Axiado, develo...Show more
    Last updated: 30+ days ago • Promoted
    Staff Firmware Engineer

    Staff Firmware Engineer

    PsiQuantum • Palo Alto, CA, United States
    Full-time
    PsiQuantum'smission is to build the first useful quantum computers-machines capable of delivering the breakthroughs the field has long promised. Since our founding in 2016, our singular focus has be...Show more
    Last updated: 18 days ago • Promoted
    Member of Technical Staff - Enterprise Model Evaluation

    Member of Technical Staff - Enterprise Model Evaluation

    Twitter • Palo Alto, CA, US
    Full-time
    AI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excelle...Show more
    Last updated: 20 days ago • Promoted
    Staff Engineer, Design Verification

    Staff Engineer, Design Verification

    Samsung Semiconductor • San Jose, CA, US
    Full-time
    To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period.Advancing the World's Tec...Show more
    Last updated: 30+ days ago • Promoted
    Staff Engineer, Technology Development Engineering

    Staff Engineer, Technology Development Engineering

    Sandisk • Milpitas, CA, US
    Full-time
    Sandisk understands how people and businesses consume data and we relentlessly innovate to deliver solutions that enable today’s needs and tomorrow’s next big ideas.With a rich history ...Show more
    Last updated: 23 days ago • Promoted
    Staff Machine Learning Engineer

    Staff Machine Learning Engineer

    Cisco Systems, Inc. • San Jose, CA, United States
    Full-time
    Join the engineering team building theintelligent backbone of Splunk Observability Cloud.We are committed to leveraging the latest advancements in data science and machine learning to unlock unprec...Show more
    Last updated: 14 days ago • Promoted
    Staff AI Engineer

    Staff AI Engineer

    Workato • Palo Alto, CA, US
    Full-time
    Workato transforms technology complexity into business opportunity.As the leader in enterprise orchestration, Workato helps businesses globally streamline operations by connecting data, processes, ...Show more
    Last updated: 26 days ago • Promoted
    Staff Quality Engineer, Design Quality

    Staff Quality Engineer, Design Quality

    Calyxo, Inc. • Pleasanton, CA, United States
    Full-time
    The company was founded in 2016 to address the profound need for improved kidney stone treatment.Kidney stone disease is a common, painful condition that consumes vast amounts of healthcare resourc...Show more
    Last updated: 30+ days ago • Promoted
    Staff System Engineer

    Staff System Engineer

    Seyond • Sunnyvale, CA, US
    Full-time
    Seyond is a leading global provider of image-grade LiDAR technology, powering a safer, smarter and more mobile world across the automotive, intelligent transportation, robotics and industrial autom...Show more
    Last updated: 30+ days ago • Promoted
    Staff Equipment Engineer

    Staff Equipment Engineer

    Halo Industries, Inc. • Santa Clara, CA, US
    Full-time
    The Staff Equipment Engineer is responsible for the performance, reliability, and continuous improvement of semiconductor manufacturing equipment. This role leads tool ownership, drives yield and up...Show more
    Last updated: 22 days ago • Promoted
    Technology Specialist - eBeam Inspection

    Technology Specialist - eBeam Inspection

    KLA • Milpitas, CA, United States
    Full-time
    KLA is a global leader in diversified electronics for the semiconductor manufacturing ecosystem.Virtually every electronic device in the world is produced using our technologies.No laptop, smartpho...Show more
    Last updated: 3 days ago • Promoted
    Staff Quality Engineer, Design Quality - Pleasanton, CA

    Staff Quality Engineer, Design Quality - Pleasanton, CA

    Calyxo • Pleasanton, CA, US
    Full-time
    The company was founded in 2016 to address the profound need for improved kidney stone treatment.Kidney stone disease is a common, painful condition that consumes vast amounts of healthcare resourc...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Senior - Senior Staff Engineer- Functional and Design Validation

    Senior - Senior Staff Engineer- Functional and Design Validation

    SK hynix memory solutions America Inc. • San Jose, CA, US
    Full-time
    We are looking for bright and innovative senior engineer who will be working closely with product development team, and be part of systems engineering group. The role will be responsible for plannin...Show more
    Last updated: less than 1 hour ago • Promoted • New!
    Technician - Level 2

    Technician - Level 2

    Sunbelt Rentals • San Leandro, CA, United States
    Full-time
    Sunbelt Rentals strives to be the customer's first choice in the equipment rental industry.From pumps to scaffolding to general construction tools, we aim to be the only call needed to outfit a job...Show more
    Last updated: 2 days ago • Promoted
    Customer Quality Engineer

    Customer Quality Engineer

    Ultra Clean Technology Systems & Svc Inc • Hayward, CA, US
    Full-time
    We indirectly touch every semiconductor chip that goes into every smartphone, smart car, and device that uses artificial intelligence. F;This is a critical time for the semiconductor industry and fo...Show more
    Last updated: 5 days ago • Promoted
    Member of Technical Staff – Machine Learning Engineer

    Member of Technical Staff – Machine Learning Engineer

    Microsoft • Mountain View, CA, United States
    Full-time
    Develop and Deploy Models : Design, develop, and implement machine learning models for high-performance recommendation systems and personalized feeds. Candidates without direct experience in recommen...Show more
    Last updated: 30+ days ago • Promoted
    Staff Engineer, Wafer Metrology

    Staff Engineer, Wafer Metrology

    Western Digital • San Jose, CA, US
    Full-time
    At Western Digital, our vision is to power global innovation and push the boundaries of technology to make what you thought was once impossible, possible. At our core, Western Digital is a company o...Show more
    Last updated: 30+ days ago • Promoted