Talent.com
Member of Technical Staff, Evaluation
Member of Technical Staff, EvaluationBoson AI • Santa Clara, CA, US
Member of Technical Staff, Evaluation

Member of Technical Staff, Evaluation

Boson AI • Santa Clara, CA, US
30+ days ago
Job type
  • Full-time
Job description

Job Description

Job Description

Boson AI is an early-stage startup building large language tools for everyone to use. Our founders (Alex Smola,Mu Li), and a team of Deep Learning, Optimization, NLP, AutoML and Statistics scientists and engineers are working on high quality generative AI models for language and beyond.

We are seeking research scientists and engineers to join our team full-time in our Santa Clara office. As part of your role, you will work on implementing and training deep neural networks, understanding and interpreting model behavior and aligning models to human values. The ideal candidate will possess a strong background in machine learning, and have motivations for developing state-of-the-art models towards AGI.

We encourage you to apply even if you do not believe you meet every single qualification. As long as you are motivated to learn and join the development of foundation models, we’d love to chat.

Responsibilities :

  • Design and run evaluations to measure model’s capabilities.
  • Write efficient and clean code to build evaluation pipeline.
  • Share your findings to help model development and data annotation guidelines.

You may be a good fit if you have :

  • Experience in prompt engineering or other ways to interact with large language models.
  • Experience in data analysis, familiar with data processing and visualization tools.
  • Strong candidates may also have :

  • Proficiency in at least one deep learning framework, such as PyTorch.
  • Think out of box, can find solutions to ambiguously scoped problems.
  • Ability to summarize results, clearly communicate the observations in your work.
  • Participated in research projects on model evaluation or related topics.
  • Experience in training / finetuning large language or multimodal models.
  • Total compensations includes base pay, equity, and benefits.

    We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

    Create a job alert for this search

    Member of Technical Staff Evaluation • Santa Clara, CA, US

    Similar jobs
    Member of Technical Staff, Safety

    Member of Technical Staff, Safety

    x.ai • Palo Alto, California, United States
    Full-time
    AI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excelle...Show more
    Last updated: 19 days ago • Promoted
    Member of Technical Staff - Enterprise Model Evaluation

    Member of Technical Staff - Enterprise Model Evaluation

    Twitter • Palo Alto, CA, US
    Full-time
    AI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excelle...Show more
    Last updated: 20 days ago • Promoted
    Member of Technical Staff, Model Evaluation

    Member of Technical Staff, Model Evaluation

    xAI • Palo Alto, CA, US
    Full-time
    AI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering exc...Show more
    Last updated: 30+ days ago • Promoted
    Staff Engineer, Technology Development Engineering

    Staff Engineer, Technology Development Engineering

    Sandisk • Milpitas, CA, US
    Full-time
    Sandisk understands how people and businesses consume data and we relentlessly innovate to deliver solutions that enable today’s needs and tomorrow’s next big ideas.With a rich history ...Show more
    Last updated: 23 days ago • Promoted
    Provider Enrollment Team Lead

    Provider Enrollment Team Lead

    VirtualVocations • Hayward, California, United States
    Full-time
    A company is looking for a Provider Enrollment Team Lead.Key Responsibilities : Assist in establishing and implementing departmental initiatives Develop and coach team members to promote quality ...Show more
    Last updated: 2 days ago • Promoted
    Member Technical Staff - Product Engineer, Cost Reduction

    Member Technical Staff - Product Engineer, Cost Reduction

    San Jose Staffing • San Jose, CA, United States
    Full-time
    The MTS Product Engineer will be responsible for driving new product releases to high volume manufacturing at the lowest cost and highest quality. This role will also be critical in shaping the prod...Show more
    Last updated: 12 days ago • Promoted
    Staff Quality Engineer, Design Quality

    Staff Quality Engineer, Design Quality

    Calyxo, Inc. • Pleasanton, CA, United States
    Full-time
    The company was founded in 2016 to address the profound need for improved kidney stone treatment.Kidney stone disease is a common, painful condition that consumes vast amounts of healthcare resourc...Show more
    Last updated: 30+ days ago • Promoted
    Senior Member of Technical Staff

    Senior Member of Technical Staff

    Oracle • Santa Clara, CA, United States
    Full-time
    As a member of the software engineering division, you will assist in defining and developing software for tasks associated with the developing, debugging or designing of software applications or op...Show more
    Last updated: 4 days ago • Promoted
    Staff System Engineer

    Staff System Engineer

    Seyond • Sunnyvale, CA, US
    Full-time
    Seyond is a leading global provider of image-grade LiDAR technology, powering a safer, smarter and more mobile world across the automotive, intelligent transportation, robotics and industrial autom...Show more
    Last updated: 30+ days ago • Promoted
    Member of Technical Staff, Senior Applied AI Engineer

    Member of Technical Staff, Senior Applied AI Engineer

    Microsoft Corporation • Mountain View, CA, United States
    Full-time
    AI assistant and productivity capabilities.LLM product engineering, evaluation science, hillclimbing, and internal tool building. You'll work across the entire lifecycle of features from early proto...Show more
    Last updated: 5 days ago • Promoted
    Staff Equipment Engineer

    Staff Equipment Engineer

    Halo Industries, Inc. • Santa Clara, CA, US
    Full-time
    The Staff Equipment Engineer is responsible for the performance, reliability, and continuous improvement of semiconductor manufacturing equipment. This role leads tool ownership, drives yield and up...Show more
    Last updated: 22 days ago • Promoted
    Technology Specialist - eBeam Inspection

    Technology Specialist - eBeam Inspection

    KLA • Milpitas, CA, United States
    Full-time
    KLA is a global leader in diversified electronics for the semiconductor manufacturing ecosystem.Virtually every electronic device in the world is produced using our technologies.No laptop, smartpho...Show more
    Last updated: 3 days ago • Promoted
    Test Technician

    Test Technician

    Fortinet • Union City, CA, United States
    Full-time
    Will support Test Engineering Team in support of Fortinet's Cyber Security and network products.Performing Fortinet product inspection , Mainly in IQC department. Based on working instruction to com...Show more
    Last updated: 13 days ago • Promoted
    Member of Technical Staff – Machine Learning Engineer

    Member of Technical Staff – Machine Learning Engineer

    Microsoft • Mountain View, CA, United States
    Full-time
    Develop and Deploy Models : Design, develop, and implement machine learning models for high-performance recommendation systems and personalized feeds. Candidates without direct experience in recommen...Show more
    Last updated: 30+ days ago • Promoted
    Staff Technical Program Manager

    Staff Technical Program Manager

    Intuit • Mountain View, CA, US
    Full-time
    Join the Global Architecture and Development Experiences Ecosystem team within Intuit's PDX (Platform and Development Xceleration) organization and be at the forefront of innovation!....Show more
    Last updated: 19 days ago • Promoted
    Staff R&D Engineer, Sustaining

    Staff R&D Engineer, Sustaining

    Imperative Care • Campbell, California, US
    Full-time
    Job Description Job Description Job Title : Staff R&D Engineer, Sustaining Location : This position is based in our Campbell, California offices. This position is on-site & full-time Why Imperative...Show more
    Last updated: 3 days ago • Promoted
    Sr Member Of Technical Staff

    Sr Member Of Technical Staff

    ThoughtSpot • Mountain View, CA, United States
    Part-time
    Member of Technical Staff : Solve performance problems and troubleshoot back-end stack.Join customer calls to assess performance issues. Part-time telecommuting allowed.Email res (ref Job Code #44350...Show more
    Last updated: 4 days ago • Promoted
    Staff Engineer, Wafer Metrology

    Staff Engineer, Wafer Metrology

    Western Digital • San Jose, CA, US
    Full-time
    At Western Digital, our vision is to power global innovation and push the boundaries of technology to make what you thought was once impossible, possible. At our core, Western Digital is a company o...Show more
    Last updated: 30+ days ago • Promoted