Talent.com
Senior Manager, Generative AI Test Engineering
Senior Manager, Generative AI Test EngineeringSamsung Research America • Mountain View, CA, United States
Senior Manager, Generative AI Test Engineering

Senior Manager, Generative AI Test Engineering

Samsung Research America • Mountain View, CA, United States
2 days ago
Job type
  • Full-time
Job description

Lab Summary :

We focus on developing speech recognition, advanced speech personalization, and state-of-the-art natural language understanding technology. We are dedicated to creating an advanced AI platform that handles seamless conversations across a variety of devices, as well as democratizing AI by allowing developers and IoT manufacturers to add new capabilities to Bixby.

Position Summary :

We're seeking a Senior Manager for our Generative AI Test Engineering team-which will join our Quality Insights team. You will be responsible for managing a small team and for designing and implementing testing strategies and frameworks to evaluate the performance, accuracy, robustness, and safety of AI models and systems. You will collaborate closely with research teams to understand new model capabilities and translate them into robust testing plans and scenario. You will drive development and maintenance of automated testing frameworks and tools for efficient AI validation and system-level testing.

Position Responsibilities :

  • Lead of small team of Data Scientists and QA Engineers
  • Act as a player / coach and utilize test results data to guide product development, identify opportunities, predict challenges, and inform strategic decisions
  • Measure product success through metrics, identifying areas for improvement, and effectively communicating insights to stakeholders
  • Work closely with other functions, such as engineering, product, design, and others

Required Skills :

  • Bachelor's degree in Computer Science, Computer Engineering, or equivalent combination of education, training, and experience
  • 12+ years of professional software development testing experience, including test automation frameworks and tools building
  • 2+ years of people management experience
  • Experience with LLMOps, model monitoring, or ML observability platforms
  • Proficiency in Python, SQL, and data visualization tools for model analytics
  • Strong knowledge of QA methodologies, test automation, and CI / CD integration
  • Experience as a mentor, tech lead or leading an engineering team
  • Special Attributes :

  • Hands-on experience with LangChain, OpenAI API, Hugging Face models, or RAG pipelines
  • Knowledge of cloud platforms (AWS / GCP / Azure) for data workflows and ML deployment
  • Familiarity with human-in-the-loop QA or AI-assisted testing workflows
  • Our total rewards programs are designed to motivate and engage exceptional talent. The base pay range for roles at this level is listed below, but may be higher or lower in other states due to geographic differentials in the labor market. Within the base pay range, individual rates depend on a number of factors-including the role's function and location as well as the individual's knowledge, skills, experience, education and training. This is part of our comprehensive compensation package with annual bonus eligibility and generous benefits to help you live life well.

    Base Pay Range

    $197,800-$296,600 USD

    Additional Information

    Disclosure of Trade Secrets

    Samsung has a strict policy on trade secrets. In applying to Samsung and progressing through the recruitment process, you must not disclose any trade secrets of a current or previous employer.

    Essential Job Functions

    This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, and frequently operate standard office equipment, such as telephones and computers.

    Samsung Research America is committed to complying with all Federal, State and local laws related to the employment of qualified individuals with disabilities. If you are an individual with a disability and would like to request a reasonable accommodation as part of the employment selection process, please contact the recruiter or email sratalent@samsung.com.

    Equal Employment Opportunity

    At Samsung, we believe that innovation and growth are driven by an inclusive culture and a diverse workforce. We aim to create a global team where everyone belongs and has equal opportunities, inspiring our talent to be their true selves. Together, we are building a better tomorrow for our customers, partners, and communities.

    Samsung Research America is committed to employing a diverse workforce, and provide Equal Employment Opportunity for all individuals regardless of race, color, religion, gender, age, national origin, marital status, sexual orientation, gender identity, status as a protected veteran, genetic information, status as a qualified individual with a disability, or any other characteristic protected by law.

    For more information regarding protection from discrimination under Federal law for applicants and employees, please refer to this link : Pay Transparency

    Create a job alert for this search

    Test Engineering Manager • Mountain View, CA, United States

    Related jobs
    Sr. AI Product Manager - Key Components

    Sr. AI Product Manager - Key Components

    Supermicro • San Jose, CA, United States
    Full-time
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show more
    Last updated: 2 days ago • Promoted
    Senior Test Automation Engineer, Photonics

    Senior Test Automation Engineer, Photonics

    PsiQuantum • Milpitas, CA, United States
    Full-time
    Quantum computing holds the promise of humanity's mastery over the natural world, but only if we can build a.PsiQuantum is on a mission to build the first real, useful quantum computers, capable of...Show more
    Last updated: 21 days ago • Promoted
    Senior Product Manager, Enterprise Mobility AI / ML

    Senior Product Manager, Enterprise Mobility AI / ML

    Samsung Electronics America • Mountain View, CA, United States
    Full-time
    Are you passionate about transforming bleeding-edge technologies into services that will impact millions in our daily lives? At Mobile Platform Solutions (MPS), we are looking for passionate produc...Show more
    Last updated: 30+ days ago • Promoted
    Senior Product Manager – Access AI

    Senior Product Manager – Access AI

    Veza • San Francisco, CA, United States
    Full-time
    Veza is the Identity Security company redefining how organizations understand and control access across hybrid and multi‑cloud environments. Our Authorization Platform helps enterprises answer the m...Show more
    Last updated: 9 days ago • Promoted
    Engineering Manager - Photonics Test

    Engineering Manager - Photonics Test

    Lightmatter • Mountain View, CA, United States
    Full-time
    Lightmatter is leading the revolution in AI data center infrastructure, enabling the next giant leaps in human progress.The company invented the world's first 3D-stacked photonics engine, Passage™,...Show more
    Last updated: 2 days ago • Promoted
    Engineering Manager, Onboard Software Test Automation

    Engineering Manager, Onboard Software Test Automation

    Wayve • Sunnyvale, CA, US
    Full-time
    Engineering Manager, Onboard Software Test Automation.At Wayve we're committed to creating a diverse, fair and respectful culture that is inclusive of everyone based on their unique skills and pers...Show more
    Last updated: 30+ days ago • Promoted
    Senior Product Manager, Enterprise Mobility AI / ML

    Senior Product Manager, Enterprise Mobility AI / ML

    Samsung Research America • Mountain View, CA, United States
    Full-time
    Senior Product Manager, Enterprise Mobility AI / ML.Are you passionate about transforming bleeding-edge technologies into services that will impact millions in our daily lives? At Mobile Platform Sol...Show more
    Last updated: 30+ days ago • Promoted
    Senior Integration & Test Engineer (Optomechanical, Thermal)

    Senior Integration & Test Engineer (Optomechanical, Thermal)

    PsiQuantum • Milpitas, CA, United States
    Full-time
    Quantum computing holds the promise of humanity's mastery over the natural world, but only if we can build a.PsiQuantum is on a mission to build the first real, useful quantum computers, capable of...Show more
    Last updated: 19 days ago • Promoted
    Senior Manager, AI Observatory Product Manager

    Senior Manager, AI Observatory Product Manager

    Visa • Foster City, CA, United States
    Full-time
    Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more t...Show more
    Last updated: 30+ days ago • Promoted
    Product Manager, Gen AI Platform

    Product Manager, Gen AI Platform

    Scale AI, Inc. • San Francisco, CA, United States
    Full-time
    Scale AI is building the engine for the next generation of enterprise software - shifting from passive "Systems of Record" to active "Systems of Intelligence. We're looking for an experienced Produc...Show more
    Last updated: 30+ days ago • Promoted
    Senior Engineering Manager - Machine Learning and AI

    Senior Engineering Manager - Machine Learning and AI

    Rippling • San Francisco, CA, United States
    Full-time
    Senior Engineering Manager - Machine Learning and AI.Rippling gives businesses one place to run HR, IT, and Finance.It brings together all of the workforce systems that are normally scattered acros...Show more
    Last updated: 25 days ago • Promoted
    Senior Product Manager, AI

    Senior Product Manager, AI

    Caraa • Palo Alto, CA, United States
    Full-time
    K – $225K • Offers Equity • Offers Bonus.We're living through a fundamental shift in how people discover, evaluate, and purchase products. The next generation doesn\'t respond to traditional marketi...Show more
    Last updated: 30+ days ago • Promoted
    Applied AI Engineering Manager, Enterprise

    Applied AI Engineering Manager, Enterprise

    Scale AI, Inc. • San Francisco, CA, United States
    Full-time
    AI is becoming vitally important in every function of our society.At Scale, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, ...Show more
    Last updated: 30+ days ago • Promoted
    Engineering Manager, Applied AI

    Engineering Manager, Applied AI

    Merge • San Francisco, CA, US
    Full-time
    Engineering Manager, Applied AI.Merge enables B2B companies to add hundreds of integrations to their products, making it easy to access and sync their customers' data. We offer Unified APIs that pro...Show more
    Last updated: 30+ days ago • Promoted
    Senior Product Manager, Generative AI

    Senior Product Manager, Generative AI

    Google Inc. • Sunnyvale, CA, United States
    Full-time
    Bachelor's degree or equivalent practical experience.Experience with the domain area of Generative AI or Large Language Models. Master's degree in a technology or business related field.UX / UI, sales...Show more
    Last updated: 5 days ago • Promoted
    Senior Engineering Manager, AI Assistant

    Senior Engineering Manager, AI Assistant

    Adobe • San Jose, CA, US
    Full-time
    Senior Engineering Manager, AI Assistant.Our Gen AI Experience Engineering team is at the forefront of integrating AI capabilities across the Adobe Experience Cloud. We operate with a startup mental...Show more
    Last updated: 19 days ago • Promoted
    Senior Manager, Manufacturing Test Engineering

    Senior Manager, Manufacturing Test Engineering

    Skydio • Hayward, CA, United States
    Full-time
    Skydio is the leading US drone company and the world leader in autonomous flight, the key technology for the future of drones and aerial mobility. The Skydio team combines deep expertise in artifici...Show more
    Last updated: 2 days ago • Promoted
    Senior Manager, AI Engineering (People Leader) (GenAI Platform Services)

    Senior Manager, AI Engineering (People Leader) (GenAI Platform Services)

    Capital One • San Francisco, California, US
    Part-time
    Please make sure you read the following details carefully before making any applications.You love to build systems, take pride in the quality of your work, and also share our passion to do the righ...Show more
    Last updated: 26 days ago • Promoted