Talent.com
Tech Lead Manager- MLRE, ML Systems
Tech Lead Manager- MLRE, ML SystemsScale AI, Inc. • New York, NY, United States
Tech Lead Manager- MLRE, ML Systems

Tech Lead Manager- MLRE, ML Systems

Scale AI, Inc. • New York, NY, United States
30+ days ago
Job type
  • Full-time
Job description

Scale's LLM post-training platform team builds our internal distributed framework for large language model training. The platform powers MLEs, researchers, data scientists, and operators for fast and automatic training and evaluation of LLMs. It also serves as the underlying training framework for the data quality evaluation pipeline.

Scale is uniquely positioned at the heart of the field of AI as an indispensable provider of training and evaluation data and end-to-end solutions for the ML lifecycle. You will work closely with Scale's ML teams and researchers to build the foundation platform which supports all our ML research and development works. You will be building and optimizing the platform to enable our next generation LLM training, inference and data curation.

If you are excited about shaping the future AI via fundamental innovations, we would love to hear from you!

You will :

  • Build, profile and optimize our training and inference framework.
  • Collaborate with ML and research teams to accelerate their research and development, and enable them to develop the next generation of models and data curation.
  • Research and integrate state-of-the-art technologies to optimize our ML system.

Ideally you'd have :

  • Passionate about system optimization
  • Experience with multi-node LLM training and inference
  • Experience with developing large-scale distributed ML systems
  • Experience with post-training methods like RLHF / RLVR and related algorithms like PPO / GRPO etc.
  • Strong software engineering skills, proficient in frameworks and tools such as CUDA, Pytorch, transformers, flash attention, etc.
  • Strong written and verbal communication skills to operate in a cross functional team environment.
  • Nice to haves :

  • Demonstrated expertise in post-training methods and / or next generation use cases for large language models including instruction tuning, RLHF, tool use, reasoning, agents, and multimodal, etc.
  • Compensation packages at Scale for eligible roles include base salary, equity, and benefits. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position, determined by work location and additional factors, including job-related skills, experience, interview performance, and relevant education or training. Scale employees in eligible roles are also granted equity based compensation, subject to Board of Director approval. Your recruiter can share more about the specific salary range for your preferred location during the hiring process, and confirm whether the hired role will be eligible for equity grant. You'll also receive benefits including, but not limited to : Comprehensive health, dental and vision coverage, retirement benefits, a learning and development stipend, and generous PTO. Additionally, this role may be eligible for additional benefits such as a commuter stipend.

    Please reference the job posting's subtitle for where this position will be located. For pay transparency purposes, the base salary range for this full-time position in the locations of San Francisco, New York, Seattle is :

    $252,000 — $315,000 USD

    PLEASE NOTE : Our policy requires a 90-day waiting period before reconsidering candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants.

    About Us :

    At Scale, our mission is to develop reliable AI systems for the world's most important decisions. Our products provide the high-quality data and full-stack technologies that power the world's leading models, and help enterprises and governments build, deploy, and oversee AI applications that deliver real impact. We work closely with industry leaders like Meta, Cisco, DLA Piper, Mayo Clinic, Time Inc., the Government of Qatar, and U.S. government agencies including the Army and Air Force. We are expanding our team to accelerate the development of AI applications.

    We believe that everyone should be able to bring their whole selves to work, which is why we are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity or Veteran status.

    We are committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. If you need assistance and / or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at accommodations@scale.com. Please see the United States Department of Labor's Know Your Rights poster for additional information.

    We comply with the United States Department of Labor's Pay Transparency provision .

    PLEASE NOTE : We collect, retain and use personal data for our professional business purposes, including notifying you of job opportunities that may be of interest and sharing with our affiliates. We limit the personal data we collect to that which we believe is appropriate and necessary to manage applicants' needs, provide our services, and comply with applicable laws. Any information we collect in connection with your application will be treated in accordance with our internal policies and programs designed to protect personal data. Please see our privacy policy for additional information.

    Create a job alert for this search

    Tech Lead • New York, NY, United States

    Related jobs
    Engineering Manager, ML Ranking & Search (Equity + Bonus)

    Engineering Manager, ML Ranking & Search (Equity + Bonus)

    Etsy, Inc. • New York, NY, United States
    Full-time
    A global marketplace for creative goods is seeking an Engineering Manager for their Search Ranking team.You’ll lead engineers to enhance search algorithms and ensure relevant listings for buyers.Th...Show more
    Last updated: 2 days ago • Promoted
    Manager, Field Learning and Development - Vaccines

    Manager, Field Learning and Development - Vaccines

    Sanofi • Morristown, New Jersey, US
    Full-time
    Job Title : Manager, Field Learning and Development - Vaccines Location : Morristown, NJ About the Job Ready to push the limits of what's possible? Join Sanofi in one of our corporate functions and...Show more
    Last updated: 8 days ago • Promoted
    Senior Technical Lead

    Senior Technical Lead

    EisnerAmper • Iselin, NJ, United States
    Full-time
    At EisnerAmper, we look for individuals who welcome new ideas, encourage innovation, and are eager to make an impact.Whether you're starting out in your career or taking your next step as a seasone...Show more
    Last updated: 9 days ago • Promoted
    Technical Lead

    Technical Lead

    Spectraforce Technologies • Newark, NJ, United States
    Full-time
    Duration : 6 Months (Temp to Hire).As a Tech Lead on Retirement Strategies Institutional team, you will partner with product owners, tech leads, designers, engineers and delivery professionals to de...Show more
    Last updated: 19 days ago • Promoted
    Senior Civil / Site Project Manager

    Senior Civil / Site Project Manager

    Jobot • Lake Como, NJ, US
    Full-time
    Civil / Site Project Manager Needed for Growing Full-Service and Consulting Firm!!.This Jobot Job is hosted by : Tony Barhoum. Are you a fit? Easy Apply now by clicking the "Apply Now" button and sen...Show more
    Last updated: 30+ days ago • Promoted
    Field Project Manager

    Field Project Manager

    Blue Line Drywall & Builders • North Brunswick, NJ, US
    Full-time
    Blue Line Drywall & Builders – Field Project Manager.Blue Line Drywall & Builders is a trusted leader in commercial and residential construction services. With a reputation for quality...Show more
    Last updated: 30+ days ago • Promoted
    Program Manager Tech

    Program Manager Tech

    IFG - International Financial Group • Corona, NY, US
    Full-time
    Transactional Email Program Manager.Job Title : Transactional Email Program Manager.Location : Remote with the ability to accommodate meetings in PST time zone. Duration : ASAP to June 30th, 2024, with...Show more
    Last updated: 20 days ago • Promoted
    Cybersecurity Lead Med Tech

    Cybersecurity Lead Med Tech

    Johnson and Johnson • New Brunswick, NJ, United States
    Full-time
    At Johnson & Johnson, we believe health is everything.Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments a...Show more
    Last updated: 13 days ago • Promoted
    Director, HEOR Modeling Lead

    Director, HEOR Modeling Lead

    Sanofi • MORRISTOWN, NJ, US
    Full-time
    Cambridge MA or Morristown, NJ.We are an innovative global healthcare company, committed to transforming the lives of people with immune challenges, rare diseases and blood disorders, cancers, and ...Show more
    Last updated: 4 hours ago • Promoted • New!
    Account Manager - Central, NJ

    Account Manager - Central, NJ

    Sonepar USA • Middletown, NJ, United States
    Full-time
    There's a Place for You at Cooper Electric Supply, LLC.A career at Cooper Electric Supply, LLC is more than a job.You're investing in a brighter, more sustainable future together and joining a team...Show more
    Last updated: 30+ days ago • Promoted
    Technology Strategy Manager

    Technology Strategy Manager

    Deloitte • Morristown, NJ, US
    Full-time
    Our Deloitte Strategy & Transactions team helps guide clients through their most critical moments and transformational initiatives. From strategy to execution, this team delivers integrated, end-to-...Show more
    Last updated: 3 days ago • Promoted
    GSOC Technical Adoption Manager

    GSOC Technical Adoption Manager

    KPMG • Short Hills, NJ, United States
    Full-time
    Known for being a great place to work and build a career, KPMG provides audit, tax and advisory services for organizations in today's most important industries. Our growth is driven by delivering re...Show more
    Last updated: 1 day ago • Promoted
    Lead Product Operations Manager - AI Enablement

    Lead Product Operations Manager - AI Enablement

    Teladoc Health • Purchase, NY, United States
    Full-time
    Teladoc Health is a global, whole person care company made up of a diverse community of people dedicated to transforming the healthcare experience. As an employee, you're empowered to show up every ...Show more
    Last updated: 30+ days ago • Promoted
    P2P Functional Lead-New Brunswick, NJ

    P2P Functional Lead-New Brunswick, NJ

    Staffing • New Brunswick, NJ, US
    Full-time
    Days Contract New Brunswick, NJ US Citizen, Green Card Holder.Project Description : P2P Enhancements - Functional Lead to help them design & implement contract based requisitions, collaborative req....Show more
    Last updated: 30+ days ago • Promoted
    Read allabout it

    Read allabout it

    Staples • Oakhurst, NJ, US
    Full-time
    Print Supervisors direct a team in driving results for key metrics by selling and providing total print solutions for customers to help them achieve their print and marketing goals.You will also be...Show more
    Last updated: 30+ days ago • Promoted
    Senior Manager of Cybersecurity Detection Engineering

    Senior Manager of Cybersecurity Detection Engineering

    Cox Automotive • New Hyde Park, NY, United States
    Full-time
    The Senior Manager of Cybersecurity Detection Engineering will lead a team of Detection Engineers in designing, implementing, and maintaining advanced detection capabilities to safeguard the organi...Show more
    Last updated: 4 days ago • Promoted
    Tech Lead / Manager, Machine Learning Research Scientist- LLM Evals

    Tech Lead / Manager, Machine Learning Research Scientist- LLM Evals

    Scale AI, Inc. • New York, NY, United States
    Full-time
    As the leading data and evaluation partner for frontier AI companies, Scale is dedicated to advancing the evaluation and benchmarking of large language models (LLMs). We are building industry-leadin...Show more
    Last updated: 26 days ago • Promoted
    SAP EAM Technical Lead

    SAP EAM Technical Lead

    Chesapeake Utilities Corporation • Newark, NJ, United States
    Full-time
    Hybrid Remote - periodic travel to Newark, DE.Must reside in TX, IL, NJ, OH, DE, MD, PA, VA, NC, GA, or FL.The SAP EAM Technical Lead is responsible for the technical architecture, development, and...Show more
    Last updated: 30+ days ago • Promoted