Talent.com

Program evaluation Jobs in Newark, NJ

Create a job alert for this search

Program evaluation • newark nj

Last updated: less than 1 hour ago

Evaluation Engineer

Freshfields Bruckhaus DeringerNew York

Build and run tests that assess the quality and reliability of the firm’s AI applications.Help maintain evaluation datasets, investigate failures and provide clear evidence of how AI systems perfor... Show more

Assistant/Associate Dean Program Evaluation and Continuous Quality Improvement

Rutgers UniversityNewark, NJ
$131,582.00–$268,759.00 yearly$131,582.00–$268,759.00 yearly
Full-timeFull-time

This newly developed role will report to the Executive Vice Dean and will provide services across the medical education continuum including faculty affairs.The Assistant/Associate Dean for Program ... Show more

Production Insurance AI Evaluation Specialist

JDA TSGNew York, NY, US
$75,000.00–$90,000.00 yearly$75,000.00–$90,000.00 yearly
Full-timeFull-time

At JDA TSG, we equip world-class brands with top-tier talent and operational expertise, because we know our people are our true differentiator.As a Production Insurance AI Evaluation Specialist, yo... Show more

Program Coordinator

NYU Langone HealthNew York, NY, US
$66,300.00–$72,000.00 yearly$66,300.00–$72,000.00 yearly

NYU Grossman School of Medicine is one of the nation's top-ranked medical schools.For 175 years, NYU Grossman School of Medicine has trained thousands of physicians and scientists who have helped t... Show more

Program Lead

Tiger Analytics Inc.Jersey City, NJ, US
Full-timeFull-time
Quick Apply

Tiger Analytics is looking for experienced Technical Program Manager to join our fast-growing advanced analytics consulting firm.Our employees bring deep expertise in Data Science, Machine Learning... Show more

Program Manager

New York Technology PartnersJersey City, NJ

Technical Program Manager / Technical Program Lead.StoneCastle capabilities into the Fiserv ecosystem.The successful candidate will lead complex cross-functional initiatives spanning deposit produc... Show more

Psychiatrist - Clinical Evaluation Specialist

MercorNew York, New York, United States
RemoteRemote
Part-timePart-time
Quick Apply

Headquartered in San Francisco, our investors include.Check each answer against the patient chart and decide which of two responses is stronger.Write structured rationales on clinical rigor, comple... Show more

Lead Specialist - Product Owner - Veterans Evaluation Services

MaximusNewark, US
Full-timeFull-time

Maximus is currently hiring for Lead Specialist - Product Owners to support our Veterans Evaluation Services (VES) team.This role is responsible for leading agile product delivery from concept thro... Show more

Program Manager

LeidosNewark, NJ
$175,000.00–$185,000.00 yearly$175,000.00–$185,000.00 yearly
PermanentPermanent

Leidos is seeking an experienced Program Manager to lead a large, technically complex IT program supporting energy efficiency and clean energy initiatives within a major utility environment.This ro... Show more

Remote | Senior Software Engineer – LLM Evaluation

24-MAGNew York, New York, United States
RemoteRemote
Full-timeFull-time
Quick Apply

We are sharing a specialised part-time consulting opportunity for experienced Senior Software Engineers to contribute to advanced large language model evaluation, coding benchmark development, and ... Show more

Physician (MD/DO) - Medical AI Evaluation

MindriftNew York, NY, US
$50.00 hourly$50.00 hourly
RemoteRemote
Part-timePart-time
Quick Apply

Paid per approved task, about $100/hr equivalent.One flat rate for every approved task.Built to fit around a clinical practice:.Tasks estimated at about 10–20 hrs/week while the project is active; ... Show more

RN Program Coordinator - CNA program Coordinator

FINLAY INSTITUTE OF TECHNOLOGY LLCWest New York, NJ, US
$30,000.00–$40,000.00 yearly$30,000.00–$40,000.00 yearly
Part-timePart-time

We are seeking an experienced and dependable healthcare professional to join our team as a.This is an excellent opportunity for a seasoned nursing or healthcare education professional seeking a fle... Show more

Program Coordinator

Phipps Neighborhoods Inc.New York, NY, United States

Phipps Neighborhoods, the social service affiliate of Phipps Houses, has been a catalyst for community growth and empowerment for over 50 years.Our mission is focused on creating safe, inclusive sp... Show more

Program Administrator

HISPANIC FEDERATION, INC.New York, NY, US
$55,000.00–$65,000.00 yearly$55,000.00–$65,000.00 yearly
Full-timeFull-time

Hispanic Federation (HF) is the nation's premier Latino nonprofit membership organization.Founded in 1990, HF supports Hispanic families and strengthens Latino institutions through grant making and... Show more

Photo Editor - AI Image Evaluation (Remote)

Scale AINew York, United States
RemoteRemote

Outlier is an AI training platform owned and operated by Scale AI.Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models.About the oppo... Show more

 • New!

Program Manager

Energize MarketingNew York City, NY, US
$65,000.00–$80,000.00 yearly$65,000.00–$80,000.00 yearly
Full-timeFull-time
Quick Apply

Remote within the United States.Candidates must reside and be authorized to work in the United States.Full-Time Reports To: Director of Customer Success and Operations  Salary: $65,000 to $80,... Show more

Program Manager

Incedo Inc.New York, NY

Banking & Payments, Wealth Management, Financial Services.New York, NY OR New Jersey (Hybrid).Incedo is a global AI, data, and digital transformation specialist that helps leading enterprises drive... Show more

Program Director

Big SpaceshipNew York, NY, US
$150,000.00–$170,000.00 yearly$150,000.00–$170,000.00 yearly
Full-timeFull-time
Quick Apply

At Big Spaceship, we're explorers, not settlers.We partner with ambitious brands ready to venture into new territory, push creative boundaries, and lead rather than follow.We're a full-service crea... Show more

Medical Evaluation Specialist - Remote

YO AI LabsNew York, NY, USA
Full-timeFull-time
Quick Apply

Job Title: Medical Evaluation Specialist.Medical Evaluation Specialists.In this role, you will create and validate challenging medical questions and answers designed to test advanced clinical reaso... Show more

Program Manager

Tucuvi Care SLNew York, United States
RemoteRemote
Full-timeFull-time
Quick Apply

At Tucuvi, we help healthcare organizations ensure every patient receives timely high-quality care by augmenting clinical teams with AI.Our clinical-grade AI Care Management platform automates and ... Show more

People also ask
The cities near Newark, NJ that boast the highest number of program evaluation jobs are:
The highest-paying jobs are:
Evaluation Engineer

Evaluation Engineer

Freshfields Bruckhaus DeringerNew York
16 days ago
Job description

Role purpose

Build and run tests that assess the quality and reliability of the firm’s AI applications. Help maintain evaluation datasets, investigate failures and provide clear evidence of how AI systems perform on legal and business tasks.

Key responsibilities

  • Implement automated evaluation cases and supporting scripts using established frameworks and guidance from senior engineers.
  • Prepare and maintain test datasets, source documents and reference examples with legal specialists. Follow requirements for confidentiality, permitted data use and version control.
  • Run evaluations of answer accuracy, completeness, citations, retrieval relevance, instruction following and appropriate escalation. Apply agreed scoring criteria and flag cases requiring expert judgement.
  • Execute functional and integration tests for AI workflows, including document ingestion, tool calls, structured outputs and error handling, in coordination with application QA.
  • Review outputs and execution traces to identify failures. Reproduce issues, document supporting evidence and help distinguish data, retrieval, model and application defects.
  • Compare results across model, prompt and application versions. Report changes accurately, including uncertainty and limitations, rather than relying solely on headline scores.
  • Support the calibration of automated graders by comparing their scores with human reviews and investigating inconsistencies.
  • Maintain regression suites, contribute to CI/CD integration and turn approved production failure examples into new test cases.
  • undefined

Required skills and experience

  • Minimum five years’ experience developing software demonstrated through employment, placements or substantial projects using programming languages such as Python, Java or C#.
  • Foundational conceptual understanding of large language models, including their capabilities, limitations and common failure modes, and an ability to apply that understanding when developing evaluation criteria, test cases and acceptance thresholds with guidance from senior engineers.
  • Ability to use coding agents effectively to support development, testing and analysis, with awareness of best practices for prompting, context management, validation, security, responsible use of generated code and when to seek human review.
  • Working knowledge of APIs, Git, automated testing and software development lifecycle practices and CI/CD tools such as Jira and Jenkins.
  • Demonstrated curiosity and ability to learn in a rapidly evolving AI landscape, assess new models, tools and evaluation techniques, and apply relevant learning pragmatically with appropriate guidance.
  • Foundational understanding of statistics and measurement, including sampling, precision and recall, together with strong analytical skills, attention to detail and the ability to document issues clearly and seek technical or legal guidance when needed.
  • Practical experience evaluating AI applications is a plus but is not required, given the newness of the field; relevant academic, internship or project experience will also be considered.