Talent.com

Program evaluation Jobs in Newark, NJ

Create a job alert for this search

Program evaluation • newark nj

Last updated: 1 day ago

Evaluation Engineer

Freshfields Bruckhaus DeringerNew York

Build and run tests that assess the quality and reliability of the firm’s AI applications.Help maintain evaluation datasets, investigate failures and provide clear evidence of how AI systems perfor... Show more

Assistant/Associate Dean Program Evaluation and Continuous Quality Improvement

Rutgers UniversityNewark, NJ
$131,582.00–$268,759.00 yearly$131,582.00–$268,759.00 yearly
Full-timeFull-time

This newly developed role will report to the Executive Vice Dean and will provide services across the medical education continuum including faculty affairs.The Assistant/Associate Dean for Program ... Show more

Program Associate

NYU Langone HealthNew York, NY, US
$43,656.26–$53,424.00 yearly$43,656.26–$53,424.00 yearly

NYU Grossman School of Medicine is one of the nation's top-ranked medical schools.For 175 years, NYU Grossman School of Medicine has trained thousands of physicians and scientists who have helped t... Show more

Program Lead

Tiger Analytics Inc.Jersey City, NJ, US
Full-timeFull-time
Quick Apply

Tiger Analytics is looking for experienced Technical Program Manager to join our fast-growing advanced analytics consulting firm.Our employees bring deep expertise in Data Science, Machine Learning... Show more

Sr. Applied Scientist, Agent Evaluation and Experimentation, DTx Science

Amazon.com Services LLCNew York, New York, USA
Full-timeFull-time

Amazon Advertising is one of Amazon's fastest growing and most profitable businesses, responsible for defining and delivering a collection of advertising products that drive discovery and sales.Our... Show more

Lead Specialist - Product Owner - Veterans Evaluation Services

MaximusNewark, US
Full-timeFull-time

Maximus is currently hiring for Lead Specialist - Product Owners to support our Veterans Evaluation Services (VES) team.This role is responsible for leading agile product delivery from concept thro... Show more

Program Manager

LeidosNewark, NJ
$175,000.00–$185,000.00 yearly$175,000.00–$185,000.00 yearly
PermanentPermanent

Leidos is seeking an experienced Program Manager to lead a large, technically complex IT program supporting energy efficiency and clean energy initiatives within a major utility environment.This ro... Show more

AI Evaluation Specialist - Remote

YO AI LabsNew York, NY, USA
RemoteRemote
Full-timeFull-time
Quick Apply

Remote — US, Canada, UK, Ireland, Australia, New Zealand.AI assistant outputs for an enterprise AI training project.You'll evaluate AI-generated responses using defined quality standards, identify ... Show more

Physician (MD/DO) - Medical AI Evaluation

MindriftNew York, NY, US
RemoteRemote
Part-timePart-time
Quick Apply

Please submit your CV in English and indicate your level of English proficiency.Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, eva... Show more

Remote | Senior Software Engineer – LLM Evaluation

24-MAGNew York, New York, United States
RemoteRemote
Full-timeFull-time
Quick Apply

We are sharing a specialised part-time consulting opportunity for experienced Senior Software Engineers to contribute to advanced large language model evaluation, coding benchmark development, and ... Show more

RN Program Coordinator - CNA program Coordinator

FINLAY INSTITUTE OF TECHNOLOGY LLCWest New York, NJ, US
$30,000.00–$40,000.00 yearly$30,000.00–$40,000.00 yearly
Part-timePart-time

We are seeking an experienced and dependable healthcare professional to join our team as a.This is an excellent opportunity for a seasoned nursing or healthcare education professional seeking a fle... Show more

Program Coordinator

Phipps Neighborhoods Inc.New York, NY, United States

Phipps Neighborhoods, the social service affiliate of Phipps Houses, has been a catalyst for community growth and empowerment for over 50 years.Our mission is focused on creating safe, inclusive sp... Show more

Program Manager

Energize MarketingNew York City, NY, US
$65,000.00–$80,000.00 yearly$65,000.00–$80,000.00 yearly
Full-timeFull-time
Quick Apply

Remote within the United States.Candidates must reside and be authorized to work in the United States.Full-Time Reports To: Director of Customer Success and Operations  Salary: $65,000 to $80,... Show more

Part Time Program Facilitator CDFP Program

Partnership with ChildrenNew York, NY, USA
$32.00–$40.00 hourly$32.00–$40.00 hourly
Part-timePart-time

Part Time Program Facilitator CDFP Program .Partnership with Children (PWC) is a nonprofit organization committed to empowering students to reach their full potential and succeed in school, society... Show more

Music Evaluation Specialist - Expert

MercorNew York, New York, United States
$23.00–$54.00 hourly$23.00–$54.00 hourly
RemoteRemote
Part-timePart-time
Quick Apply

Headquartered in San Francisco, our investors include.Music & Lyrics Expert - English (US/UK/Australia).Evaluate AI-generated music across various genres and rate it against quality standards.C... Show more

Program Director

PrideStaffNew York, NEW YORK, US
$95,000.00 yearly$95,000.00 yearly
PermanentPermanent

Drive strategic operations, regulatory compliance, and public health initiative governance across nationwide healthcare operations for a premier wellness organization.Monday-Friday, standards busin... Show more

Program Director

Big SpaceshipNew York, NY, US
$150,000.00–$170,000.00 yearly$150,000.00–$170,000.00 yearly
Full-timeFull-time
Quick Apply

At Big Spaceship, we're explorers, not settlers.We partner with ambitious brands ready to venture into new territory, push creative boundaries, and lead rather than follow.We're a full-service crea... Show more

Junior Software Engineer – AI Code Evaluation (Remote)

ELITEBRAINNew York, New York, United States
RemoteRemote

Our client is seeking talented Junior Software Engineers to participate in an innovative artificial intelligence initiative focused on improving the quality, accuracy, and technical capabilities of... Show more

Program Manager

Tucuvi Care SLNew York, United States
RemoteRemote
Full-timeFull-time
Quick Apply

At Tucuvi, we help healthcare organizations ensure every patient receives timely high-quality care by augmenting clinical teams with AI.Our clinical-grade AI Care Management platform automates and ... Show more

People also ask
The cities near Newark, NJ that boast the highest number of program evaluation jobs are:
The highest-paying jobs are:
Evaluation Engineer

Evaluation Engineer

Freshfields Bruckhaus DeringerNew York
12 days ago
Job description

Role purpose

Build and run tests that assess the quality and reliability of the firm’s AI applications. Help maintain evaluation datasets, investigate failures and provide clear evidence of how AI systems perform on legal and business tasks.

Key responsibilities

  • Implement automated evaluation cases and supporting scripts using established frameworks and guidance from senior engineers.
  • Prepare and maintain test datasets, source documents and reference examples with legal specialists. Follow requirements for confidentiality, permitted data use and version control.
  • Run evaluations of answer accuracy, completeness, citations, retrieval relevance, instruction following and appropriate escalation. Apply agreed scoring criteria and flag cases requiring expert judgement.
  • Execute functional and integration tests for AI workflows, including document ingestion, tool calls, structured outputs and error handling, in coordination with application QA.
  • Review outputs and execution traces to identify failures. Reproduce issues, document supporting evidence and help distinguish data, retrieval, model and application defects.
  • Compare results across model, prompt and application versions. Report changes accurately, including uncertainty and limitations, rather than relying solely on headline scores.
  • Support the calibration of automated graders by comparing their scores with human reviews and investigating inconsistencies.
  • Maintain regression suites, contribute to CI/CD integration and turn approved production failure examples into new test cases.
  • undefined

Required skills and experience

  • Minimum five years’ experience developing software demonstrated through employment, placements or substantial projects using programming languages such as Python, Java or C#.
  • Foundational conceptual understanding of large language models, including their capabilities, limitations and common failure modes, and an ability to apply that understanding when developing evaluation criteria, test cases and acceptance thresholds with guidance from senior engineers.
  • Ability to use coding agents effectively to support development, testing and analysis, with awareness of best practices for prompting, context management, validation, security, responsible use of generated code and when to seek human review.
  • Working knowledge of APIs, Git, automated testing and software development lifecycle practices and CI/CD tools such as Jira and Jenkins.
  • Demonstrated curiosity and ability to learn in a rapidly evolving AI landscape, assess new models, tools and evaluation techniques, and apply relevant learning pragmatically with appropriate guidance.
  • Foundational understanding of statistics and measurement, including sampling, precision and recall, together with strong analytical skills, attention to detail and the ability to document issues clearly and seek technical or legal guidance when needed.
  • Practical experience evaluating AI applications is a plus but is not required, given the newness of the field; relevant academic, internship or project experience will also be considered.