Talent.com
YO IT Consulting
Java Software Engineer - Ai TrainingYO IT Consulting • Boston, MA, US
No longer accepting applications
Java Software Engineer - Ai Training

Java Software Engineer - Ai Training

YO IT Consulting • Boston, MA, US
15 days ago
Job type
  • Full-time
  • Part-time
Job description

Work Mode: Remote

Engagement Type: Independent Contractor

Schedule: Full-Time or Part-Time Contract

Language Requirement: Fluent English

Role Overview

We partner with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. This project focuses specifically on evaluating and improving how AI systems reason about code, generate programming solutions, and explain technical concepts across various complexity levels. The role involves rigorous technical evaluation of AI-generated responses in coding and software engineering contexts.

What You'll Do

  • Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness
  • Conduct fact-checking using trusted public sources and authoritative references
  • Conduct accuracy testing by executing code and validating outputs using appropriate tools
  • Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies
  • Assess code quality, readability, algorithmic soundness, and explanation quality
  • Ensure model responses align with expected conversational behavior and system guidelines
  • Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines

Who You Are

  • You hold a BS, MS, or PhD in Computer Science or a closely related field
  • You have significant real-world experience in software engineering or related technical roles
  • You are an expert in at least one relevant programming language (e.g., Python, Java, C++, JavaScript, Go, Rust)
  • You are able to solve HackerRank or LeetCode Medium and Hard-level problems independently
  • You have experience contributing to well-known open-source projects, including merged pull requests
  • You have significant experience using LLMs while coding and understand their strengths and failure modes
  • You have strong attention to detail and are comfortable evaluating complex technical reasoning, identifying subtle bugs or logical flaws

Nice-to-Have Specialties

  • Prior experience with RLHF, model evaluation, or data annotation work
  • Track record in competitive programming
  • Experience reviewing code in production environments
  • Familiarity with multiple programming paradigms or ecosystems
  • Experience explaining complex technical concepts to non-expert audiences

What Success Looks Like

  • You identify incorrect logic, inefficiencies, edge cases, or misleading explanations in model-generated code, technical concepts, and system design discussions
  • Your feedback improves the correctness, robustness, and clarity of AI coding outputs
  • You deliver reproducible evaluation artifacts that strengthen model performance

J-18808-Ljbffr

Create a job alert for this search

Java Software Engineer - Ai Training • Boston, MA, US

Similar jobs

Senior Java Architect: AI-Driven Cloud Platform

AG Mednet, Inc.Boston, MA, United States
Full-time

A technology company is seeking a Senior Software Engineer to lead and design complex systems with Java and AWS.You will collaborate on AI-assisted development practices and guide architectural dec... Show more

 • Promoted

Lead AI Software Engineer

Venturefizz Product Management CommunityBoston, MA, United States
Full-time

At Klaviyo, we value the unique backgrounds, experiences and perspectives each Klaviyo (we call ourselves Klaviyos) brings to our workplace each and every day.We believe everyone deserves a fair sh... Show more

 • Promoted

Remote AI Engineer Trainee

FOCUSKPI INCBoston, MA, United States
Remote
Full-time

Benefits :Flexible scheduleOpportunity for advancementTraining & developmentLocation :Remote in United States (EST Preferred)Type :Full-Time / Unpaid Trainee ProgramCompany :FocusKPIDO NOT CALL... Show more

 • Promoted

Software Engineer (Machine Learning - LLMs)

LendbuzzBoston, MA, United States
Full-time

Software Engineer (Machine Learning - LLMs).Get AI-powered advice on this job and more exclusive features.This range is provided by Lendbuzz.Your actual pay will be based on your skills and experie... Show more

 • Promoted

Senior Software Engineer, AI Platform & Kubernetes

Red HatBoston, MA, United States
Full-time

A leading open source software company in Boston seeks a Senior Software Engineer to develop a Kubernetes/OpenShift Operator for the Llama Stack.You will produce robust software while collaborating... Show more

 • Promoted

Software Engineer – AI-Native Security Platform

Snyk Ltd.Boston, MA, United States
Full-time

A leading application security company based in Boston is seeking a Software Engineer to help shape modern security solutions in the AI era.You will design, implement, and support software systems,... Show more

 • Promoted

Lead Software Architect/Engineer - AI Native (Remote US)

RevvityBoston, MA, United States
Remote
Part-time

Revvity Signals makes market-leading software that empowers scientists across Life Science R&D, clinical research, and specialty chemicals to make better medicines and products, faster.Our flag... Show more

 • Promoted

Senior Software Engineer - AI / Java

SavianceBoston, MA, United States
Full-time

Senior Software Engineer - AI / Java.AI, and cloud partner specializing in healthcare and life sciences.We help healthcare organizations modernize platforms, optimize revenue cycle operations, and ... Show more

 • Promoted

Software Engineer - Cloud Identity & Access SaaS (Java)

Wayne State UniversityBoston, MA, United States
Full-time

A global security solutions company is seeking a Software Engineer (Level 2) to help develop and maintain their cloud-native SaaS platform.This role involves working collaboratively within a team t... Show more

 • Promoted

Senior AI/Java Backend Engineer for Healthcare RCM

BigRioBoston, MA, United States
Full-time

A leading technology partner is seeking a Senior Software Engineer focusing on AI and Java for a major healthcare project.Responsibilities include designing scalable backend services integrated wit... Show more

 • Promoted

Senior Software Engineer, Fullstack (AI Advisor)

CoinbaseBoston, MA, United States
Full-time

Ready to be pushed beyond what you think you’re capable of?.At Coinbase, our mission is to increase economic freedom in the world.It’s a massive, ambitious opportunity that demands the best of us, ... Show more

 • Promoted

Mendix Avaya Engineer

DRC SystemsBoston, MA, United States
Full-time
Quick Apply

Mendix Avaya Engineer<br /> Location: MA (Remote)</div> <div> </div> <div>Mandatory Skills:<br /> 1.Mendix Application Development & Custom Extensions: Expe... Show more

Senior SW Engineer- Real Time Bidding (Java)

Roberts RecruitingBoston, MA, United States
Full-time

We are currently seeking an engineer to work on our RTB (Real Time Bidding) system.This role will include designing a distributed system capable of analyzing billions of data points across hundreds... Show more

 • Promoted

Senior Software Engineer, Voice AI

Toast IncBoston, MA, United States
Full-time

US (remote), Boston (hybrid), or New York (hybrid) .Now, more than ever, the Toast team is committed to our customers.Our focus is on building the restaurant platform that helps restaurants adapt, ... Show more

 • Promoted

Lead Full Stack Software Engineer (Java)

Roberts RecruitingBoston, MA, United States
Full-time

Technical Lead Software Engineering.This Technical Lead Software Engineering position is responsible for full stack web development of novel healthcare solutions powered by our AI-based software en... Show more

 • Promoted

Senior Software Engineer - ETL, Java

KyruusBoston, MA, United States
Full-time

Senior Software Engineer - ETL.Collaborate with teams across the organization, including product managers, data engineers and business leaders to translate requirements into software solutions to p... Show more

 • Promoted

Senior Software Engineer: Motion Control Systems (9/80)

AnalogicCanton, MA, United States
Full-time

A technology solutions company in Canton, MA seeks a Senior Software Engineer to build reliable systems that power motion control technologies.The ideal candidate will have over 5 years of Java exp... Show more

 • Promoted

Senior Microservices Engineer — Java, Go & Python (Cloud)

Largeton GroupBoston, MA, United States
Full-time

A technology organization based in Boston, MA is seeking a Senior Software Engineer with over 7 years of experience in Java, Go, and Python.The role involves designing and building scalable, micros... Show more

 • Promoted

Senior Software Engineer, Agentic AI

Invicti SecurityBoston, MA, US
Remote
Full-time
Quick Apply

You’re a seasoned software engineer ready for your next challenge.In this role, you’ll join Invicti’s newly formed AI team as a Senior Software Engineer, Agentic AI, and play a pivotal role in buil... Show more

Software Engineer: LabVIEW Development Engineer

NanobiosymCambridge, MA, USA
$70,000.00 yearly
Full-time
Quick Apply

Nanobiosym is an innovative, high-tech company that is developing novel technologies at the nexus of physics, nanotechnology, and biomedicine.Founded by MIT/Harvard alum and located in Cambridge, M... Show more