Talent.com
Mercor
Design Evaluation Expert - GraphicMercor • New York, New York, United States
Design Evaluation Expert - Graphic

Design Evaluation Expert - Graphic

Mercor • New York, New York, United States
5 days ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Design Expert
Type: Contract
Compensation: $80–$150/hour
Location: Remote

Role Responsibilities

  • Design precise, task-specific grading criteria for real-world design deliverables such as brand identity systems and guidelines, campaign visuals, and packaging concepts.
  • Score AI-generated and human work samples against established criteria, providing detailed written justifications for each score.
  • Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
  • Incorporate structured feedback from senior reviewers and iterate quickly on your work.
  • Collaborate asynchronously and work independently to meet deadlines and improve AI model performance.

Qualifications

Must-Have

  • 5+ years of professional experience in graphic, brand, or visual design.
  • Background at world-class design studios or creative agencies, or in senior design roles at leading consumer or technology brands.
  • Deep fluency in typography, layout, visual hierarchy, color, composition, and brand systems.
  • Exceptionally strong written communication skills.
  • Detail-oriented and consistent, with comfort in having your judgment reviewed.

Preferred

  • Prior experience with AI training, evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

  • Submit your resume, portfolio, or relevant professional background to get started.
  • Qualified applicants may be asked to complete a brief assessment or submit additional information.

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

Design Evaluation Expert - Graphic • New York, New York, United States

Similar jobs

Principal UX Researcher & Design Strategist (Remote) Job at Maidservices in New

MaidservicesNew York City, NY, United States
Remote
Full-time +1

A leading home services company is seeking a Principal UX Researcher / Design Strategist to lead qualitative research initiatives.This contract role, remote and part-time or full-time, requires ext... Show more

 • Promoted

Senior Design Sourcer

BrexNew York, NY, United States
Full-time

Recruiting is where every career at Brex begins.We're the first point of connection for future builders and leaders, helping candidates see what's possible.We partner with leaders across the compan... Show more

 • Promoted

Production Design Assistant - Development & Production

PepsiCoNew York, NY, United States
Full-time

Production Design Assistant Development & Production plays a critical support role within the Global Lifestyle Merchandise team, partnering closely with the Development and Production Lead to execu... Show more

 • Promoted

L&D Evaluator - Training Expert

MercorNew York, New York, United States
$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Training / onboarding / L&D Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesthetic, ... Show more

Design Build Leader - Environmental Consulting (Remote)

Woodard & CurranBronx, NY, United States
Remote
Full-time

Woodard & Curran is a national engineering, science, and operations firm with a simple vision for clean water, a safe environment, healthy communities, and happy people.As an employee-owned com... Show more

 • Promoted

Remote | Senior Brand & Visual Design Specialist — $75–$145/hour

24-MAGNew York, New York, United States
$75.00 hourly
Remote
Full-time +1
Quick Apply

We are sharing a specialised part-time consulting opportunity for experienced design professionals skilled in brand identity, graphic design, visual systems, campaign creative, typography, layout, ... Show more

Work Design Architect

UpsideNew York, NY, United States
Full-time

We created Upside to transform brick-and-mortar commerce.Our technology uses the sophistication of online retailprofit measurement, attribution, and incrementalityto provide users with more value o... Show more

 • Promoted

Design Studio Manager

Lutron ElectronicsNew York, NY, United States
Full-time

Lutron is seeking a dynamic Design Studio Manager to lead the Communications team in our New York City office location.As Design Studio Manager, you will provide operational leadership and team man... Show more

 • Promoted

Product Launch Expert - Evaluator

MercorNew York, New York, United States
$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Product launch / experiment readiness Evaluator.Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide deck... Show more

Process Design Specialist

Macy'sNew York, NY, United States
Full-time

Macy's is more than just a store.One that's captured the hearts and minds of America for more than 160 years.A story about innovations and traditionsabout inspiring stores and irresistible products... Show more

 • Promoted

Remote | AI Evaluation Guidelines & Rubric Specialist — $40–$60/hour

24-MAGNew York, New York, United States
$40.00 hourly
Remote
Full-time
Quick Apply

We are sharing a specialised full-time consulting opportunity for US-based linguists, instructional designers, and technical writers experienced in developing clear evaluation guidelines, structure... Show more

Education Evaluator - Domain Expert

MercorNew York, New York, United States
$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aesthetic, and presentation errors.Provide clear, str... Show more

Design Coordinator (Health + Education&Science)

HDRNew York, NY, United States
Full-time

At HDR, our employee-owners are fully engaged in creating a welcoming environment where each of us is valued and respected, a place where everyone is empowered to bring their authentic selves and n... Show more

 • Promoted

Design Director: Product Imagery & Brand Visualization - Remote

SkillNew York City, NY, United States
Remote
Full-time

A leading design consultancy is seeking a Design Director to enhance product presentation and brand fidelity.This full-time role focuses on managing brand design from concept to delivery, ensuring ... Show more

 • Promoted

Data Viz & Graphic Design Specialist -- Remote (Sports)

National Basketball Association (NBA)New York City, NY, United States
Remote
Full-time

A leading sports organization in New York is seeking a Project Employee for Data Visualization & Graphic Design.This role involves designing data-driven visuals that tell the WNBA's stories.Can... Show more

 • Promoted

Design Director (Digital Experience & AI)

Creative People Inc.New York, NY, United States
Full-time

Design Director (Digital Experience & AI).Location: NYC - hybrid, 3x a week.Company: global digital transformation agency and IT consulting firm partnering with companies to build custom digital pr... Show more

 • Promoted

Freelance Luxury Brand Evaluator - Central & Southern New Jersey, US

CXGWest Long Branch, NJ, United States
Full-time

Turn your passion for luxury into a career opportunity.Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles.Join CXG, the global leader in custo... Show more

 • Promoted

Business Strategy Expert Evaluator

MercorNew York, New York, United States
$80.00 hourly
Remote
Part-time
Quick Apply

Headquartered in San Francisco, our investors include.General business strategy / management Evaluator.Evaluate AI-generated artifacts against domain-specific quality rubrics.Identify factual, aest... Show more

Remote | LLM Red Team & Benchmark Evaluation Specialist — $55–$85/hour

24-MAGNew York, New York, United States
$55.00 hourly
Remote
Full-time
Quick Apply

We are sharing a specialised full-time consulting opportunity for AI evaluation and research professionals with experience identifying failure modes, vulnerabilities, edge cases, and hidden weaknes... Show more

Remote | Senior Marketing Strategy & AI Evaluation Specialist — $55–$75/hour

24-MAGNew York, New York, United States
$55.00 hourly
Remote
Full-time
Quick Apply

We are sharing a specialised full-time consulting opportunity for US-based senior marketing professionals with deep experience in brand strategy, growth marketing, performance marketing, and struct... Show more