AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in MemphisMediabistro • Memphis, TN, United States

No longer accepting applications

AI Communication Quality & Culture Evaluator Job at Hireio, Inc. in Memphis

Mediabistro • Memphis, TN, United States

23 days ago

Job type

Full-time

Job description

Overview

Join a collaborative remote team working to make AI communication emotionally intelligent, culturally aware, and engaging.

Responsibilities

Score AI messages for tone, empathy, and contextual awareness
Identify subtle errors like “overly agreeable” or “lack of personality”
Write short creative samples to model ideal AI tone
Evaluate humor, pop culture references, and archetype use
Maintain high scoring consistency with the evaluation team

Qualifications

Native or near-native US English proficiency

Strong reading comprehension and precision tagging skills

Deep familiarity with American conversational norms and humor

Background in writing, editing, moderation, or customer engagement

Bonus

Psychology, creative writing, or linguistics degree

AI tools or chatbot evaluation experience

$25–$30 / hr

#J-18808-Ljbffr

Create a job alert for this search

Evaluator • Memphis, TN, United States

Related jobs

AI Evaluation Analyst

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for an AI Evaluator / Annotator (Remote- freelance, 100+ openings).Key Responsibilities Evaluate outputs generated by large language models (LLMs) across multiple modalities ...Show more

Last updated: 18 days ago • Promoted

AI Data Specialist

VirtualVocations • Memphis, Tennessee, United States

Part-time

A company is looking for an AI Data Specialist to support the improvement of AI-generated content in English.Key Responsibilities Perform data collection, evaluation, and annotation Conduct pair...Show more

Last updated: 30+ days ago • Promoted

AI Audit Specialist

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for an AI Audit Methodology Specialist.Key Responsibilities Design, test, and refine prompts and datasets to enhance AI accuracy in audit documentation Curate and contextual...Show more

Last updated: 2 days ago • Promoted

AI Multimedia Evaluator

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for an AI Multimedia Generation Product Evaluator.Key Responsibilities Set up Halo tasks and run model inference Audit annotations from vendors and manage evaluation dataset...Show more

Last updated: 3 days ago • Promoted

Remote Equity Research Analyst – AI Trainer ($50-$60 / hour)

Data Annotation • Bartlett, Tennessee

Remote

Full-time +1

We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...Show more

Last updated: 10 days ago • Promoted

Impact Evaluator

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for an Impact Evaluator to design and implement systemic impact evaluation across the organization.Key Responsibilities Develop and refine the organization's evaluation frame...Show more

Last updated: 1 day ago • Promoted

Director of AI Content Strategy

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for a Director, AI Content Strategist to lead the development and execution of AI-powered content strategies. Key Responsibilities Lead content strategy for digital experience...Show more

Last updated: 2 days ago • Promoted

Monitoring and Evaluation Specialist

VirtualVocations • Memphis, Tennessee, United States

Temporary

A company is looking for a Monitoring, Evaluation, Research and Learning Specialist for a 5-6 month contract.Key Responsibilities Collect team-wide input on data collection instruments Program, ...Show more

Last updated: 2 days ago • Promoted

AI Quality Rater

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for a Generalist AI Quality Rater (US-Remote).Key Responsibilities Design prompts tailored to tasks, contexts, and audiences Generate creative and informative texts such as ...Show more

Last updated: 2 days ago • Promoted

AI Implementation Manager

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for an AI Implementation Manager to oversee the delivery of enterprise Voice AI programs from initiation to go-live. Key Responsibilities Manage project delivery, including ki...Show more

Last updated: 4 days ago • Promoted

LLM Quality Analyst

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for a LLM Quality Analyst to support the quality and reliability of AI outputs.Key Responsibilities Manage LLM feedback intake and triage, identifying patterns in quality iss...Show more

Last updated: 16 hours ago • Promoted • New!

Multimodal AI Evaluation Analyst

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for a Multimodal AI Evaluation Analyst.Key Responsibilities Evaluate and score AI-generated outputs across various modalities Assess quality, correctness, coherence, style, ...Show more

Last updated: 18 hours ago • Promoted • New!

Clinical Practice Evaluation Specialist

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for a Practice Evaluation Specialist III.Key Responsibilities Manage coordination of internal and external provider peer review and comprehensive quality review of electronic...Show more

Last updated: 30+ days ago • Promoted

Generative AI Red Team Specialist

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for a Generative AI Associate - Red Teaming Specialist.Key Responsibilities Complete training on AI / ML, LLMs, Red Teaming, and jailbreaking Craft prompts to bypass filters o...Show more

Last updated: 3 days ago • Promoted

AI Data Project Manager

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for an Agent Evaluation Analyst.Key Responsibilities Take ownership of delivery team projects, ensuring data quality and timely delivery Lead a cross-functional team to keep...Show more

Last updated: 1 day ago • Promoted

Test & Evaluation Specialist

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for a Test & Evaluation Specialist to support software testing and evaluation in a remote setting.Key Responsibilities Produce and maintain quality test scripts, collaboratin...Show more

Last updated: 2 days ago • Promoted

Research and Evaluation Coordinator

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for a Coordinator of Research and Evaluation.Key Responsibilities Organizes literature on scratch cooking in schools and summarizes key takeaways for program evaluation Mana...Show more

Last updated: 22 hours ago • Promoted • New!

AI Multimedia Generation Evaluator

VirtualVocations • Memphis, Tennessee, United States

Full-time

A company is looking for a Software Engineer II to evaluate AI multimedia generation products for images and videos.Key Responsibilities Set up Halo tasks and run model inference Audit annotatio...Show more

Last updated: 1 day ago • Promoted