Content Specialist - Conversational AI Quality

Job Description

Job Description

We are seeking a highly skilled Conversational AI Content & Quality Specialist to join our team. In this role, you will write, review, edit, and evaluate content, with a focus on improving AI model conversational quality through expert prompt engineering and annotation. This position requires exceptional editorial judgment, deep experience with AI tools, and the ability to assess and enhance conversational experiences in emerging generative AI technologies.

Responsibilities :

Write, edit, and review a variety of content, from creative copy to AI model prompts.

Perform qualitative annotation and evaluation of AI model outputs, assessing conversationality and overall quality.

Identify and address conversational quality issues through effective prompting practices.

Design, test, and refine system prompts using clear, compelling natural language to improve AI performance.

Apply and interpret guidelines with critical thinking, adapting to novel or ambiguous scenarios.

Conduct analysis and produce actionable insights for cross-functional teams.

Maintain high standards of accuracy and consistency when reviewing content at scale.

Collaborate with content and product teams to enhance user experience.

Support quality control for large datasets on nuanced topics such as politics, bias, gender, and religion.

Work extended or weekend schedules as required.

Minimum Qualifications :

6+ years in journalism, digital content strategy, production, or related fields.

Demonstrated expertise in prompt engineering, annotation, and AI tool usage.

Strong editorial judgment and experience reviewing sensitive or nuanced subject matter.

Excellent writing, editing, and communication skills (familiarity with AP Style preferred).

Proficiency in spreadsheet tools (Google Sheets, MS Excel) and basic data visualization.

Ability to work independently and manage multiple priorities in a fast-paced environment.

Preferred Qualifications :

Knowledge of the social media landscape and platform trends.

Storytelling expertise across text, audio, and video formats.

Experience in multimedia content creation, photo editing, or video production.

Background in creative writing or other content creation disciplines.

Education :

Bachelor's degree required.

Pursuant to the California Fair Chance Act, Los Angeles County Fair Chance Ordinance for Employers, Los Angeles Fair Chance Initiative for Hiring Ordinance, and San Francisco Fair Chance Ordinance, qualified applicants will be considered for assignment with arrest and conviction records. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness, meet client expectations, standards, and accompanying requirements, and safeguard business operations and company reputation.

Location : United States (Remote)

Role type : Contract 6 Month Position

Expected hours : 40 per week

Benefits :

• Dental insurance
• Health insurance
• Health savings account
• Life insurance
• Paid time off
• Retirement plan
• Vision insurance

Schedule :

Application Question(s) :

Language :