AI Annotation Specialist - Fully Remote

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Location: Remote

• Review recorded sessions where users interact with an AI assistant via voice and camera.
• Compare the assistant's responses with visible video content to identify hallucinated or fabricated details.
• Score sessions on visual interpretation, accuracy, relevance, response timing, and use of spatial language.
• Evaluate if the assistant provided timely warnings on health, safety, or financial risks.
• Write detailed comments supporting each score with concrete evidence from sessions.
• Capture conversation turns in the intake form.

Qualifications

• Native or native-level French, spoken and written.
• Clear, precise written French.
• An Android phone with a working camera and microphone.
• Attention to detail and consistent rubric application.
• Professional English reading comprehension.

• Experience in data annotation, linguistic QA, content moderation, or AI model evaluation.
• Training in linguistics, translation, or interpreting.
• Ability to recognize unnatural or non-native French.

• Immediate. High volume of work expected between 26 to 31 Aug.

• Submit your resume or relevant background.
• Complete a short calibration task on sample sessions, assessed on scoring consistency and comment usefulness.

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
• For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.