Arabic AI Session Reviewer

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: AI Session Annotator (Arabic)
Type: Contract
Compensation: $17$23/hour
Location: Remote

Role Responsibilities

• Review recorded sessions where users interact with an AI assistant via voice and camera.
• Compare the assistants responses with visible video content to identify hallucinated or fabricated details.
• Score sessions on visual interpretation accuracy relevance and response timing including spatial language use.
• Judge the appropriateness and timing of warnings related to health safety or financial security.
• Write detailed comments supporting each score with concrete evidence from sessions.
• Capture conversation turns in the intake form.

Qualifications

Must-Have

• Native or native-level Arabic spoken and written.
• Clear precise written Arabic.
• An Android phone with a working camera and microphone. This is mandatory for the project.
• Attention to detail and consistent rubric application.
• Professional English reading comprehension.

Preferred

• Experience in data annotation linguistic QA content moderation or AI model evaluation.
• Training in linguistics translation or interpreting.
• Ability to recognize unnatural or non-native Arabic.

Start Date

• Immediate; high volume of work between 26 to 31 Aug is expected.

Application Process (Takes 2030 mins to complete)

• Submit your resume or relevant background.
• Complete a short calibration task on sample sessions assessed on scoring consistency and comment usefulness.

Resources & Support

• For details about the interview process and platform information please check:
• For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.