About the job
Job Title: AI Response Evaluator
Location: Remote
Type: Contract / Freelance
Language: Arabic (MSA)
Overview
We are hiring multilingual annotators to support Supervised Fine-Tuning (SFT) projects by creating high-quality, step-by-step responses (“trajectories”) across multiple languages. This role focuses on ensuring reasoning clarity, linguistic accuracy, and cultural relevance for Arabic speakers.
Key Responsibilities
- Create structured question → reasoning → answer annotations
- Write clear and logical step-by-step explanations
- Translate and adapt content while preserving meaning and reasoning
- Review and improve multilingual responses for clarity and consistency
- Ensure outputs are natural, accurate, and culturally appropriate
Requirements
- Fluency in Modern Standard Arabic for the task and English for understanding guidelines
- Strong writing and comprehension skills
- Ability to break down complex ideas into simple, structured steps
- High attention to detail and consistency
Nice to Have
- Experience in annotation, translation, or content writing
- Familiarity with AI training data or SFT workflows
- Background in linguistics, education, or communication
What Success Looks Like
- Clear, well-structured reasoning across all outputs
- Consistent quality across languages
- Strong alignment with guidelines and tone
Compensation
- Competitive, based on language and experienc