Job Application: AI Evaluator / Annotator
About the Company: iMerit
iMerit is seeking detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities.
Role Description
Position Overview: iMerit is looking for individuals to evaluate outputs generated by LLMs across multiple modalities such as text, image captions, video descriptions, and multimodal prompts.
Responsibilities
– Evaluate the quality of AI system outputs against project-specific criteria
– Provide detailed feedback and scoring of outputs
– Collaborate with Project Managers and Quality Leads to meet benchmarks
Skills & Requirements
– Strong critical reading and evaluative skills
– Bachelor’s degree or equivalent qualification
– 1+ years of experience in data annotation or related AI/ML domains
– Ability to adapt quickly to changing project directions
What We Offer
– Opportunities to shape the evaluation standards for next-generation multimodal AI systems
– Competitive compensation and flexible remote working arrangements
– Continuous learning and growth in applied AI evaluation
Selection Process
– Platform assessment (15–30 minutes)
– Quality test after 10 hours of work
– 3-month project with potential for further opportunities
Commitment
– Minimum 20 hours per week with flexible scheduling
– Hourly rates vary based on location
Why This Remote Job is Worth Applying For
This remote job with iMerit offers the opportunity to work with cutting-edge AI technology, shape the future of AI systems, and be part of a supportive global team. With competitive compensation, flexible working arrangements, and continuous learning opportunities, this role provides a rewarding and dynamic work experience.
✅ Want to Learn Tech Skills & Boost Your Career?
Try SheCodes – beginner-friendly coding workshops made for women.
Many graduates land freelance work or jobs earning $20–$40/hour after completing a course.
Start with a free intro, then level up at your own pace.
(Affiliate link. Your sign-up helps support this site.)
