white imac and apple magic keyboard

AI Evaluator / Annotator (Remote- freelance)

About the Company

At iMerit, we are dedicated to shaping the evaluation standards for next-generation multimodal AI systems. We offer an innovative and supportive global working environment where you can contribute to the development of advanced large language models, vision models, and multimodal AI systems.

Position Overview

We are currently seeking detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities including text, image, video, and multimodal interactions. As an AI Evaluator / Annotator, you will play a crucial role in ensuring that AI model outputs align with project standards and real-world use cases.

Role Responsibilities

As an AI Evaluator / Annotator, your responsibilities will include evaluating outputs generated by large language models, assessing quality against project-specific criteria, identifying errors or biases in AI responses, providing detailed feedback, and collaborating with project managers and quality leads to meet benchmarks.

Skills & Competencies

To excel in this role, you should have strong critical reading, observational, and evaluative skills across different modalities. Excellent English comprehension, familiarity with generative AI and multimodal systems, and the ability to apply guidelines consistently are also key competencies required.

Requirements

The ideal candidate should have a Bachelor’s degree or equivalent educational qualification, at least 1 year of experience in data annotation or related AI/ML domains, and a strong understanding of language and multimodal communication. Adaptability, attention to detail, and the ability to work in fast-paced environments are essential.

What We Offer

At iMerit, you will have the opportunity to work with the best of the best in the industry, receive competitive compensation, and enjoy flexible remote working arrangements. Continuous learning and growth in applied AI evaluation are also part of the package.

Conclusion

If you are passionate about AI evaluation and eager to contribute to the development of cutting-edge AI systems, this remote freelance position at iMerit is worth applying for. Join us in shaping the future of AI evaluation and make a difference in the world of artificial intelligence.

Apply Now



🧠Get Paid for Your Insights with Respondent
Join Respondent.io and participate in high-paying research interviews and surveys. Companies are looking for your opinionβ€”whether you are a professional, student, or just have experience to share.
βœ… Earn $25 to $300+ per study
βœ… Remote interviews via Zoom
βœ… Free to join
πŸ‘‰ Sign Up for Respondent
(Affiliate/partner link. Your sign-up helps support this site.)

Author: Amy