Media Quality Evaluator (AI Training Data)
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview
Our client is a US-based AI research company working on advanced generative and multimodal AI systems.We are looking for a Visual Content Annotator / Media Quality Evaluator to review and evaluate images and videos using structured rating frameworks and detailed quality guidelines.
In this role, you will assess both AI-generated and real-world media content for realism, composition, motion accuracy, lighting, and overall production quality. Your evaluations will directly contribute to improving next-generation AI models.
This role requires strong visual judgment, high attention to detail, and the ability to work consistently across high-volume review tasks.
What You’ll Do
- Review images and videos using predefined evaluation guidelines and scoring frameworks
- Assess realism, composition, lighting, motion, camera movement, and production quality
- Provide clear written justifications for evaluation decisions
- Maintain high consistency and accuracy across large annotation workloads
- Identify quality issues and inconsistencies in generated or real-world media
- Apply structured reasoning when following complex annotation instructions
- Incorporate feedback and guideline updates into ongoing annotation work
- Collaborate with remote teams working on AI training data and evaluation
Commitments Required: 8 hours per day with an overlap of 4 hours with PST.
Employment type: Contractor assignment (no medical/paid leave)
Duration of contract: 4 weeks
Location: India, Pakistan, Bangladesh, Turkey, Nigeria, Ghana
Selection process: 3x30min quizzes related to AI Prompt Generation
Experience working in media, creative, design, or production environments strongly preferred
Mandatory: hands-on experience working with designers, photographers, videographers, or creative teams
Strong understanding of visual quality, motion realism, lighting, framing, and composition
Experience with AI image or video generation tools is a strong plus
Strong analytical thinking and ability to follow structured guidelines
Excellent written English communication skills
Ability to stay consistent across repetitive, high-volume tasks
Availability to work 40 hours per week
Ability to start quickly preferred
Work in a fully remote environment.
Opportunity to work on cutting-edge AI projects with leading Tech companies.