Annotation Guidelines Specialist Internship
1. Overview of the Annotation Guideline Specialist role:
• Documentation and Grooming: The Guideline creation involves receiving annotation
requirements, defining the new annotation guideline process and understanding its main
requirements. It also involves discussing the annotation purposes with the key stakeholders and
aligning similar annotation approaches with the developer’s needs, as well as connecting with
the Data Engineering team and the Quality Assurance Lead for alignment on the annotation
outcomes. Draft or update guideline documents based on existing standards. Keep track with the
new requirements, guideline updates and the potential edge cases in new data
• Tool configuration: Testing the most fitting annotation approach and creating sample PoCs for
the Data engineering team to begin their workflows.
• Alignment & Testing: Explain the new guidelines and act as an expert resource for annotation
management and annotators. Drive the training sessions to test new or updated guidelines
before production.
• Stakeholder Coordination: Gathering requirements from the product owners and developers
and • Quality assurance: Assisting the quality assurance lead with identifying potential annotations
risks, monitoring data quality and arising issues and ensuring the overall process in compliance
with the annotation standards
assist with brainstorming and refining their needs and the outcomes.
2. Core responsibilities:
• Assist in drafting and updating annotation guidelines
• Gather and document annotation examples and edge cases.
• Maintain version control of guideline updates.
• Assist in creating PoCs.
• Validate classes, labels, tags used in the annotation workflow.
• Support in training sessions for different teams.
• Answer basic guideline-related questions.
• Collect annotator feedback and improvement suggestions.
• Assist with requirement clarification sessions with the stakeholders
• Assist in refining guidelines based on QA feedback
• Strong attention to detail
• Effective written and communication skills
• Problem-solving
• Organization and time management
• Ability to learn quickly and adapt to changing requirements