Data Analyst (AI Evaluation)

• Review datasets and detailed task outputs for accuracy, completeness, and adherence to guidelines.
• Identify and flag inconsistencies, errors, and outputs that deviate from provided instructions.
• Apply structured rubrics and evaluation criteria consistently across large data sets.
• Exercise sound judgment and document rationale in ambiguous scenarios where guidelines are unclear.
• Escalate patterns or recurring data issues for further analysis rather than addressing them individually.
• Provide clear, actionable written and verbal feedback pinpointing issues and suggesting resolution paths.
• Maintain meticulous attention to detail while working through high volumes of repetitive data review assignments.

• No prior experience in AI is required.
• Baseline fluency with spreadsheets (sorting, filtering, simple formulas).

• 3–5+ years of experience in data review, data quality, quality assurance, or analytical roles.
• Proven expertise in reviewing, validating, and critiquing data or deliverables based on explicit criteria.
• Exceptional ability to follow detailed written instructions and apply complex evaluation rubrics precisely.
• Demonstrated comfort with ambiguity, including making justifiable decisions when guidelines are incomplete.
• Advanced attention to detail and error-spotting capabilities across repetitive or high-volume work.
• Strong written and verbal communication skills for documenting findings and providing feedback.
• SQL or hands-on data querying is a plus.
• Experience with data annotation, labeling, or rubric-based evaluation is advantageous.

Also listed: attention to detail.

Project and contracting process: the hiring partner. Applications continue on the provider's website.