Content Judgement Operations - Account Governance

Description

About the Team
The AI Data Service and Operations (ADSO) team provides both safety and non-safety data annotation services, as well as search operations support, for the company’s international products. Within ADSO, the Account Governance function focuses on ensuring high-quality data and enforcement standards related to account-level risks, including third-party content reposting and related governance scenarios.

Role Overview
In this role, you will support account governance initiatives by ensuring the accuracy, consistency, and reliability of annotated datasets used across policy enforcement and model evaluation. You will work closely with cross-functional stakeholders to uphold quality standards, improve workflows, and support scalable governance solutions across international markets.

Key Responsibilities
- Develop, refine, and maintain Operational Guidelines for assigned policy areas, translating policy intent into clear, actionable instructions and ensuring alignment with policy changes, platform updates, and operational best practices.
- Produce, validate, and maintain high-quality Testing Sets for calibration, labeler's evaluation, arbitration, and operational assessments, ensuring balanced coverage of scenarios, content types, and edge cases.
- Analyze complex, ambiguous, and high-risk cases to provide structured clarifications, reduce enforcement discrepancies, and make guideline and Testing Set improvements.
- Support arbitration, training, and calibration workflows by identifying misapplication patterns and operational gaps, driving measurable improvements in reviewer accuracy and consistency.
- Independently conducted analysis based on RCA findings and successfully addressed errors by updating guidelines, SOPs, and training materials.
- Track quality and operational metrics to identify improvement opportunities and drive continuous enhancements in enforcement accuracy, workflow efficiency, and cross-team effectiveness.
- Contribute to ad-hoc quality and governance initiatives that enhance enforcement quality, operational effectiveness, and team performance.

Requirements

Minimum Qualifications
- Strong command of English with exceptional attention to detail, clarity, and linguistic consistency.
- Bachelor’s degree or equivalent practical experience, preferably in policy, content moderation, trust & safety, quality-related roles.
- 2+ years of experience in quality assurance, training, editorial review, or a related field.
- Demonstrated QA experience handling third-party content reposting, cross-platform content reuse, or similar governance scenarios.
- High level of self-motivation, solution-oriented thinking, and ability to multi-task, prioritize, and meet strict deadlines in a fast-paced, collaborative environment.
- Fluency in English (written and verbal) is required.

Preferred Qualifications
- Familiarity with machine-executable logic, labeling or annotation frameworks, and testing or evaluation set workflows.
- Experience collaborating cross-functionally with Policy, Product, Governance, Engineering, or Training teams.
- Strong understanding of scenario coverage, positive/negative sample balance, and dataset validation methodologies.
- Ability to apply structured judgment to ensure data quality, consistency, and operational scalability.
- Experience working in content moderation, AI-related operations, or technical documentation is a strong plus.