AI Policy Reviewer – Remote (Worldwide)

About the role

The AI Policy Reviewer ensures that AI‑generated and user‑generated content complies with internal governance, regulatory standards, and responsible AI principles. Working remotely, you will act as a quality‑assurance gatekeeper, protecting model integrity and safeguarding users from unsafe or biased outputs.

Key responsibilities

• Review and score AI responses against detailed policy rubrics, assessing safety, truthfulness, fairness, and alignment with community guidelines.
• Identify and flag edge‑case scenarios where policy application is ambiguous or the model misinterprets policy.
• Analyze data to uncover systematic flaws, bias, hallucinations, or policy gaps and report findings to Product and Engineering teams.
• Collaborate with policy teams to refine evaluation rubrics and create high‑quality “golden set” prompts and responses.
• Participate in adversarial testing (red‑team exercises) to expose vulnerabilities before product launch.
• Work closely with Machine Learning Engineers to explain rating decisions and help adjust model behavior.

Required profile

• Minimum 3 years of experience in Trust & Safety, Content Policy, Risk Analysis, or Legal/Compliance review.
• Deep knowledge of content moderation policies covering hate speech, harassment, misinformation, and graphic violence.
• Strong analytical ability to deconstruct AI outputs, detect logical flaws, hallucinations, and subtle biases.
• Excellent written communication skills for explaining findings to engineers and policy experts.
• Emotional resilience and self‑care strategies for handling disturbing content.

Required skills

• Familiarity with large language models (e.g., ChatGPT, Gemini).
• Proficiency with dashboards and spreadsheet tools for data analysis.
• Experience using specialized content review platforms.

What we offer

• Fully remote work with a global, interdisciplinary team.
• Opportunity to shape responsible AI practices at scale.
• Competitive compensation and professional development resources.