AI Policy Reviewer (Remote)

About the role

The AI Policy Reviewer ensures that AI‑generated and user‑generated content complies with internal governance, regulatory standards, and responsible AI principles. Working remotely, you will act as a quality‑assurance checkpoint, safeguarding model integrity by identifying safety risks, bias, misinformation, and policy violations.

Key responsibilities

• Review and score AI responses against detailed policy rubrics, assessing safety, truthfulness, fairness, and alignment with community guidelines.
• Identify and report systematic flaws, bias, hallucinations, or policy gaps to Product and Engineering teams.
• Collaborate with policy teams to refine evaluation rubrics and create high‑quality “golden set” prompts and responses.
• Participate in adversarial testing (red‑team) to uncover jailbreaks and unsafe outputs before product launch.
• Work closely with Machine Learning Engineers, explaining rating decisions to help adjust model behavior.
• Handle complex edge cases where policy application is ambiguous, making nuanced judgement calls.

Required profile

• Minimum 3 years of experience in Trust & Safety, Content Policy, Risk Analysis, or Legal/Compliance review.
• Deep knowledge of content moderation policies covering hate speech, harassment, misinformation, and graphic violence.
• Strong analytical ability to deconstruct AI responses and detect logical flaws, hallucinations, or subtle biases.
• Excellent written communication to explain findings to engineers and policy experts.
• Emotional resilience to handle disturbing content and proven self‑care strategies.

Required skills

• Familiarity with large language models (e.g., ChatGPT, Gemini).
• Experience using content moderation and review dashboards.
• Proficiency with spreadsheets for data analysis.