AI Policy Reviewer (Remote)

About the role

The AI Policy Reviewer ensures that AI‑generated and user‑generated content complies with internal governance, regulatory standards, and responsible AI principles. Working remotely, you will act as a quality‑assurance checkpoint, safeguarding model integrity by identifying safety risks, bias, misinformation, and policy violations.

Key responsibilities

• Review and score AI responses against detailed policy rubrics, assessing safety, truthfulness, fairness, and alignment with community guidelines.
• Identify and flag edge cases where policy interpretation is ambiguous or the model misbehaves.
• Analyze data to uncover systematic flaws, bias patterns, or hallucinations and report them to Product and Engineering teams.
• Collaborate with Policy teams to refine evaluation rubrics and test their teachability to AI models.
• Participate in adversarial testing (red‑team) to expose vulnerabilities before product launch.
• Provide clear, written explanations of rating decisions to engineers and policy experts.
• Create high‑quality prompt‑response examples for “golden sets” used in model training.

Required profile

• Minimum 3 years of experience in Trust & Safety, Content Policy, Risk Analysis, or Legal/Compliance review.
• Deep knowledge of content moderation policies covering hate speech, harassment, misinformation, and graphic violence.
• Strong analytical ability to deconstruct AI outputs and detect logical flaws, hallucinations, or subtle biases.
• Excellent written communication skills for explaining technical issues to cross‑functional teams.
• Proven emotional resilience and self‑care strategies for handling disturbing content.

Required skills

• Familiarity with large language model platforms (e.g., ChatGPT, Gemini).
• Proficiency with dashboard and spreadsheet tools for data analysis.
• Experience using specialized content review and risk‑analysis tools.