Safeguards Analyst, User Well-being

Job Description

Job Title: Safeguards Analyst, User Well-being. Location: San Francisco, CA | New York City, NY

Note: This role may involve reviewing sensitive or explicit content, including material of a sexual, violent, or psychologically distressing nature.

Responsibilities:

• Design scalable, accurate automated enforcement systems and review processes.
• Collaborate with Engineering and Data Science teams to improve policy violation detection models.
• Analyze flagged content and drive continuous improvement of enforcement policies.
• Enforce usage guidelines to prevent harmful or abusive use of AI technologies;
• Identify and close policy gaps based on real-world enforcement data;
• Stay informed on evolving best practices in AI policy enforcement and digital well-being.

Qualifications:

• Bachelor’s degree or equivalent experience in a related field.
• Proven experience in standing up scalable enforcement workflows.
• Proficient in SQL and data analysis tools for deriving insights from large datasets;
• Familiarity with generative AI tools and prompt engineering for content evaluation;
• Experience navigating content moderation, child safety, and regulatory frameworks (e.g., CSAM, NCII).
• Ability to work cross-functionally with Product, Engineering, Policy, and Legal teams.
• Strong communication and collaboration skills in fast-changing environments.

Benefits:

• Competitive annual salary: $170,000 – $200,000 USD.
• Hybrid work model with a minimum of 25% in-office presence.
• Visa sponsorship available (evaluated case-by-case);
• Work with leading experts at the intersection of AI, safety, and policy;
• Join a mission-driven organization prioritizing ethical AI deployment.