Safeguards Policy Analyst, Fraud & Scams at Anthropic

Remote - San Francisco, CA, USA; New York City, NY, USA

Apply
More jobs at Anthropic

Safeguards Policy Analyst, Fraud & Scams is a role focused on designing, building, and executing enforcement workflows that detect and mitigate fraud and scam-related harms on Anthropic's products. The analyst will serve as a subject‑matter expert on fraud typologies, scam ecosystems, and threat actors, translating expertise into durable and scalable policies. Working within the Integrity & Authenticity team, the analyst will own policies, collaborate closely with threat investigative and enforcement teams, develop guidelines for classifiers, and engage in cross‑functional workstreams to protect users from financial, psychological, and disturbing content.

Salary

USD 245,000 - 285,000

Requirements

Skills

  • Trust & Safety professional with a focused background in fraud, scams, or financial crime – particularly in a tech platform or AI context
  • Experience writing, iterating on, and managing operational policies for fraud or abuse prevention at scale
  • Threat modeling for fraud and scam ecosystems, including social engineering, romance scams, investment fraud, impersonation, and phishing
  • Identifying and articulating common fraud tactics (e.g., pig butchering, advance fee fraud, account takeover facilitation) and how they manifest on AI platforms
  • Using SQL or other data analysis tools to identify trends, measure enforcement efficacy, and surface policy gaps
  • Collaborating cross-functionally with Engineering, ML, Legal, and Policy teams on safety initiatives
  • Working with generative AI products, including writing effective prompts for content review and enforcement use cases
  • Thriving in a fast-paced, ambiguous environment where priorities shift and the threat landscape evolves rapidly

Responsibilities

  • Draft, maintain, and iterate on Fraud & Scams policies governing Anthropic's products and APIs
  • Conduct regular structured policy reviews to identify gaps, ambiguities, and coverage failures
  • Develop detailed threat models for fraud and scam vectors and translate them into enforceable policy language
  • Stay current on the fraud and scam landscape, including emerging typologies, regulatory shifts, and threat actor tactics
  • Design and architect automated enforcement systems and human review workflows that scale effectively while maintaining high precision and recall
  • Review flagged content to drive enforcement decisions and surface policy improvements
  • Define and manage precision/recall tradeoffs in enforcement, working with data science teams to continuously tune classifiers and detection signals
  • Build and maintain an effective feedback loop between threat intelligence, policy, and enforcement operations
  • Serve as the primary policy point of contact for ML and Engineering teams developing fraud detection classifiers
  • Partner with Product, Engineering, and Data Science teams to optimize detection models, automated enforcement pipelines, and tooling for fraud-specific policy violations
  • Collaborate with external researchers, law enforcement liaisons, and fraud SMEs
  • Educate and align internal stakeholders—including Legal, Public Policy, and Go-to-Market teams—around Anthropic's fraud and scams policies and enforcement approach
  • Serve as an internal resource on fraud risk, briefing leadership and cross-functional partners as threats evolve
  • Contribute to Anthropic's external communications and policy documentation related to fraud and platform integrity where relevant

Technologies

SQLData analysis toolsMachine Learning (ML)EngineeringData ScienceArtificial Intelligence (AI)Generative AI productsPolicy enforcement classifiersAutomation pipelines

Share job

See if your resume is ready for this job

See how our AI can optimize your resume and improve your chances for this role.