Software Engineer in the Safeguards Foundations team, building internal tooling for human review. The role is full‑stack, focusing on product design, API, data storage, and integration with detection systems, working closely with trust & safety operations, policy, and engineering teams. The work directly impacts AI safety by improving the reliability, speed, and usability of internal review tools.
Software Engineer, Safeguards Foundations (Internal Tooling) at Anthropic
Hybrid - London, UK
More jobs at AnthropicSalary
GBP 255,000 - 325,000
Requirements
Skills
- 4+ years of experience as a software engineer, with meaningful time spent building internal tools, operations platforms, or back‑office products
- Comfortable using agentic coding tools (e.g., Claude Code) as a core part of your workflow, able to ship well‑tested, production‑quality software at a high cadence without lowering the bar
- Product‑minded approach to internal users, working with people who use the tools, watching where they struggle, and fixing it
- Results‑oriented, with a bias toward flexibility and impact
- Able to pick up slack, even if it goes outside the job description
- Clear communication with non‑engineering stakeholders and ability to explain technical trade‑offs to operations and policy partners
- Concern for the societal impacts of work and willingness to apply engineering skills directly to AI safety
- Experience building tooling in trust & safety, content moderation, fraud, integrity, or risk‑operations setting (strong candidates)
- Experience designing case‑management or workflow systems (queues, SLAs, escalation paths, audit logs)
- Experience working with sensitive data and understanding privacy, access‑control, and reviewer‑wellbeing considerations
- Experience with GCP/AWS, Postgres/BigQuery, and CI/CD in a production environment
- Experience using LLMs as a building block inside operational tools (e.g., assisted triage, summarisation, classification)
Responsibilities
- Design, build, and maintain the internal review and enforcement tooling used by Safeguards analysts, including case queues, content review surfaces, decision/audit logging, and account‑actioning workflows
- Understand user workflows and establish tooling for well‑processes that may be distributed across a number of tools and UIs
- Develop the base layer of reusable APIs, data storage, and backend services that let new review workflows be stood up quickly and safely
- Partner with operations and policy teams to understand reviewer pain points and translate them into clear product improvements that reduce handling time and decision error
- Integrate tooling with upstream detection systems and downstream enforcement infrastructure so that flagged behaviour flows cleanly from signal → human review → action
- Build in the guardrails that sensitive internal tools require: granular permissions, audit trails, data‑access controls, and reviewer wellbeing features
- Instrument the tools you ship—surfacing metrics on queue health, reviewer throughput, and decision quality so the team can see what’s working
- Contribute to the Foundations team’s shared platform and on‑call responsibilities
Technologies
ReactTypeScriptPythonGCPAWSPostgresBigQueryCI/CDLLMsClaude Code
See if your resume is ready for this job
See how our AI can optimize your resume and improve your chances for this role.