Anthropic is looking for a Staff+ Software Engineer to join its Safeguards team and help build safety and oversight mechanisms for AI systems. The role focuses on developing monitoring and abuse detection systems, creating dashboards for analysts, surfacing abuse patterns to research teams, and building robust, scalable defenses to prevent misuse of models while ensuring user well‑being.
Staff+ Software Engineer, Safeguards en Anthropic
Híbrido - San Francisco, CA; New York City, NY
Más vacantes en AnthropicSalary
USD 320,000 - 485,000
Requirements
Skills
- Bachelor’s degree in Computer Science, Software Engineering or comparable experience
- Proficiency in Python and Typescript
- Ability to work across the stack
- Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders
- 8+ years of experience in a software engineering position (strong candidates may have)
- Experience with integrity, spam, fraud, or abuse detection and mitigation
- Experience building trust and safety detection mechanisms and intervention for AI/ML systems
- Experience with prompt engineering, jailbreak attacks, and other adversarial inputs
- Experience working closely with operational teams to build custom internal tooling
Responsibilities
- Develop monitoring systems to detect unwanted behaviors from API partners and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review
- Build abuse detection mechanisms and infrastructure
- Surface abuse patterns to our research teams to harden models at the training stage
- Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale
Technologies
PythonTypescript
Descubre si tu currículum está listo para esta vacante
Mira cómo nuestra IA puede optimizar tu currículum y aumentar tus chances en este puesto.