Data Scientist, Developer Productivity at Anthropic

On-site - San Francisco, CA; New York City, NY

The role involves partnering with Developer Productivity engineering leadership to define and drive the strategy for measuring, understanding, and improving developer productivity in an AI‑first organization. The candidate will own the end‑to‑end data strategy, conduct investigations, build evidence, and influence cross‑functional teams.

Requirements

Skills

Experience writing production-quality SQL and Python (or a similar language) to build pipelines, dashboards, and models independently
Experience serving as the primary data or analytics voice in a space where the questions weren't yet well-defined, and helping define them
A track record of holding conclusions loosely — favoring instrumentation and evidence-gathering over defending a prior position, and revising views in public when the evidence warrants it
Experience shaping what an engineering or product team worked on, not only measuring what they shipped — being consulted before a decision was made, not just after
Genuine interest in how AI is changing the way software gets built, with some firsthand experience grappling with the harder, less-defined parts of that question
Comfort presenting data-backed conclusions to a room of engineers, including when that means saying a built feature isn't moving the needle
8+ years of hands-on data science experience, ideally in infrastructure, performance, or platform contexts
Direct experience with developer productivity, developer experience, or internal tooling, at any scale

Responsibilities

Lead ambiguous, high-stakes investigations where the question isn't yet well-formed — from "is Claude making engineers faster?" to "what does 'faster' even mean here?"
Treat findings as provisional in a space that changes month to month. Bias toward instrumenting first, collecting evidence broadly, and revising the team's priors as the picture sharpens
Partner with Developer Productivity engineering leadership to set the team's measurement and research agenda — what to study, what to build, what to stop
Define the metrics framework for developer productivity in an AI-augmented org, and drive its adoption as the basis for tooling and infrastructure investment decisions
Design and run experiments on internal tooling and workflow changes; build the causal evidence base for what actually moves productivity
Influence engineering, infrastructure, and product leadership with data. Push back when the data doesn't support the prevailing narrative, and say so plainly when it doesn't support yours either
Build the analytical foundations (pipelines, dashboards, models) yourself or through partners — staying hands-on and close to the work rather than directing from a distance

Technologies

SQLPython

Share job

See if your resume is ready for this job

See how our AI can optimize your resume and improve your chances for this role.