Job description
Scale AI • San Francisco, CA; New York, NY
About This Role
Lead applied ML engineering on Scale's Applied ML team, powering data infrastructure for leading agentic LLMs (ChatGPT, Gemini, Llama). You will build scalable multi-agent systems to validate agentic reasoning and behaviors, scale human expertise, and drive research into real-world agent reliability failures despite strong benchmarks, shipping production fixes.
Ideal for exceptional engineers with deep research rigor and a relentless focus on practical, high-impact systems. You will iterate rapidly with data, leverage AI tools to accelerate development, and collaborate tightly across engineering, product, and research.
If you excel at turning frontier agent research into reliable deployed systems, we want to hear from you.
You will:
-
Build and deploy multi-agent systems for agentic reasoning validation
-
Develop pipelines to detect errors and scale human judgment
-
Combine classical ML, LLMs, and multi-agent techniques for reliability
-
Lead research into agent failure modes and ship fixes
-
Use AI tools to speed prototyping and iteration
-
Build data-driven evaluations and deploy rapid improvements
-
Integrate systems into Scale's platform