Research Scientist, Frontier Risk Evaluations

San Francisco Bay Area, New York, NY

$197,400 - $246,750

• In this role, you'll design evaluation measures, harnesses and datasets for measuring risks from frontier AI systems.
• Build testing harnesses for AI models and systems to identify dangerous capabilities like security exploits.
• Work with government agencies and labs to scope and design evaluations measuring advanced AI risks.
• Publish evaluation methodologies and technical reports for policymakers.
• Prototype and instrument ML pipelines to translate research concepts into working systems.

Scale AI is a company that provides training data for machine learning teams, as well as various other services including testing and evaluation. They work with generative AI companies, the US government, and various enterprises.