Research Scientist, AI Controls and Monitoring

San Francisco Bay Area, New York, NY

$197,400 - $246,750

• In this role, you'll design methods and experiments to ensure AI models remain aligned with intended goals in high-stakes environments.
• Develop monitoring techniques to track AI behavior in real time and identify deviations and anomalies.
• Research control mechanisms including fail-safes, oversight protocols, and intervention methods for AI systems.
• Design red-team simulations to probe weaknesses in oversight and control mechanisms.
• Collaborate with policymakers and researchers to establish standards and benchmarks for AI monitoring.

Scale AI is a company that provides training data for machine learning teams, as well as various other services including testing and evaluation. They work with generative AI companies, the US government, and various enterprises.