Curated roles
Browse roles focused on reducing risks from advanced AI systems, including alignment research, safety engineering, evaluations and related operations.
364 active roles found.
Research scientist role focused on post-training methods, interpretability, and evaluations to improve frontier AI model safety, robustness, and alignment.
Remote AI red team analyst role focused on adversarial testing of AI models, safety violations, bias, and policy compliance for frontier AI labs.
The Research Lead will develop and lead a research agenda focused on reducing catastrophic risks from advanced AI, mentoring a team and sharing findings through publications and policy briefings.
The Research Engineer will develop open-source verification tools and infrastructure for AI-assisted formal verification to ensure bug-free code.
A 5-day London incubator for people building AI safety projects and organizations, with funding for selected teams.
3-6 month fellowship working on an AI safety research project at Constellation's office workspace in the San Francisco Bay Area.
Lead LawZero's Evaluations Team to assess AI capability and safety claims through benchmarks, datasets, adversarial robustness testing, and red-teaming programs.
Research fellowship at CHAI focused on beneficial AI and human-compatible AI research, including alignment-relevant topics like reasoning, decision making, interpretability, reward learning, and adversarial attacks.
Remote mentor-led research fellowship on secure program synthesis, focusing on formal methods for AI systems, specification validation, and adversarial robustness to improve secure and reliable AI systems.
Senior red-team lead role focused on jailbreaking frontier AI models, finding high-severity vulnerabilities, and translating findings into mitigations for AI safety and security.
Technical project manager for FAR.AI's red-teaming programme, coordinating engagements with governments and frontier AI companies and supporting related technical, policy, and grant work.
Research fellowship program for AI safety and field-building work focused on reducing frontier AI risk, with tracks including policy & governance and systems security.
Research manager role leading an AIxCyber research fellowship, overseeing fellows and projects focused on mitigating risks from frontier AI.
Machine Learning Researcher focused on AI safety research, stress-testing advanced models, and informing safety evaluations for frontier AI systems.
The role involves building internal products and automations to enhance the operations of the AI Security Institute, focusing on AI safety and efficiency.
Technical role focused on security architecture, threat modeling, and red-teaming for frontier AI infrastructure, with some standards work involving labs and government stakeholders.
The Fellowship Manager will design and execute a fellowship program for AI safety researchers in Berlin, managing applications and operational responsibilities.
The role is a theoretical AI safety research position at LawZero focused on safe-by-design AI systems, formal safety guarantees, and analysis of frontier model risks.
The Senior Software Engineer II will develop AI tooling and ensure safe execution environments for automated code modifications within the Shared AI Tooling Layer.
Technical safety role focused on red-teaming, adversarial evaluations, safety benchmarks, and release gating for Reflection’s models.