Curated AI safety and governance jobs

Research scientist role focused on frontier AI risk evaluations, including designing evaluation harnesses and datasets, testing dangerous capabilities, and communicating results to policymakers.

The role involves running evaluations on frontier AI systems to assess risks, including pre-deployment evaluations and analyzing model behavior.

Research scientist/engineer role focused on studying scheming, misaligned preferences, and evaluation techniques for frontier AI systems.

The role involves developing methods to mitigate false information in large language models, creating evaluation protocols, and conducting research in LLM security and interpretability.

Role focused on AI behavioral evaluations and oversight for harmful model behaviors, policy requirements, and frontier lab evaluation work.

PhD fellowship focused on researching mechanistic interpretability methods to enhance the security of large language models and address misinformation.

Responsible AI internship focused on AI policy, regulation, and the legal, societal, and ethical implications of AI.

Project officer role coordinating international dialogues, events, and researcher exchanges on general-purpose AI policy and security issues at a frontier AI policy lab.

AI Engineer building an adversarial AI evaluation platform for model performance, robustness, and risk evaluation, which is adjacent to AI safety work.

Policy Officer role supporting supervisory work on AI compliance, with a focus on monitoring generative AI providers and EU AI Act implementation and enforcement.

Applied scientist role focused on AI risk assessment and model evaluation, including safety/reliability evaluations, failure modes, vulnerabilities, and AI-specific risks for responsible AI deployment.

The Anthology Fund focuses on investments in trust and safety tooling that enhances AI safety and supports responsible AI deployment.

Senior data science role focused on AI risk assessment, model evaluation, and pricing frameworks for insuring AI systems; directly relevant to AI risk management and responsible AI.

Policy advisor role focused on building coalitions and supporting advocacy campaigns for AI policy and regulation, including legislative analysis and policy communications.

Project funding for journalists reporting on technology and society, with priority areas including AI regulation, AI industry investigations, and AI's societal impacts.

Full-stack engineering role building web applications and features for formal verification tools and AI safety infrastructure.

Technical staff role conducting AI alignment research, including threat modeling, empirical countermeasure testing, and communicating safety-focused findings.

Postdoctoral research role focused on mechanism design and game theory for robust AI alignment, including theoretical work on advanced AI behavior and alignment challenges.

The role focuses on detecting insider threats and safeguarding sensitive AI assets through security engineering, including developing detection rules and automating investigation workflows.