Remote mentor-led research fellowship on secure program synthesis, focusing on formal methods for AI systems, specification validation, and adversarial robustness to improve secure and reliable AI systems.
Curated roles
Browse roles focused on reducing risks from advanced AI systems, including alignment research, safety engineering, evaluations and related operations.
343 active roles found.
Remote mentor-led research fellowship on secure program synthesis, focusing on formal methods for AI systems, specification validation, and adversarial robustness to improve secure and reliable AI systems.
Senior red-team lead role focused on jailbreaking frontier AI models, finding high-severity vulnerabilities, and translating findings into mitigations for AI safety and security.
Technical project manager for FAR.AI's red-teaming programme, coordinating engagements with governments and frontier AI companies and supporting related technical, policy, and grant work.
Research fellowship program for AI safety and field-building work focused on reducing frontier AI risk, with tracks including policy & governance and systems security.
Research manager role leading an AIxCyber research fellowship, overseeing fellows and projects focused on mitigating risks from frontier AI.
Machine Learning Researcher focused on AI safety research, stress-testing advanced models, and informing safety evaluations for frontier AI systems.
The role involves building internal products and automations to enhance the operations of the AI Security Institute, focusing on AI safety and efficiency.
Technical role focused on security architecture, threat modeling, and red-teaming for frontier AI infrastructure, with some standards work involving labs and government stakeholders.
The Fellowship Manager will design and execute a fellowship program for AI safety researchers in Berlin, managing applications and operational responsibilities.
The role is a theoretical AI safety research position at LawZero focused on safe-by-design AI systems, formal safety guarantees, and analysis of frontier model risks.
The Senior Software Engineer II will develop AI tooling and ensure safe execution environments for automated code modifications within the Shared AI Tooling Layer.
Technical safety role focused on red-teaming, adversarial evaluations, safety benchmarks, and release gating for Reflection’s models.
Senior software engineer building shared platform, tooling, and evaluation infrastructure for the Chem-Bio team’s technical research on AI capability risks, CB misuse, and safeguards.
Lead the Chem-Bio engineering function building shared platform, tooling, and evaluation infrastructure for technical research on advanced AI capabilities, misuse risks, and safeguards.
The Model Behavior Architect role focuses on improving LLMs' function calling and tool use through model evaluation and rigorous testing.
Backend software engineer building evals infrastructure and continuous monitoring for OpenAI support automation, with direct relevance to model evaluation work.
The Sr. Software Engineer, Inference role at Anthropic involves building and maintaining systems for AI model inference, focusing on reliability and societal impacts.
The Research Engineer role focuses on advancing reinforcement learning techniques to enhance the safety and capabilities of AI systems, collaborating with teams to ensure effective and safe model development.
The Engineering Manager for Research Tools at Anthropic will lead a team focused on building systems that enhance the productivity of researchers and ensure the safe and efficient development of AI systems.
Preparedness safety research role modeling and forecasting frontier AI risks, including misuse, alignment risks, and evaluation/safeguard design for severe AI threats.