AI Safety Jobs

Cyber Researcher Irregular Tel Aviv, Israel In this role, you'll conduct research on AI security, focusing on protecting models against cyber threats and evaluating AI's cybersecurity capabilities. Develop cyber capabilities evaluation challenges including CTF-style vulnerability tests and network attack simulations. Research methods to mitigate AI misuse risks, model weight theft, and dangerous AI agent capabilities. Publish research findings and deliver results to customers. Advise on product development while exploring frontier questions about AI's potential in cybersecurity. Irregular Labs is a frontier security lab that aims to protect t...

Technical Project Manager, Red Team FAR AI Remote, Global, San Francisco Bay Area, Remote, USA $125,000 - $190,000 In this role, you'll be the delivery backbone of FAR.AI's red-teaming programme, owning engagements with governments and frontier AI companies. Own the end-to-end red-team hiring pipeline, including sourcing, work trials, and recruiting technical talent. Manage the RFP and opportunity pipeline by scoping engagements, drafting proposals, and supporting negotiations. Conduct analysis on team bottlenecks and ecosystem mapping to improve performance. Support technical writing, event organising, policy work, and grant applications as ...

Senior communications role focused on external messaging for OpenAI safety research, including alignment, evaluations, preparedness, and interpretability.

The role involves pursuing a PhD with a focus on AI safety, generative AI, and agentic AI systems, addressing critical aspects of AI development and deployment.

Research engineer building AI platforms and infrastructure for alignment research, safety research, and evaluation of AI alignment/control approaches at CARMA.

The role involves leading the development and implementation of safety systems for AI deployment, focusing on technical safety strategies and evaluations to mitigate risks associated with scientific superintelligence.

The role involves contributing to AI safety research with a focus on machine learning, analyzing solutions to safety questions, and developing novel algorithms to address complex AI safety problems.

The AI Red Teamer role involves probing frontier AI systems for vulnerabilities, designing attack strategies, and building safety evaluation infrastructure to ensure AI safety.

The Research Scientist role involves leading high-impact research to enhance the safety and reliability of frontier AI systems, focusing on areas like AI honesty, robustness, and transparency.

Research engineer role at CAIS focused on ML experiments, model training and evaluation, and safety-relevant research on robustness, transparency, and backdoor behaviors.

Research Scientist role studying latent structure and behavior in neural networks, with explicit emphasis on understanding as safety, safety-relevant tools, and internal red teaming.

Founding engineer role building an AI-native cyberdefense platform, including AI systems and evaluations that measure performance against real cyber incidents and frontier AI labs.

Senior operator role at the Center for AI Safety to own and execute high-stakes AI safety projects, including AGI risk campaigns and safety benchmark initiatives.

Technical lead for ARIA’s multi-agent security programme, supporting research on AI agents operating and coordinating in untrusted environments, with explicit emphasis on AI red-teaming and security research.

Senior systems administration role managing on-premise and cloud compute infrastructure for a nonprofit AI safety organization; relevant because it supports safe-by-design AI systems and AI-risk research infrastructure.

Computational biologist role focused on building evaluation frameworks and experiments for biological security problems using frontier AI systems.

Role building evaluation task pipelines and infrastructure for frontier model testing, including systems to prevent models from detecting evaluations.

A remote global technical AI safety course covering alignment, RLHF, mechanistic interpretability, evaluations, and AI control, designed to prepare participants for AI safety careers.

The Chief Data Scientist will lead AI Safety research and development programs, focusing on national security missions, ensuring technical excellence and alignment with evolving mission requirements.