Curated AI safety and governance jobs

Senior Software Engineer Irregular San Francisco Bay Area In this role, you'll design, build, and scale production systems that power evaluation and security platforms for frontier AI models. Architect and scale production-grade systems and workflows for AI model evaluation. Build backend services, APIs, and monitoring tools that support large-scale evaluations. Design infrastructure that enables research experiments to run efficiently at scale. Implement agent frameworks and build security challenges to test AI models' evasion capabilities. Irregular Labs is a frontier security lab that aims to protect the world in a time of increasingly cap...

Technical Policy Researcher Irregular Tel Aviv, Israel In this role, you'll tackle complex questions of AI development and deployment as a Technical Policy Researcher, shaping the emerging field of AI security. Conduct threat modeling to identify specific ways strong cyber-capable models could cause harm. Develop taxonomies for dangerous AI capabilities and potential mitigations. Create policy proposals for models' refusal policies and track developments in AI policy and research. Write academic papers and blog posts detailing research on evaluation theory and mitigation recommendations. Irregular Labs is a frontier security lab that aims to ...

Cyber Researcher Irregular Tel Aviv, Israel In this role, you'll conduct research on AI security, focusing on protecting models against cyber threats and evaluating AI's cybersecurity capabilities. Develop cyber capabilities evaluation challenges including CTF-style vulnerability tests and network attack simulations. Research methods to mitigate AI misuse risks, model weight theft, and dangerous AI agent capabilities. Publish research findings and deliver results to customers. Advise on product development while exploring frontier questions about AI's potential in cybersecurity. Irregular Labs is a frontier security lab that aims to protect t...

Research role focused on AI security, cyber capability evaluations, and mitigating misuse and dangerous agent capabilities for frontier AI systems.

Research engineer building evaluation and security testing systems for frontier AI models, including capability assessment, evasion testing, and risk mitigation.

The Technical Policy Researcher will address AI security issues, conduct threat modeling, develop taxonomies for AI capabilities, and create policy proposals.

The role involves designing and building production systems for evaluating and securing frontier AI models.