Curated AI safety and governance jobs

The role involves designing, deploying, and maintaining AI systems for critical infrastructure and sovereign institutions, focusing on compliance and risk management.

The AI Engineer, Product role at Mistral AI focuses on improving AI features through evaluations, safety metrics, and collaboration with science teams to ensure quality and reliability.

Safety operations role focused on child safety, content enforcement, and improving Grok's defenses through policy enforcement, risk assessment, and LLM red-teaming.

The Safety Trainer - Monetization at xAI is responsible for designing and delivering training programs focused on safety in Ads and payment systems, enhancing platform trust and safety.

The role involves addressing post-training and reinforcement learning challenges, focusing on reward modeling and improving AI reasoning and truthfulness.

The Application Security Engineer at xAI is responsible for ensuring the security of cloud-native applications, focusing on code security and AI technologies, including threat modeling and risk assessments.

The SWE Fellow role focuses on designing and evaluating advanced generative AI systems, contributing to research publications, and collaborating with AI labs to enhance model performance.

The SWE Fellow role focuses on evaluating and interpreting generative AI systems, contributing to research publications, and collaborating with AI labs.

The SWE Fellow role focuses on evaluating and interpreting generative AI systems, contributing to research publications, and collaborating with AI labs.

The STEM Fellow will collaborate on high-impact projects to design and evaluate generative AI systems, contributing to research publications and enhancing AI model performance.

The STEM Fellow will collaborate on high-impact AI projects, focusing on the design and evaluation of generative AI systems, while contributing to research publications.

The Staff Software Engineer for the Public Sector at Scale AI will develop systems for federal datasets, focusing on AI safety through agentic guardrails and explainability.

The Staff Product Manager will lead the development of AI platforms for national security, focusing on ethical deployment and compliance with government regulations.

The Senior Software Engineer, GenAI role at Scale AI focuses on building and maintaining systems for generative AI applications, emphasizing model evaluation, safety, and trust.

Research Scientist role on Scale Labs' Safety Post Training team developing post-training and interpretability methods to improve frontier AI safety, robustness, alignment, and safety evaluations, with some policy-facing collaboration.

Research Scientist role focused on frontier AI risk evaluations, including building evaluation harnesses and datasets, testing dangerous capabilities, and publishing findings for policymakers.

The Research Scientist will focus on AI controls and monitoring, developing methods to ensure AI systems remain aligned with intended goals and conducting risk evaluations.

The Research Scientist will focus on agent robustness, AI control protocols, and AI risk evaluations to promote safe and aligned AI systems.

The Research Advisor role focuses on providing consultancy on model behavior and governance, collaborating on high-impact AI research, and contributing to technical publications.