Curated AI safety and governance jobs

The Research Engineer role involves implementing and running safety evaluations on frontier AI models, focusing on loss-of-control and harmful manipulation risks.

Machine Learning Engineer building AI safety and security systems, including abuse detection, frontier model evaluations, and red teaming workflows.

Remote global request for proposals and fellowships funding research and applied work on digital minds, including governance and legal research on societal responses to potentially sentient AI systems.

The role involves supporting CivAI's mission to educate policymakers about AI risks, preparing briefings on AI developments, and developing strategies for outreach.

The role involves serving as a technical advisor to public sector customers, focusing on AI compliance and risk management while integrating AI systems into government operations.

The Research Scientist role involves leading research on risks in frontier AI models, designing evaluation methodologies, and authoring safety reports to advance AI safety.

The Research Engineer role involves implementing and running safety evaluations on frontier AI models, focusing on loss-of-control and harmful manipulation risks.

Research scientist role focused on empirical and conceptual research into AI well-being, moral status, and related safety/welfare questions.

Nonprofit role focused on building the technical AI safety talent pipeline through advising, courses, grants, and field strategy.

Senior operations role on OpenAI's User Safety & Risk Operations team, building operating models for safety and risk workflows around product deployments, monitoring, escalation, and resolution.

Policy manager role focused on biosecurity policy, misuse prevention, product risk evaluation, and enforcement frameworks for dual-use capabilities.

Lead a technical operations team building analytics, automation, reporting, monitoring, and quality systems for OpenAI user safety and risk operations, with direct relevance to AI risk management and responsible AI controls.

Strategic partnerships role for Scale's Red Team and Safety function, managing frontier-lab engagements focused on AI red teaming, adversarial evaluations, and safety testing of frontier models.

The role involves building systems for high-quality reinforcement learning data, focusing on AI safety research and ensuring the quality of training data.

Data science role supporting Anthropic's policy and public affairs work by producing analyses, dashboards, and regulatory-trend tracking for policymakers and regulators.

The role involves analyzing user behavior data to provide insights on safety concerns and defining metrics to measure success in deploying safe AI systems.

This course focuses on AI security research, teaching participants about attacks on AI systems and defenses, including adversarial examples and model tampering.

Lead responsible AI and data governance work, including AI governance policies, dual-use evaluations, bias testing, and controls for internal AI tools.

The AI Red Teamer role involves evaluating the security and resilience of advanced AI systems through red team assessments, adversarial testing methodologies, and identifying vulnerabilities to ensure safe deployment.