Product manager for Anthropic’s Safeguards team, building safety systems, evals, and interventions to mitigate risks from frontier AI models and user misuse.
Curated roles
Browse roles focused on reducing risks from advanced AI systems, including alignment research, safety engineering, evaluations and related operations.
343 active roles found.
Product manager for Anthropic’s Safeguards team, building safety systems, evals, and interventions to mitigate risks from frontier AI models and user misuse.
The role involves conducting research in AI safety and alignment, focusing on model evaluations and interpretability techniques, while collaborating with top researchers to address critical AI challenges.
People management and technical leadership role guiding ML research projects for LawZero’s AI safety agenda and safe-by-design AI systems.
The Digital Media Accelerator supports creators producing content that raises awareness about AI developments and issues, particularly regarding AI safety and risk.
Research engineer role focused on scalable interpretability assistants, evaluations for undesirable model behaviors, and AI oversight capabilities.
The Research Scientist role at Sequent focuses on AI alignment research, requiring contributions to both empirical and theoretical aspects of alignment problems.
Research engineer building infrastructure and automation for AI alignment research, including experiment orchestration, analysis pipelines, autoformalization tools, and evaluation infrastructure for frontier-tier models.
The role involves conducting research on AI safety and alignment, focusing on model evaluations and innovative alignment techniques.
Software engineer building evaluation infrastructure for Anthropic’s safety investigation and abuse detection systems, including datasets, metrics, and pipelines that assess misuse detection and robustness.
This is an expression of interest for future openings in an AI safety research and engineering company focusing on catastrophic risk evaluations and red-teaming.
The Foresight Institute is offering grants for projects focused on AI safety, specifically in secure AI and neurotechnology for safe AI.
Lead the Commercial Applied AI Architect team to drive the adoption of frontier AI while ensuring the deployment of safe and reliable AI systems across commercial accounts in Europe.
Analytics Engineer on OpenAI’s Safety Systems team building canonical datasets, dashboards, and data products for safety metrics and decision-making around safe, robust, reliable AI deployment.
Remote global short course on AGI safety and AI alignment, covering technical alignment methods, interpretability, security, frontier safety practices, and capability evaluations.
Fellowship focused on adversarial red teaming and model evaluations for AI systems, identifying vulnerabilities, safety risks, and failure modes.
This fellowship focuses on advancing cryptographic verification mechanisms for AI training, addressing safety and verification standards in AI.
A 13-week part-time remote fellowship training and supporting Black researchers and practitioners in AI Safety, AI Security, AI Governance, and Responsible AI through mentorship and research projects.
The role involves maintaining facilities operations for a workspace focused on AI safety research, supporting logistics and vendor relationships.
The role involves managing model launches and building evaluations to measure AI model performance, directly connecting to AI safety and alignment through the development of agentic evaluations.
Research Scientist role focused on frontier AI safety research and evaluations, specifically loss-of-control and harmful manipulation risks, evaluation awareness, sandbagging, and deception.