Senior Technical Advisor, AI Capability Assessment

Institute for Security and Technology Senior Technical Advisor, AI Capability Assessment Remote · Contractor Apply for Senior Technical Advisor, AI Capability Assessment

Join IST as a Senior Technical Advisor, AI Capability Assessment, supporting efforts to advance AI governance through technical evaluations, testing methodologies, and research on emerging AI capabilities. This role offers the opportunity to help shape frameworks that guide frontier labs, evaluators, and policymakers.

About Institute for Security and Technology

The Institute for Security and Technology designs and advances solutions to the world’s toughest emerging security threats. We are a nonpartisan, nonprofit network based in the San Francisco Bay Area dedicated to solving critical international security challenges through better technology and policy. We are a close-knit team with an excellent remote workflow and take pride in providing our employees with reliable mentorship. We work with all staff to advance their professional development by providing access to our network in each team member’s field of interest, and support opportunities for professional exposure. We look forward to your application.

Description

The Institute for Security and Technology (IST), a 501(c)(3) critical action think tank that unites technology and policy leaders to create solutions to emerging security challenges, is seeking an independent contractor for a Senior Technical Advisor, AI Capability Assessment engagement. IST is looking for a practitioner eager to apply AI capability assessment expertise to important AI governance problems — translating abstract AI safety concepts into concrete, testable capability evaluations and best practices that frontier labs, evaluators, and policymakers can reference consistently, in support of IST's projects on Recursive Self Improvement.

IST takes collaborative action to advance national security and global stability through trustworthy technology, guiding businesses and governments with hands-on expertise, in-depth analysis, and a global network. Since its foundation in 2020, IST has launched a vast array of impactful initiatives addressing challenges such as ransomware, the resilience of lifeline critical infrastructure, trust and safety, nuclear risk reduction, the role of artificial intelligence, and more.

Key Responsibilities

• Contribute technical expertise to identify and define RSI-relevant sub-capabilities (e.g., autonomy in long-horizon tasks, competence in AI R&D, closure of improvement loops)
• Support development of draft evaluation protocols and testing methodologies for capability thresholds
• Review and validate the technical robustness of proposed interventions and mitigations against current frontier model capabilities
• Assist in translating technical findings into a modular framework suitable for lab piloting and policy reference
• Engage with frontier lab contacts and evaluation organizations to validate assumptions and gather input
• Document methodology and findings clearly enough for both technical and policy audiences

Qualifications

Requirements

• Advanced degree (MS/PhD) in Computer Science, Machine Learning, AI Safety, or a related technical field, plus 2–4 years of experience
• Demonstrated experience with AI/ML model evaluation, capability assessment, or safety testing
• Strong understanding of frontier AI systems and current AI R&D pipelines
• Basic understanding of AI governance, safety frameworks, or risk management structures
• Ability to work independently and communicate technical concepts to mixed technical/policy audiences
• Must be authorized to work in the United States
• This engagement is contingent upon the successful completion of a background check

Preferred

• Prior experience engaging with frontier AI labs or independent evaluation organizations
• Publications or demonstrated work in AI safety, capability evaluation, or related areas
• Experience with red-teaming, adversarial testing, or safety benchmarking
• Familiarity with policy processes and government AI evaluation bodies
• Operates as an independent business (e.g., sole proprietorship, LLC, or corporation), consistent with this engagement's structure as an independent contractor relationship

Compensation

This is an independent contractor engagement, estimated at 15-20 hours a week for a 12-month term (target: 09/01/2026 – 08/31/2027, to be confirmed based on actual start date).

We anticipate a contract value of up to $100,000 for the term, based on an estimated 15-20 hours per week; the final contract rate will be negotiated directly with the contractor

As an independent contractor, this role is not eligible for IST's employee benefits package (health/dental/vision insurance, 401(k) matching, parental leave, or PTO).

Payment is made against invoices submitted by the contractor, per the independent contractor agreement, rather than as a regular salary or wage.

This is a 1099 independent contractor engagement, to be governed by a separate Independent Contractor Agreement. The contractor is expected to use their own computer and equipment for this engagement, to maintain their own business location separate from IST (a home office qualifies), and, where required by their jurisdiction, to hold any applicable business license or tax registration. The contractor is free to provide similar services to other clients during the term of this engagement.

Location

This is a fully remote contractor engagement — there is no in-office requirement and no geographic location restriction. Given the need for real-time collaboration with the AI Center team, the contractor is expected to generally be reachable during standard Pacific Time business hours, while retaining discretion over their own daily schedule.

How to apply

Kindly utilize this link to submit your application and feel free to reach out to [email protected] if you have any inquiries.

We welcome candidates from all backgrounds and particularly encourage candidates from communities that are historically underrepresented in foreign affairs and national security. Read IST’s Diversity, Inclusion, and Belonging statement.

For more information, visit www.securityandtechnology.org. If you're ready to embark on an exhilarating journey at the forefront of AI security policy, then seize this opportunity to join us at IST. Apply now and become a driving force in shaping the future of AI security and national security policy!

Salary

$80,000 - $100,000 per year

Apply for Senior Technical Advisor, AI Capability Assessment Your Privacy Choices

Read our Privacy Policy