POSTED Nov 13

AI Abuse & Threat Intelligence Analyst

at OpenAISan Francisco

Share:

About the Team

The Intelligence and Investigations team seeks to rapidly detect and disrupt abuse in AI and generative AI technologies to ensure their safe use. We are dedicated to identifying emerging abuse trends, analyzing risks, and working with our internal partners to implement effective mitigation strategies to protect against misuse. Our efforts contribute to OpenAI's overarching goal of developing AI that benefits humanity.

About the Role

As an AI Abuse and Threat Intelligence Analyst focused on Intel & Investigations at OpenAI, you will play a pivotal role in ensuring the safety of AI.

We’re looking for people who combine online safety experience and risk management with outstanding analytical and problem-solving skills. The ideal candidate will be able to clearly articulate complex abuse concepts and collaborate effectively with diverse technical and business teams. We value professionals dedicated to promoting the responsible use of AI. Adaptability and a commitment to continuous learning in the rapidly evolving field of AI are also key traits for this role.

This role is based in San Francisco, CA. We use a hybrid work model of 3 days in the office per week and offer relocation assistance to new employees.

In this role, you will:

  • Drive insights and recommendations through comprehensive qualitative and quantitative analysis of emerging risks in AI and online platforms, translating complex patterns into actionable safety insights.

  • Collaborate on safety reporting tools by contributing technical expertise in Python (essential) and SQL (desirable), helping to scale and automate safety insights for diverse internal and external stakeholders.

  • Support safety enhancements on OpenAI’s platforms, leveraging experience with React and TypeScript to assist in building robust safety features.

  • Conduct and evaluate targeted risk assessments and simulations, working with cross-functional teams to assess and mitigate AI misuse scenarios, while ensuring insights are effectively communicated and actionable.

  • Build tooling for internal and external users to help track abuse on first-party and third-party platforms.

 You might thrive in this role if you:

  • Have experience in performing in-depth qualitative and quantitative analysis to inform safety strategies, particularly within online content and AI applications.

  • Possess technical skills in Python, and modern front-end development technologies like React, and TypeScript, with a track record of contributing to projects aimed at risk assessment, safety reporting, or building technical systems that detect abuse at scale.

  • Demonstrate a deep understanding of AI and generative AI technologies and the potential abuse scenarios, with a proactive approach to identifying and addressing emerging threats.

  • Exhibit excellent communication skills, capable of synthesizing complex findings into clear, concise recommendations for various audiences.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. 

We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status. 

OpenAI Affirmative Action and Equal Employment Opportunity Policy Statement

For US Based Candidates: Pursuant to the San Francisco Fair Chance Ordinance, we will consider qualified applicants with arrest and conviction records.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Please mention that you found this job on Moaijobs, this helps us get more companies to post here, thanks!

Related Jobs

Amazon
Applied Scientist, Generative Artificial Intelligence (AI) Innovation Center
AU, NSW, Sydney
Amazon
Senior Software Engineer - AI, Artificial General Intelligence | Inference Engines
US, MA, Boston
ElevenLabs
AI Researcher
United States
X AI
Product AI Engineer
San Francisco or Palo Alto, CA
Palantir
Mission Security Analyst
London, United Kingdom