Scribd
Upload
22 views3 pages

AI Red Teams List

This document outlines various organizations involved in AI red teaming activities, categorized into sections such as Model Developers, AI as a Service, AI Technology Providers, AI Consumers, AI Consulting, AI Security, and AI Research. Each section lists specific organizations and notes whether their red teaming activities are conducted by dedicated teams or safety teams. The document serves as a tracking and organizational tool for AI red teaming efforts.

Uploaded by

Prathyusha M
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
22 views3 pages

AI Red Teams List

This document outlines various organizations involved in AI red teaming activities, categorized into sections such as Model Developers, AI as a Service, AI Technology Providers, AI Consumers, AI Consulting, AI Security, and AI Research. Each section lists specific organizations and notes whether their red teaming activities are conducted by dedicated teams or safety teams. The document serves as a tracking and organizational tool for AI red teaming efforts.

Uploaded by

Prathyusha M
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 3

This document serves as my place to track and organize AI red teaming activity.

Model Developers
Organizations in this section are directly involved in the development of models and have
expertise in-house to red-team those models.
●​ Anthropic*
●​ OpenAI**
●​ Google/DeepMind*
●​ Microsoft*
●​ Nvidia*
●​ Meta
●​ Hugging Face**
●​ Groq

AI as a Service
Organizations in this section provide AI products and solutions as a service and perform red
team activities on the service they provide.
●​ Scale*
●​ IBM
●​ SmartOne
●​ Clarifai

AI Technology Provider
Organizations in this section develop hardware and related technologies for AI systems and
perform red team activities on AI systems they provide infrastructure for.
●​ AMD
●​ Nvidia*

AI Consumer
Organizations in this section use AI systems that they did not create nor manage, and perform
red team activities on the AI system given to them.
●​ Walmart
●​ Wells Fargo*
●​ Verizon
●​ eBay

*: this organization’s RT activities seem to be carried out by a dedicated “red team”


**: this organization’s RT activities seem to be carried out by an AI safety team or alignment
team
AI Consulting
Organizations in this section consult widely on technology and business concerns, and offer red
team activities as a service.
●​ Deloitte
●​ Reply
●​ Booz Allen Hamilton
●​ Kudelski Security
●​ Palo Alto Networks
●​ KPMG
●​ HackerOne
●​ NRI Secure Technologies
●​ Praetorian
●​ Grid Dynamics Holdings
●​ Black Hills Security
●​ Trend Micro

AI Security
Organizations in this section are focused on AI security as a service and offer red teaming as a
service.
●​ Luminos.Law
●​ Adversa
●​ Hidden Layer
●​ Lakera
●​ Vijil
●​ Robust Intelligence
●​ Cranium
●​ Enkrypt AI
●​ Mileva Security Labs
●​ Haize Labs
●​ Mindgard
●​ HackAPrompt
●​ Faculty AI
●​ Pillar Security

AI Security without Red Teaming as a Service


Organizations in this subsection do not offer red teaming as a service, but do focus on the
development of AI security solutions.
●​ NIghtfall AI
●​ Calypso AI
●​ Protect AI
*: this organization’s RT activities seem to be carried out by a dedicated “red team”
**: this organization’s RT activities seem to be carried out by an AI safety team or alignment
team
●​ Fiddler AI
●​ Gray Swan AI

AI Research
Organizations in this section perform research on AI systems and applications, and perform red
teaming to advance knowledge in AI vulnerabilities.
●​ MITRE
●​ NIST
●​ METR
●​ Apollo
●​ UK AISI
●​ US AISI

*: this organization’s RT activities seem to be carried out by a dedicated “red team”


**: this organization’s RT activities seem to be carried out by an AI safety team or alignment
team

You might also like