ITMAP for AI Model Security

AI Red Teaming and AI Model Security is the market for platforms that adversarially test, attack, and defend AI models, applications, and agents against AI-specific threats — prompt injection (direct and indirect), jailbreaks, model extraction, training-data poisoning, sensitive-data leakage, tool and function-call abuse, agent goal hijacking, and unsafe output. Products in this market span two operating modes that buyers increasingly purchase together: offensive red teaming (automated and continuous adversarial testing of models, RAG pipelines, and agents — pre-deployment and on every release) and runtime model security / guardrails (inline detection and blocking of attacks against production AI traffic). To qualify, a product must address AI-native threats specifically — generic application security tools (WAFs, SAST, DAST) and traditional security testing platforms do not qualify. The market is distinct from AI Gateways (which provide the routing data plane and integrate security as policy), from LLM Observability (which measures quality and cost, not adversarial robustness), and from Data Security Posture Management (which secures the data layer, not the model layer). The primary buyer is the CISO organization — AppSec, product security, and emerging AI security teams — not the ML or platform engineering team. Deployment is SaaS, self-hosted, or SDK/CI-integrated.

Vendors and products in this market

  • CalypsoAI (F5) — CalypsoAI Inference Platform
  • Check Point (Lakera) — Lakera Guard
  • Cisco — Cisco AI Defense (formerly Robust Intelligence)
  • CrowdStrike — Falcon Cloud Security for AI
  • HiddenLayer — HiddenLayer AISec Platform
  • Microsoft — Azure AI Content Safety & PyRIT
  • Mindgard — Mindgard AI Security Platform
  • Noma Security — Noma AI & Data Security Platform
  • Palo Alto Networks — Prisma AIRS (formerly Protect AI Platform)
  • Pillar Security — Pillar AI Security Platform
  • Red Hat (IBM) — Red Hat OpenShift AI 3.5 (EvalHub & Guardrails)
  • Repello AI — Repello Artemis
  • SentinelOne — Prompt Security Platform
  • Snyk — Snyk AI Trust Platform (DeepCode AI)
  • TrojAI (A10 Networks) — TrojAI Defend & TrojAI Detect

Explore the interactive vendor map and product comparisons. Registration and profile requirements apply to protected features, reports and intelligence.

Browse all markets