Executive Guide | Securing the AI Data Center & AI Factory

Executive Guide | Securing the AI Data Center & AI Factory

When deploying private LLMs and AI infrastructure in a data center, greater security is needed to tackle business risks and compliance challenges.

Executive Guide | Securing the AI Data Center & AI Factory

SECURING THE AI DATA CENTER & AI FACTORY

Guide for CTO, CISO, CAIO

SECURING THE AI DATA CENTER & AI FACTORY 2

© 2026 Check Point Software Technologies Ltd. All rights reserved.

Securing the AI Data Center & AI Factory Guide for CTO, CISO, CAIO

How Check Point protects Enterprise AI Factories, Data Centers, and Neocloud Providers across AI applications, Infrastructure, Networking, Large Language Model, and Governance Layers

Executive Summary The enterprise adoption of private AI and LLM (Large Language Model) infrastructures introduces a new breed of risks. Unlike traditional IT workloads, AI factories and data centers manage sensitive training data, powerful GPU clusters, distributed inference services, and high-throughput pipelines. This new and much broader attack surface increases threats to data, intellectual property, proprietary AI models, and end-users.

Another segment building their own AI factories are Neocloud providers, who deliver GPU-as-a-Service, building hyperscale AI factories powered by NVIDIA and other leading GPU platforms to give enterprises on-demand, high-performance compute for training and inference.

Deploying AI capabilities and private LLMs (Large Language Models) without embedding additional security increases exposure to poisoning, data leakage, and governance failures. To ensure system resilience, AI data centers must be secured end-to-end — from the fabric and GPU clusters to Kubernetes workloads, along with API-driven inference workloads and services.

Check Point enables organizations to confidently adopt and scale AI by addressing both traditional IT threats and new vulnerabilities introduced by AI-driven environments. Check Point delivers embedded cyber security by design to cover all sensitive blocks of AI data centers and private LLMs.

An AI Arms Race The race to build AI is accelerating. Enterprises are investing billions in AI factories that power the creation and development of AI capabilities. More than half of enterprise networks now use AI tools, making them prime targets for cyber attacks. Check Point data shows that 1 in every 80 GenAI prompts exposes sensitive data. Meanwhile, a recent Gartner report found that 32% of organizations experienced an AI attack involving prompt manipulation, and 29% faced attacks on their GenAI infrastructure in the past year. While AI provides amazing productivity benefits, AI systems face unprecedented security challenges. Protecting the entire AI pipeline, from development to production, has become an urgent imperative. As organizations scale their AI infrastructure, they need comprehensive security solutions that won’t come at the cost of AI server performance.

https://blogs.nvidia.com/blog/ai-factory/ https://blog.checkpoint.com/research/ai-security-report-2025-understanding-threats-and-building-smarter-defenses/ https://www.gartner.com/en/newsroom/press-releases/2025-09-22-gartner-survey-reveals-generative-artificial-intelligence-attacks-are-on-the-rise

SECURING THE AI DATA CENTER & AI FACTORY 3

© 2026 Check Point Software Technologies Ltd. All rights reserved.

AI Cyber Security Threats and Risks AI security risks are compounded by the huge investment costs required by AI infrastructure and AI applications, which in turn amplifies and accelerates the threat landscape. The pace of change in attackers’ capabilities is reflected by industry establishments, such as OWASP, who recently published the Top 10 LLM threats. The list includes prompt injections, data leakage, model manipulation, and insecure outputs, along with previously unknown attack vectors that target the core behavior of modern AI applications and can cause incalculable business disruption.

Others such as MITRE, and their ATLAS framework, further expand our understanding of this evolving landscape. It maps new real-world adversarial techniques against AI models and infrastructure, revealing how attackers exploit weaknesses across data pipelines, training processes, inference workflows, and GPU-driven environments.

The new AI threat landscape includes the following risks and attack methods:

• Prompt injection and jailbreaks: Manipulative inputs that bypass controls or trigger unintended behavior

• Model poisoning: Corrupted training data that degrades accuracy or embeds backdoors

• Data leakage: Model prompt responses reveal confidential or regulated information

• AI-driven cyber threats: AI infrastructure faces emerging threats like data poisoning, model theft, inference attacks, and AI-specific exploits that can manipulate the training process and output of models.

• Open ecosystems: AI developers pull code, containers, and models from public repositories. This open environment creates additional risks like model poisoning, data exfiltration, and malicious workloads hiding in downloaded models.

• Significant business losses: Training LLMs can involve processing massive volumes of sensitive data. One breach can wipe out investments and compromise intellectual property.

• AI Supply Chain failures: Private LLM models and AI systems introduce a hyperconnected environment, and therefore, a much broader threat surface than traditional IT data centers.

• AI applications require maximum GPU resources: AI workloads and language models can require AI Servers to run at maximum capacity for weeks or months. Every percentage point of CPU usage and microsecond of latency multiplies costs exponentially. Enterprises need security measures that do not impact AI performance.

• Compromised developers: whether through insider threat, credential theft, or coercion, a compromised user with privileged access represents a significant threat to AI factories and data centers.

SECURING THE AI DATA CENTER & AI FACTORY 4

© 2026 Check Point Software Technologies Ltd. All rights reserved.

Strategic Approach for Building Secure AI Systems As organizations look to maximize the business value of AI and cyber teams develop their understanding of the attacker’s capability, a strategic risk-centric approach is required. A clear understanding of the likelihood and impact of attacks against AI systems means a clearer protection-first approach. To help communicate where key risks exist and how to mitigate them, Check Point developed an AI threat triangle.

The AI Threat Triangle is a simple model designed to help visualize three core AI domains for AI cyber security risk and business impact:

• AI Applications External threats targeting AI models and applications mostly through prompt injection. This is the most valuable target since there is a significant cost in building elements in this layer. Training models can cost millions of dollars. For example, the estimated training cost of GPT-4 was over $50M.

• AI Responsible use and Governance Ethical, transparent, and controlled operation of AI systems should ensure safe, reliable behavior, in line with organizational and regulatory requirements. This is not focused on external attacks but rather on how AI behaves internally — how it makes decisions, what it outputs, and how it impacts users and society.

• AI Infrastructure We consider this the most important foundational layer to secure. If an enterprise loses access to their AI systems, or if their infrastructure layer is compromised then all other layers will be directly impacted.

The major network security risks include compromise to hosts (GPUs) running LLMs, as a result of CVEs, supply chain attacks, and illicit lateral movement.

AI Threat Triangle

SECURING THE AI DATA CENTER & AI FACTORY 5

© 2026 Check Point Software Technologies Ltd. All rights reserved.

Check Point AI Data Center Security Now that we understand the unique threats and risks to our AI Data Center, we can conceptualize what is required to protect enterprise from attacks. It is important to note that securing AI data centers after they are running (either training or inference) is prohibitively expensive. This is why ensuring security-by-design and extensive pre-deployment validation testing is critical.

The Check Point approach to protect AI factories and data centers is unique and holistic, based on a layered AI Security ecosystem built on a defense-in-depth approach.

The conceptual technologies stack includes:

1. AI Native Application Protection (LLM): API based security of AI application and Agentic / LLM layer protection

2. Perimeter Protection: External access control zone, entry point to the AI data center fabric, secured by zero-trust (ZTNA) enabled with Check Point Maestro Hyperscale Firewall and DDoS security

3. Host Security: Check Point AI Factory Firewall running on the NVIDIA DPU, with security close to the AI workloads, segment servers (DGX) and protecting management traffic (Control Plane)

4. AI-Hardware Protection: Monitor GPU and hosts memory behavior in real time, without negatively impacting GPU performance. Detects anomalous access patterns, enabling early identification of malicious activity, including data exfiltration, model theft, or compromised workloads

5. Workload and Container Protection: Secure East-West traffic inside Kubernetes environments including cluster visibility and containers, with micro segmentation policy enforcement

AI Responsible Use & Governance

AI Applications

AI Infrastructure

3. Distributed Host Level Security Check Point AI Factory Firewall + NVIDIA BlueField-3 DPU

1. AI Native Application Security AI Security + WAF Prompt Defense + API security

2. Perimeter & Network Security AI Firewall + Hyperscale Zero Trust + Prompt Inspection

NVIDIA DOCA Argus + Check Point ThreatCloud 4. Hardware Accelerated AI Security Integration

5. Workload & Container Security Microsegmentation Kubernetes Runtime Security

3. Distributed Host Level Security Check Point AI Factory Firewall + NVIDIA BlueField-3 DPU

1. AI Native Application Security AI Security + WAF Prompt Defense + API security

2. Perimeter & Network Security AI Firewall + Hyperscale Zero Trust + Prompt Inspection

NVIDIA DOCA Argus + Check Point ThreatCloud 4. Hardware Accelerated AI Security Integration

5. Workload & Container Security Microsegmentation Kubernetes Runtime Security

SECURING THE AI DATA CENTER & AI FACTORY 6

© 2026 Check Point Software Technologies Ltd. All rights reserved.

Securing the AI Factory & Data Center Multi Layer: Data Center, Servers, Containers and Application

1) AI Applications Protection The following solutions are foundational to protecting AI applications. The unique nature of AI apps means that AI-native security is key to success

• Check Point AI LLM Security and API Security

• AI-native runtime protection against prompt injection, data leakage, and model manipulation. With support for over 100 languages.

• WAF / AppSec – Prevent advanced threats including OWASP Top-10 and zero-day attacks without signature updates. Real-time API protection and auto-discovery

• Model Context Protocol (MCP) traffic visibility

2) AI Infrastructure Security The term ‘AI infrastructure’ describes the components that support AI applications but have multiple roles and applications in a data center. These include the perimeter security capabilities and the developer environment. However, the threat profile of the AI Factory or AI data center is very different from traditional data centers.

Users & Agents Connecting

to LLM

Users & Agents Connecting

to LLM

Check Point Maestro Hyperscale Firewall

Check Point WAF

Check Point AI-Powered Security

Management

K8s K8s K8s

North-South Data Plane Access Control

East-West Kubernetes POD / Namespace Access Control

API for Connector Network Interface

Check Point AI Security &

Runtime Protection

Check Point AI Security &

Runtime Protection

Check Point AI Security &

Runtime Protection

Management Control Plane Access Control

AI FACTORYAI FACTORY AI FACTORYAI FACTORY

Check Point AI Factory Firewall

Check Point AI Factory Firewall

Check Point AI Factory Firewall

GPU GPU GPU

Check Point Maestro Hyperscale Firewall

Check Point WAF*

Check Point AI-Powered Security

Management

K8s

North-South Data Plane Access Control

East-West Kubernetes POD / Namespace Access Control

API for Container Network Interface

Check Point AI Security & Runtime Protection*

Management Control Plane Access Control

Check Point AI Factory Firewall

GPU DPU

K8s

Check Point AI Security & Runtime Protection*

Check Point AI Factory Firewall

GPU DPU

K8s

Check Point AI Security & Runtime Protection*

Check Point AI Factory Firewall

GPU DPU

Fig. Architecture reference sample

* Check Point embeds AI runtime security and prompt defense in all Check Point firewalls, Check Point WAF, and runs natively in AI Factory Firewall on NVIDIA BlueField DPUs

SECURING THE AI DATA CENTER & AI FACTORY 7

© 2026 Check Point Software Technologies Ltd. All rights reserved.

2) AI Infrastructure Security (cont’d) NVIDIA BlueField-3 DPU + Check Point Host Security

• Check Point AI Factory Firewall embedded on BlueField-3 DPU, enforces inline security at the hardware layer

• Security is offloaded to the DPU, preserving CPU & GPU resources for AI workloads

• Strong segmentation between control and data planes, blocks lateral movement

• Inline Threat Prevention and IPS for host ingress and egress traffic

• Secure Zero Trust access for developers, operators, and SecOps teams

NVIDIA DOCA Argus (with Check Point)

• Integrated with DOCA Argus Workload Threat Detection, leverages AI-driven memory behavior analysis

• Detects anomalous GPU and host memory activity; enables early identification of model theft and workload compromise

Check Point Maestro Hyperscale Firewall

• High-performance perimeter security for AI fabrics, supports terabit/sec east-west and north- south traffic inspection

• Zero Trust access enforcement to AI workloads based on user identity, role, and context

Workload & Kubernetes Protection

• Check Point + open platform solutions for micro segmentation & container isolation

• Runtime protection for Kubernetes clusters, increasing visibility and control over AI workloads

3) AI Responsible Use and Governance Without robust governance, organizations lack the visibility and control mechanisms to manage these unique risks. Therefore, applying a security-by-design approach assures that governance is a high priority for AI data center architects. Practically speaking, the key governance and regulatory elements to consider are:

• External AI regulations and data residency laws (EU AI Act, GDPR, ISO/IEC 42001)

• International AI frameworks (e.g., NIST AI RMF, Gartner AITRISM) enforce data lineage, provenance, and quality to prevent LLM (model) bias, poisoning, and compliance failures

• Internal / in-house AI governance frameworks ensure least-privilege access to data and training infrastructure, reducing risks of data leakage, model theft, and operational disruption.

• AI supply-chain governance is critical to mitigate third-party risks introduced by external models, libraries, and cloud service providers.

8

Worldwide Headquarters 5 Shlomo Kaplan Street, Tel Aviv 6789159, Israel | Tel: +972-3-753-4599

U.S. Headquarters 100 Oracle Parkway, Suite 800, Redwood City, CA 94065 | Tel: 1-800-429-4391

www.checkpoint.com

© 2026 Check Point Software Technologies Ltd. All rights reserved. | Updated v.5 April 23, 2026

SECURING THE AI DATA CENTER & AI FACTORY

The Bottom Line AI factories and AI-powered data centers are rapidly becoming the digital core of the modern enterprise. However, without security purpose-built for AI, these environments become the most exposed. Check Point’s AI Factory & Data Center Security architecture represents a fundamental shift from traditional perimeter defense to model-centric protection, from fragmented tools to unified security fabrics, and from reactive compliance to proactive, continuous trust. Check Point’s hyperscale, GPU-aware design secures high-throughput east-west traffic with the performance and efficiency required for AI scalability and resilience. CIOs and CISOs who adopt an integrated, fabric-based approach today will safeguard their AI investments, meet evolving regulatory mandates, and position their organizations to scale confidently into the next era of intelligent infrastructure.

About Check Point Check Point Software Technologies Ltd. is a global cyber security leader protecting more than 100,000 organizations worldwide. Its mission is to secure enterprises’ AI transformation. Built on a prevention first approach and an open ecosystem architecture, Check Point helps organizations reduce risk, simplify operations, and innovate with confidence. The unified security architecture continuously adapts to evolving threats and expanding AI attack surfaces, protecting hybrid networks, cloud environments, digital workspaces, and AI systems. Structured around four strategic pillars, Hybrid Mesh Network Security, Workspace Security, Exposure Management, and AI Security, Check Point delivers consistent protection and visibility across complex multivendor environments.

Learn More

View Security Blueprint Speak with an Expert Check Point AI Factory Firewall

https://www.checkpoint.com/resources/items/white-paper-ai-data-center-ai-factory-security-blueprint https://www.checkpoint.com/resources/items/white-paper-ai-data-center-ai-factory-security-blueprint https://www.checkpoint.com/resources/items/white-paper-ai-data-center-ai-factory-security-blueprint https://pages.checkpoint.com/2026-mar-ww-ai-factory-and-data-center-security.html https://pages.checkpoint.com/2026-mar-ww-ai-factory-and-data-center-security.html https://pages.checkpoint.com/2026-mar-ww-ai-factory-and-data-center-security.html https://www.checkpoint.com/ai/cloudprotect/ https://www.checkpoint.com/ai/cloudprotect/ https://www.checkpoint.com/ai/cloudprotect/


Item Type: pdf