Module 2

AI Defense Strategies

Building resilient AI systems that can withstand adversarial attacks.

Defense in Depth

Multiple layers of security to prevent a single point of failure.

Input Sanitization

The first line of defense. • Strict Typing: Ensure inputs match expected formats. • Content Filtering: Using secondary LLMs to check for injection patterns. • Rate Limiting: Preventing automated brute-force prompt attempts.

Monitoring and Observability

Detecting attacks in real-time. • Anomaly Detection: Monitoring for unusual prompt patterns. • Output Auditing: Checking for leaked PII or corrupted logic. • Feedback Loops: Implementing human-in-the-loop for high-risk actions.

The Over-reliance Trap

Do not rely solely on 'system prompts' for security. A determined attacker can bypass almost any static prompt. True security requires external verification layers.

Red-Teaming Checklist

Implement Input Filtering
Establish Real-time Monitoring ✓
Define Incident Response for AI
Audit Tool Privileges
Previous
Current: /cyber-security-course/modules/ai-defense
Next