World's First Dynamic and Static Agentic Application Security Testing Tool across AWS Bedrock, Azure Foundry and GCP Vertex AI
AI-First Cloud Security. In a market with hundreds of cloud security tools, none focus on AI workloads. EEG is the go-to DevSecOps tool for developers to catch AI-specific vulnerabilities before pushing to production.
Target: AI-Specific Workload Security (No general cloud/infra drift)
Deployment: CI/CD Integrated Pre-deployment Testing
Scan Modes: Static analysis (AST + Regex) · Authenticated live audit · NVD CVE fetching
Console Support: Local CLI · Azure Cloud Shell · AWS CloudShell · GCP Cloud Shell
Report Formats: JSON · HTML · CSV (multiple formats in single run)
pip install eeg-securityWith cloud-specific authenticated scanning:
pip install eeg-security[aws] # + boto3 for Bedrock/SageMaker live audit
pip install eeg-security[azure] # + azure-identity for OpenAI/Foundry live audit
pip install eeg-security[gcp] # + google-cloud-aiplatform for Vertex AI live audit
pip install eeg-security[all] # All cloudsFor development:
git clone https://github.com/findthehead/EEG.git
cd EEG
pip install -e ".[dev]"Update to latest version:
pip install --upgrade eeg-security
# Or from GitHub directly:
pip install --upgrade git+https://github.com/findthehead/EEG.git# Scan a Bedrock app for AI vulnerabilities
eeg --env aws --path ./my-bedrock-app --report html
# Scan with authenticated live audit (reads ~/.aws/credentials)
eeg --env aws --auth true --path ./my-app --report json
# Scan Azure AI Foundry app, skip IAC/network checks, parallel mode
eeg --env azure --path ./foundry-app --avoid iac,network --thread max --report html
# Scan without CVE fetching (offline/air-gapped)
eeg --env gcp --path ./vertex-app --vm false --report json
# Run directly in Azure Cloud Shell (auto-detects credentials)
eeg --env azure --console-mode auto --path . --report csv
# Generate multiple report formats in a single scan
eeg --env aws --path ./app --report csv,html,json
# Multiple formats with custom base filename
eeg --env azure --path ./app --report html,json --output-file security-report
# Creates: security-report.html and security-report.json
# Live-only audit (no static analysis, just check cloud resources)
eeg --env azure --auth true --report htmleeg --env aws/azure/gcp --path /path/to/repo [OPTIONS]
| Flag | Values | Default | Description |
|---|---|---|---|
--env |
aws azure gcp |
required | Target cloud environment |
--path |
/path/to/repo |
optional | Repository or project directory to scan. Optional if --auth true (live-only scan) |
--auth |
true false |
false |
Enable authenticated live audit (reads cloud credentials) |
--console-mode |
auto local cloud |
auto |
Console mode: auto-detect, force local CLI, or force cloud shell |
--vm |
true false |
true |
Enable NVD CVE fetching for AI dependencies |
--avoid |
iam,storage,guardrail,model,network,iac,policy,prompt,secrets,logging |
none | Comma-separated categories to skip |
--thread |
med max |
sequential | Parallel scanning: med(4 threads), max(8 threads) |
--report |
json html csv |
json |
Report format(s). Comma-separated for multiple: --report csv,html,json |
--output-file |
/path/to/file |
auto-generated | Base filename for reports. Extensions added automatically |
Generate multiple report formats in a single scan:
# Generate all three formats
eeg --env aws --path ./app --report csv,html,json
# Just HTML and JSON
eeg --env azure --path ./app --report html,json
# With custom base filename (extensions added automatically)
eeg --env gcp --path ./app --report csv,html --output-file my-audit
# Creates: my-audit.csv and my-audit.htmlOutput:
[REPORT] Generated 3 report(s):
- eeg-report-aws-app-12-30-00-05052026.csv
- eeg-report-aws-app-12-30-00-05052026.html
- eeg-report-aws-app-12-30-00-05052026.json
EEG automatically detects and works in cloud shell environments:
| Environment | Detection | Authentication |
|---|---|---|
| Azure Cloud Shell | ACC_CLOUD, /home/cloudshell |
Uses existing az login session |
| AWS CloudShell | AWS_EXECUTION_ENV, AWS_CLOUDSHELL_USER_ID |
Uses IAM role attached to CloudShell |
| GCP Cloud Shell | CLOUD_SHELL, DEVSHELL_PROJECT_ID |
Uses Application Default Credentials |
When running in a cloud shell, EEG falls back to CLI-based scanning if SDK packages aren't available, making it work out-of-the-box without additional pip installs.
EEG automatically discovers and audits all accessible subscriptions/accounts:
- Azure: Iterates through all subscriptions the authenticated identity can access
- AWS: Scans the current account (multi-account support via profile switching)
- GCP: Audits the current project (configurable via
GOOGLE_CLOUD_PROJECT)
Resilient Scanning: If one account/subscription/resource fails (permission error, API timeout), EEG logs the error and continues to the next. The scan completes with partial results rather than failing entirely.
[AUTH-AZ] Auditing subscription: sub-1234-5678
> Auditing: my-openai-resource
> Error auditing my-openai-resource: Permission denied - continuing to next resource
> Auditing: my-ai-foundry
[AUTH-AZ] Completed subscription: sub-1234-5678
[AUTH-AZ] Auditing subscription: sub-8765-4321
...
- AWS: Bedrock (Agents, Guardrails, Knowledge Bases), SageMaker (ML/LLM Endpoints, Notebooks, Pipelines), and Amazon Q.
- Azure: Azure OpenAI Service, AI Foundry, Azure Machine Learning, Azure AI Studio, Cognitive Services, and Prompt Flow.
- GCP: Vertex AI, Vertex AI Agent Builder, Vertex AI Search, Model Garden, and Generative AI Studio.
- General: All AI model hosting, fine-tuning, embedding services, agent frameworks, and RAG pipelines.
- Prompt Exploits: System prompt leakage, prompt injection via external data sources (indirect prompt injection), and jailbreak resistance weaknesses.
- Multimodal Security: Multimodal prompt injection via image, audio, or document inputs into LLM pipelines.
- Guardrail Validation: PII filtering bypass, toxicity/content moderation bypass, insecure AI guardrail configurations, missing guardrails (CRITICAL), weak filter strengths, ANONYMIZE vs BLOCK, DRAFT vs PRODUCTION versions.
- Default Guardrails Detection: Checks if projects have default guardrails configured at the account/project level. This is a CRITICAL finding as it indicates fundamental AI safety is not properly configured.
- Agent Integrity: AI agent tool/function calling permission abuse (excessive agency), unsafe agent memory exposure, missing human confirmation for mutating actions, and sensitive prompt/response logging.
- Vector Database Security: Public access, weak auth, and unencrypted embeddings for vector stores (e.g., ChromaDB, Pinecone, Weaviate).
- RAG Pipeline Security: Data source leakage, context poisoning via unvalidated RAG retrieval, indirect prompt injection through poisoned documents, and write-access to knowledge base data sources.
- Endpoint Exposure: Insecure model endpoint exposure, over-permissive inference APIs, and "Shadow AI" endpoints.
- AI Sandboxing: Tool execution isolation, plugin/runtime isolation, network egress restrictions for agents, file system access control, and model execution environment isolation.
- Model Security: Checks for Model Weight Exfiltration (unprotected S3/Blob/GCS containing
.binor.safetensorsfiles) and Insecure Orchestration (unauthenticated dashboards for Ray, Kubeflow, or Triton Inference Server).
Strictly monitors AI-related components and frameworks in CI/CD via NVD API:
- Live API Monitoring:
https://services.nvd.nist.gov/rest/json/cves/2.0?keywordSearch=chromadbhttps://services.nvd.nist.gov/rest/json/cves/2.0?cvssV3Severity=CRITICAL
- Frameworks: LangChain, LlamaIndex, Transformers, PyTorch, FastAPI, vLLM, Ray, MLflow, and 70+ AI packages.
- Runtime/Hardware: CUDA, NCCL, TensorRT, and related GPU/NPU runtime libraries.
- Full CVE Details: Shows complete vulnerability descriptions, affected version ranges, and actionable remediation — not just links.
- AI IAM Scoping: Insecure IAM permissions specifically related to AI services (e.g., overly broad
bedrock:*,roles/aiplatform.admin,Cognitive Services Contributor). - S3/Blob/GCS Bucket Policies: Detects
GetObject/*,PutObject/*with broad principals on AI data buckets. - Misconfiguration Scanning: Detecting sensitive exposures, unusual permissions, and insecure configurations of managed AI guardrails.
- Data Integrity: Training Data Poisoning checks — ensuring write access to datasets used for fine-tuning or RAG ingestion is strictly restricted.
- Model Invocation Logging: Detects missing Bedrock model invocation logging, Azure OpenAI diagnostic settings, Vertex AI audit logs.
- Evaluation & Red-Teaming: Flags absent model evaluation configurations and red-team testing setups.
- CloudWatch/Log Analytics/Cloud Logging: Validates centralized logging for AI workloads with encryption and retention policies.
- Agent action groups without human confirmation
- Unrestricted tool/function calling (
tool_choice=auto) - AI-generated code passed to
exec()/eval()/subprocess - Agent roles with
AdministratorAccess,Contributor, orroles/editor
Scans repository source code using AST parsing (Python) and regex pattern matching across .py, .tf, .json, .yaml, .bicep, .env, and more. 139 detection rules across 10 categories.
Connects to your cloud account and audits live resources:
- AWS: Lists guardrails, agents, knowledge bases, model invocation logging, IAM policies, evaluation jobs, fine-tuning jobs, provisioned throughput via boto3 or AWS CLI
- Azure: Audits Cognitive Services accounts across all subscriptions, deployments, content filters (RAI policies), network ACLs, private endpoints, local auth (API keys), diagnostic settings
- GCP: Audits Vertex AI endpoints, models, CMEK encryption, private networking, safety settings
Permission-Safe Scanning: EEG gracefully handles permission errors without breaking the scan. If your credentials lack access to certain resources, those checks are skipped and reported in the summary — the scan continues across all accounts/subscriptions and completes successfully with partial results.
[LIVE] ✓ Authenticated scan complete
═════════════════════════════════════════════════════════════
EEG SCAN SUMMARY
═════════════════════════════════════════════════════════════
Checks: 47 completed, 3 skipped
⚠ 3 permission issue(s) encountered
(Some checks skipped due to limited permissions)
Run authenticated scanning without static analysis:
# Audit all Azure AI resources without scanning any code
eeg --env azure --auth true --report htmlParses requirements.txt, pyproject.toml, setup.py, Pipfile, and package.json for AI dependencies, then queries NVD for known vulnerabilities with full descriptions and remediation steps.
Reports are auto-named: eeg-report-{env}-{appname}-{HH-MM-SS-DDMMYYYY}.{ext}
{
"summary": {
"total_findings": 42,
"by_severity": {"CRITICAL": 5, "HIGH": 18, "MEDIUM": 19},
"completed_checks": 47,
"skipped_checks": 3,
"permission_issues": 3
},
"findings": [
{
"rule_id": "AUTH-AZ-GUARD-002",
"severity": "CRITICAL",
"message": "Azure AI account 'my-openai' does NOT have default guardrails configured",
"file_path": "live:cognitive:my-openai",
"line_number": 0,
"code_snippet": "defaultGuardrails=NOT_CONFIGURED",
"recommendation": "Configure default content filtering policies at the account level...",
"owasp_llm": "LLM01: Prompt Injection"
}
]
}Self-contained dark-themed report with severity badges, code snippets, OWASP LLM mappings, and actionable recommendations. Open directly in a browser.
Flat format for spreadsheet analysis and SIEM ingestion. Includes findings table plus summary metadata as comment rows.
| Code | Meaning |
|---|---|
0 |
No HIGH or CRITICAL findings |
1 |
HIGH findings detected |
2 |
CRITICAL findings detected |
3 |
Execution error |
- name: EEG AI Security Scan
run: |
pip install eeg-security[aws]
eeg --env aws --path . --report json,html --output-file eeg-report
if [ $? -eq 2 ]; then
echo "::error::CRITICAL AI security findings detected"
exit 1
fi
- name: Upload Reports
uses: actions/upload-artifact@v4
with:
name: eeg-security-reports
path: |
eeg-report.json
eeg-report.htmlSee ARCHITECTURE.md for detailed component diagrams and extension guide.
eeg/
├── __init__.py
├── __main__.py # python -m eeg entry point
├── cli.py # CLI argument parsing & orchestration
├── collector.py # Finding aggregation & deduplication
├── config.py # YAML config loader for dynamic checks
├── detectors/ # 10 static analysis detectors
│ ├── base.py # AST + regex scanning engine
│ ├── iam.py, storage.py, guardrail.py, model.py
│ ├── network.py, iac.py, policy.py, prompt.py
│ └── secrets.py, logging_monitor.py
├── auth_scanner/ # Authenticated live audit
│ ├── aws_scanner.py # Bedrock guardrails, agents, KBs, logging, evals
│ ├── azure_scanner.py # Cognitive Services (all subs), content filters, diagnostics
│ ├── gcp_scanner.py # Vertex AI endpoints, models, CMEK
│ └── check_runner.py # Config-driven check execution
├── vuln_manager/ # CVE tracking
│ ├── cve_fetcher.py # NVD API client with full descriptions
│ └── dependency_parser.py # 70+ AI package registry
├── utils/ # Shared utilities
│ ├── auth.py # Cloud credential discovery
│ ├── cloud_console.py # Cloud shell detection & CLI auth
│ ├── repocrawler.py # File system traversal
│ ├── threadpoolexecutor.py # Parallel scanning
│ ├── htmlreport.py, jsonreport.py, csvreport.py
└── rules/
├── static/ # Static analysis rules (YAML)
│ ├── aws_static.yaml
│ ├── azure_static.yaml
│ └── gcp_static.yaml
└── dynamic/ # Live audit check configs
├── aws_dynamic.yaml
├── azure_dynamic.yaml
├── gcp_dynamic.yaml
└── thresholds.yaml
tests/ # pytest test suite
├── conftest.py # Shared fixtures
├── test_cli.py
├── test_collector.py
├── test_detectors.py
├── test_utils.py
└── test_vuln_manager.py
# Run all tests
pytest tests/ -v
# With coverage
pytest tests/ --cov=eeg --cov-report=htmlEEG is available as a reusable GitHub Action for CI/CD pipelines.
name: AI Security Scan
on: [push, pull_request]
jobs:
security-scan:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- name: EEG AI Security Scan
uses: findthehead/EEG@v1
with:
env: aws
path: .| Input | Description | Required | Default |
|---|---|---|---|
env |
Cloud environment (aws, azure, gcp) |
Yes | - |
path |
Path to scan | No | . |
auth |
Enable authenticated live audit | No | false |
vm |
Enable NVD CVE fetching | No | true |
avoid |
Categories to skip (comma-separated) | No | - |
thread |
Parallel scanning (med, max) |
No | - |
report |
Output format(s) (json, html, csv, or comma-separated) |
No | json |
output-file |
Base filename for reports | No | auto |
fail-on-severity |
Fail threshold (critical, high, medium, low, none) |
No | critical |
version |
EEG version to install | No | latest |
extra-args |
Additional CLI arguments | No | - |
| Output | Description |
|---|---|
findings-count |
Total number of findings |
critical-count |
Number of CRITICAL findings |
high-count |
Number of HIGH findings |
report-file |
Path to generated report |
exit-code |
EEG exit code (0=clean, 1=high, 2=critical) |
Azure OpenAI with Multiple Report Formats:
- uses: findthehead/EEG@v1
with:
env: azure
path: ./ai-app
report: html,jsonGCP Vertex AI - Fail on HIGH:
- uses: findthehead/EEG@v1
with:
env: gcp
path: .
fail-on-severity: highAuthenticated Live Audit (AWS):
- uses: findthehead/EEG@v1
with:
env: aws
path: .
auth: 'true'
env:
AWS_ACCESS_KEY_ID: ${{ secrets.AWS_ACCESS_KEY_ID }}
AWS_SECRET_ACCESS_KEY: ${{ secrets.AWS_SECRET_ACCESS_KEY }}
AWS_REGION: us-east-1Authenticated Live Audit (Azure):
- uses: findthehead/EEG@v1
with:
env: azure
path: .
auth: 'true'
report: csv,html,json
env:
AZURE_CLIENT_ID: ${{ secrets.AZURE_CLIENT_ID }}
AZURE_CLIENT_SECRET: ${{ secrets.AZURE_CLIENT_SECRET }}
AZURE_TENANT_ID: ${{ secrets.AZURE_TENANT_ID }}
AZURE_SUBSCRIPTION_ID: ${{ secrets.AZURE_SUBSCRIPTION_ID }}name: AI Security Pipeline
on:
push:
branches: [main]
pull_request:
branches: [main]
jobs:
eeg-scan:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- name: EEG AI Security Scan
uses: findthehead/EEG@v1
with:
env: aws
path: .
report: json,html
thread: max
fail-on-severity: high
- name: Upload Security Reports
uses: actions/upload-artifact@v4
if: always()
with:
name: eeg-security-reports
path: eeg-report-*"No subscriptions accessible"
- Ensure you're logged in:
az login/aws sts get-caller-identity/gcloud auth list - Check your account has Reader access to at least one subscription
"Permission denied" during live audit
- EEG continues scanning other resources when permissions are denied
- Check the summary for skipped checks and permission issues
- Grant
Reader+Cognitive Services Userroles for full Azure scanning
"SDK not installed" in Cloud Shell
- EEG automatically falls back to CLI-based scanning
- For full SDK features:
pip install eeg-security[azure]
Multiple report formats not generating
- Ensure formats are comma-separated without spaces:
--report csv,html,json - Check write permissions in the output directory
Pull requests welcome. For major changes, open an issue first.
See ARCHITECTURE.md for codebase overview and extension points.

