Skip to content

Latest commit

 

History

History
93 lines (76 loc) · 2 KB

File metadata and controls

93 lines (76 loc) · 2 KB

CLI Command Cheat Sheet

These commands are short CLI references for testing and debugging. Full scenario walkthroughs live in examples/:

Inspect the CLI

mithridatium --version
mithridatium --help
mithridatium defenses
mithridatium detect --help

Run One Local Defense

mithridatium detect --model models/resnet18_poison.pth --data cifar10 --defense mmbd --out reports/mmbd.json --force
mithridatium detect --model models/resnet18_poison.pth --data cifar10 --defense strip --out reports/strip.json --force
mithridatium detect \
  --model models/resnet18_poison.pth \
  --data cifar10 \
  --defense freeeagle \
  --freeeagle-optimize-steps 100 \
  --out reports/freeeagle.json \
  --force
mithridatium detect \
  --model models/resnet18_poison.pth \
  --data cifar10 \
  --defense aeva \
  --aeva-samples-per-class 5 \
  --aeva-hsja-iterations 5 \
  --aeva-ep 1 \
  --out reports/aeva_smoke.json \
  --force

Run a Hugging Face Model

mithridatium detect \
  --provider huggingface \
  --hf-model-id microsoft/resnet-50 \
  --data cifar10_for_imagenet \
  --defense strip \
  --out reports/hf_strip.json \
  --force

Work With Report Output

cat reports/mmbd.json
mithridatium detect \
  --model models/resnet18_clean.pth \
  --data cifar10 \
  --defense freeeagle \
  --out - \
  | python -m json.tool
mithridatium detect \
  --model models/resnet18_clean.pth \
  --data cifar10 \
  --defense freeeagle \
  --out reports/freeeagle.json \
  --force

Useful fields:

  • defense: the defense that ran
  • dataset: dataset/preprocessing selection
  • results.verdict: clean/backdoored decision
  • results.thresholds: threshold values used for the decision
  • results.parameters: runtime settings