Debiasing (concept editing + dataset biasing)

[dariuskia]

Add Biasing and Debiasing Experiments Framework

Implements few-shot biasing experiments and cross-bias ACE debiasing.

Files Added

• configs/biasing_experiments.yaml - Example biasing config
• configs/bias_test_quick.yaml - Quick validation config
• example/sports_understanding_fewshot.json - Sports fewshot examples
• example/anachronisms_fewshot.json - Anachronism fewshot examples
• example/social_chemistry_fewshot.json - Social chemistry fewshot examples
• example/logical_deduction_fewshot.json - Logic fewshot examples
• scripts/test_biasing.py - Biasing validation tests
• scripts/test_biasing_config.py - Config loading tests

Files Modified

• src/data_loading.py - Biased few-shot sampling and dataset creation
• src/config.py - Added bias parameters to DatasetConfig
• src/cache_manager.py - Updated hashing for bias experiments
• src/experiment_runner.py - Bias-aware dataset loading and train/test splitting

Enables experiments with positive/negative/neutral bias and cross-bias debiasing where ACE
interventions trained on one bias type are tested on the opposite bias.