Skip to content

Commit 00d8b5e

Browse files
lukasugarclane9
authored andcommitted
Update README.md
1 parent 38f0ee6 commit 00d8b5e

1 file changed

Lines changed: 26 additions & 2 deletions

File tree

src/asparagus_bridge/README.md

Lines changed: 26 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -125,7 +125,7 @@ uv run asp_finetune_cls \
125125
data.test_split=TEST_80_10_10
126126
```
127127

128-
#### Task 5 smoke test:
128+
##### Task 5 smoke test:
129129
```
130130
uv run asp_finetune_cls --config-name finetuning/smoke_test_cls_task_5.yaml
131131
```
@@ -147,7 +147,31 @@ TBD
147147

148148
#### Linear probing
149149

150-
TBD.
150+
##### Task 6
151+
152+
Linear probing uses Asparagus' `asp_linear_probe` entry point. It freezes the
153+
backbone, trains one linear classification head per learning rate in
154+
`training.probing.learning_rates`, selects the best head by validation AUROC,
155+
and then evaluates that head on the test split.
156+
157+
The current linear probing module is for classification tasks only.
158+
159+
Task 1 FLAIR-only smoke test:
160+
161+
```sh
162+
uv run asp_linear_probe --config-name finetuning/smoke_test_linear_probe_tasks.yaml
163+
```
164+
165+
[smoke_test_linear_probe_tasks.yaml](./configs/finetuning/smoke_test_linear_probe_tasks.yaml)
166+
can be used as a reference for Task 1 probing runs. It uses CPU settings,
167+
disables wandb, limits the number of batches, and points at a local converted
168+
checkpoint. Override `checkpoint_path` or edit the config before running it on
169+
another machine.
170+
171+
##### Task 7
172+
Task 7 should use the results from Task 6 (F1 and AUROC metrics) and analyze it for fairness, based on the inputs demographics. This data is not available, so we can just rely on task 6 data.
173+
174+
151175

152176
### 4. Multi-task finetune eval - not tested yet
153177

0 commit comments

Comments
 (0)