Skip to content

Commit 429a46e

Browse files
Update README.md to make it clear that there are precomputed examples
1 parent b5951aa commit 429a46e

1 file changed

Lines changed: 5 additions & 4 deletions

File tree

README.md

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -200,14 +200,15 @@ token budget.
200200
https://tristanthrush.github.io/perplexity-correlations/
201201

202202

203-
## Real-World Usage Examples
203+
## Real-World Usage Examples and Precomputed Examples
204204

205205
Navigate to the `examples/` directory for examples of code that might be useful if you
206206
want to use our package in practice. We provide code to get BPB values and evaluations
207207
on practically any large group of Hugging Face LLMs, Eleuther Eval Harness benchmarks,
208-
and Hugging Face pretraining data samples. We also provide code for training fastText
209-
pretraining data filters from our estimate. We've tried to make it easy to swap in other
210-
pretraining datasets, LLMs, evaluations, and cluster schedulers.
208+
and Hugging Face pretraining data samples - as well as the actual values we computed for
209+
our paper. We also provide code for training fastText pretraining data filters from our
210+
estimate. We've tried to make it easy to swap in other pretraining datasets, LLMs,
211+
evaluations, and cluster schedulers.
211212

212213

213214
## Development guidelines

0 commit comments

Comments
 (0)