File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -200,14 +200,15 @@ token budget.
200200https://tristanthrush.github.io/perplexity-correlations/
201201
202202
203- ## Real-World Usage Examples
203+ ## Real-World Usage Examples and Precomputed Examples
204204
205205Navigate to the ` examples/ ` directory for examples of code that might be useful if you
206206want to use our package in practice. We provide code to get BPB values and evaluations
207207on practically any large group of Hugging Face LLMs, Eleuther Eval Harness benchmarks,
208- and Hugging Face pretraining data samples. We also provide code for training fastText
209- pretraining data filters from our estimate. We've tried to make it easy to swap in other
210- pretraining datasets, LLMs, evaluations, and cluster schedulers.
208+ and Hugging Face pretraining data samples - as well as the actual values we computed for
209+ our paper. We also provide code for training fastText pretraining data filters from our
210+ estimate. We've tried to make it easy to swap in other pretraining datasets, LLMs,
211+ evaluations, and cluster schedulers.
211212
212213
213214## Development guidelines
You can’t perform that action at this time.
0 commit comments