GitHub - cfoster0/humongous-rs: A Rust pipeline for extracting HUMONGOUS, a dataset of web-based text extracted from Common Crawl and ready for multilingual language modeling.

Name		Name	Last commit message	Last commit date
Latest commit History 22 Commits
humongous-bin		humongous-bin
humongous-lib		humongous-lib
Cargo.toml		Cargo.toml

About

A Rust pipeline for extracting HUMONGOUS, a dataset of web-based text extracted from Common Crawl and ready for multilingual language modeling.

No releases published