Discuss releasing OS optimization benchmark on Hugging Face

[NielsRogge]

Hi @yunwei37 🤗

Niels here from the open-source team at Hugging Face. I discovered your work on Arxiv and was wondering whether you would like to submit it to hf.co/papers to improve its discoverability. If you are one of the authors, you can submit it at https://huggingface.co/papers/submit.

The paper page lets people discuss about your paper and lets them find artifacts about it (your planned benchmark for instance), you can also claim the paper as yours which will show up on your public profile at HF, add Github and project page URLs.

I saw in your GitHub README that you are working on a "benchmark for evaluating the optimizations for OS!" (WIP). That sounds like a fantastic new dataset!

Would you be interested in hosting this benchmark dataset on https://huggingface.co/datasets once it's ready for release?
Hosting on Hugging Face will give it more visibility/enable better discoverability, and will also allow people to easily use it with:

from datasets import load_dataset

dataset = load_dataset("your-hf-org-or-username/your-dataset")

You can find a guide for uploading datasets here: https://huggingface.co/docs/datasets/loading.
We also support Webdataset, useful for image/video datasets: https://huggingface.co/docs/datasets/en/loading#webdataset.

Besides that, there's the dataset viewer which allows people to quickly explore the first few rows of the data in the browser.

After uploaded, we can also link the datasets to the paper page (read here) so people can discover your work.

Let me know if you're interested or need any help regarding this when the benchmark is ready!

Cheers,

Niels
ML Engineer @ HF 🤗

[yunwei37]

Thank you very much! Sounds helpful, I will have a look!