Release DCoT dataset on Hugging Face

[NielsRogge]

Hi @HaritzPuerto 🤗

I'm Niels and work as part of the open-source team at Hugging Face. I discovered your work through Hugging Face's daily papers as yours got featured: https://huggingface.co/papers/2407.03181.
The paper page lets people discuss about your paper and lets them find artifacts about it (your dataset for instance),
you can also claim the paper as yours which will show up on your public profile at HF, add Github and project page URLs.

It's great to see the pre-trained models already on Hugging Face. Would you be open to also hosting the DCoT dataset on Hugging Face? Hosting it there would give it much greater visibility and allow researchers to easily access and use it. We can add tags to the dataset card to make it more discoverable and link it to your paper page.

We support various formats, including JSON. There's also a dataset viewer that lets people explore the data directly in their browsers. We can help you with the upload process if needed.

Let me know if you're interested!

Kind regards,

Niels

[HaritzPuerto]

Hi @NielsRogge,

Thank you for your interest in our work! I am so sorry for the late reply, I just saw your message. We are indeed interested in hosting the dataset on HuggingFace. What would you suggest for the next steps?

Thanks.
Best regards,
Haritz

[NielsRogge]

Here's a guide to get started: https://huggingface.co/docs/datasets/en/loading. After that, you can do dataset.push_to_hub(...) to make it available on the hub.

Next it could be nice to document your dataset by adding a README and link it to https://huggingface.co/papers/2407.03181. Here's a guide: https://huggingface.co/docs/hub/en/datasets-cards

Let me know if you need any help!

[HaritzPuerto]

Thanks Niels for the tips! We'll work on it in a couple of weeks and will update the repository once it is done