Skip to content

feat: add in jsonl file format to save data#1652

Merged
penguine-ip merged 2 commits intoconfident-ai:mainfrom
yudhiesh:feat/add-jsonl-as-file-format
Jun 4, 2025
Merged

feat: add in jsonl file format to save data#1652
penguine-ip merged 2 commits intoconfident-ai:mainfrom
yudhiesh:feat/add-jsonl-as-file-format

Conversation

@yudhiesh
Copy link
Copy Markdown
Contributor

@yudhiesh yudhiesh commented Jun 3, 2025

What is this PR about?

  • References Add jsonl file support in dataset  #931 which requests JSONL as a file format to save datasets
  • I implemented this as I am generating a large synthetic dataset > 10k rows and don't want to load everything into memory therefore JSONL fits my use case perfectly.

TODO:

  • update all documentation to showcase that jsonl is a valid type.

@vercel
Copy link
Copy Markdown

vercel Bot commented Jun 3, 2025

Someone is attempting to deploy a commit to the Confident AI Team on Vercel.

A member of the Team first needs to authorize it.

@yudhiesh yudhiesh changed the title feat: add in jsonl to save data feat: add in jsonl file format to save data Jun 3, 2025
@penguine-ip penguine-ip merged commit def7906 into confident-ai:main Jun 4, 2025
2 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants