Commit 65f5c2b
authored
Add Wikipedia Persian Dataset (#3629)
Currently, the Open-assistant model doesn't support Farsi. This is a
text-only dataset to learn Farsi (Persian).
One of my friends fine-tuned LLaMa on this dataset and It could
understand Farsi grammar and word usage very well. If the Open-assistant
team wants to add support to Farsi, this should be the first step.
I have transformed the dataset into the standard that has been mentioned
[here](https://projects.laion.ai/Open-Assistant/docs/data/datasets) and
uploaded it to [my huggingface
account](https://huggingface.co/datasets/pourmand1376/fa-wikipedia).
- #29741 parent aa96100 commit 65f5c2b
2 files changed
Lines changed: 7 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| 7 | + | |
7 | 8 | | |
8 | 9 | | |
9 | 10 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
0 commit comments