Skip to content

Commit f331251

Browse files
Add note for WikiSplit
1 parent 0724c0f commit f331251

File tree

1 file changed

+3
-0
lines changed
  • model_cards/google/roberta2roberta_L-24_wikisplit

1 file changed

+3
-0
lines changed

model_cards/google/roberta2roberta_L-24_wikisplit/README.md

+3
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,9 @@ Disclaimer: The model card has been written by the Hugging Face team.
1717

1818
You can use this model for sentence splitting, *e.g.*
1919

20+
**IMPORTANT**: The model was not trained on the `"` (double quotation mark) character -> so the before tokenizing the text,
21+
it is advised to replace all `"` (double quotation marks) with two single `'` (single quotation mark).
22+
2023
```python
2124
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
2225

0 commit comments

Comments
 (0)