Skip to content

Commit de07640

Browse files
authored
en-zh-bible-uedin desegmentation fix (#1061)
* en-zh-bible-uedin desegmentation fix * Aplly desegmentation in the opposite direction and fix filters.json format
1 parent 7bd75ad commit de07640

File tree

2 files changed

+54
-0
lines changed

2 files changed

+54
-0
lines changed
Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,27 @@
1+
{
2+
"version": 1,
3+
"files": [
4+
],
5+
"filters": [
6+
{
7+
"filter": "opus.RegExpSub",
8+
"parameters": {
9+
"patterns": [
10+
[
11+
"\\uff0e",
12+
"\u3002",
13+
0,
14+
""
15+
],
16+
[
17+
"([\\u3400-\\u4dbf\\u4e00-\\u9fff\\uf900-\\ufaff\\u3000-\\u303f]) +",
18+
"\\1",
19+
0,
20+
""
21+
]
22+
]
23+
},
24+
"language": null
25+
}
26+
]
27+
}
Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,27 @@
1+
{
2+
"version": 1,
3+
"files": [
4+
],
5+
"filters": [
6+
{
7+
"filter": "opus.RegExpSub",
8+
"parameters": {
9+
"patterns": [
10+
[
11+
"\\uff0e",
12+
"\u3002",
13+
0,
14+
""
15+
],
16+
[
17+
"([\\u3400-\\u4dbf\\u4e00-\\u9fff\\uf900-\\ufaff\\u3000-\\u303f]) +",
18+
"\\1",
19+
0,
20+
""
21+
]
22+
]
23+
},
24+
"language": null
25+
}
26+
]
27+
}

0 commit comments

Comments
 (0)