Commit b8a74fb
committed
fix(gui): transcode non-UTF-8 text uploads to UTF-8
Strict UTF-8 probing rejected GBK/Big5/Shift-JIS/UTF-16 text files as
binary and let legacy-encoded text reach the model as mojibake. Classify
uploads into utf8/needs-transcode/binary (tolerating multibyte chars cut
at the 32KiB probe boundary), transcode staged copies and native
attachment inlining to UTF-8 via encoding_rs + chardetng, and leave
in-workspace source files untouched.1 parent 6abc0be commit b8a74fb
3 files changed
Lines changed: 386 additions & 56 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
62 | 62 | | |
63 | 63 | | |
64 | 64 | | |
| 65 | + | |
| 66 | + | |
65 | 67 | | |
66 | 68 | | |
67 | 69 | | |
| |||
0 commit comments