fix: raise default n_ctx from 4096 to 8192 and fix UTF-8 token boundary#187

Michael-A-Kuykendall merged 1 commit intoMichael-A-Kuykendall:mainMichael-A-Kuykendall/shimmy:mainfrom

LopezNuance:fix/kvcache-ctx-and-utf8LopezNuance/shimmy:fix/kvcache-ctx-and-utf8Copy head branch name to clipboard