- Run
pnpm iand start withpnpm run start - Get a model.
Some that work well are Luna AI Llama2 Uncensored or OpenHermes Mistral - Run LM Studio Local Inference Server.
Make sure the model has correct settings and prompt formatting preset.
You should also increase the number of cpu threads. (default is 4, 10-14 works fine)
Spejik/pepa-discord-ai-bot
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|