Open
Description
I tried to use LocalAI as a backend for https://github.com/madox2/vim-ai , but when feeding a request that is bigger than the README examples, it takes forever before crashing with :
ggml_gptj_new_tensor_impl: not enough space in the context's memory pool (needed 1073907088, available 1073741824)
fatal error: unexpected signal during runtime execution
[signal SIGSEGV: segmentation violation code=0x2 addr=0x48 pc=0x1031386a0]
see attached redacted.txt stacktrace