Skip to content

Crash when asking a question too big #110

Open
@MartyLake

Description

@MartyLake

I tried to use LocalAI as a backend for https://github.com/madox2/vim-ai , but when feeding a request that is bigger than the README examples, it takes forever before crashing with :

ggml_gptj_new_tensor_impl: not enough space in the context's memory pool (needed 1073907088, available 1073741824)
fatal error: unexpected signal during runtime execution
[signal SIGSEGV: segmentation violation code=0x2 addr=0x48 pc=0x1031386a0]

see attached redacted.txt stacktrace

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions