Skip to content

Could not create context from binary for context index = 0 : err 5000" #148

@Apriqi

Description

@Apriqi

Describe the bug
A clear and concise description of what the bug is.

To Reproduce
Steps to reproduce the behavior:
TB522FU:/data/local/tmp/genie_bundle $ ls
Llama2_Part1.bin Llama2_Part2.bin Llama2_Part3.bin Llama2_Part4.bin genie-t2t-run genie_config.json htp_backend_ext_config.json libGenie.so libQnnHtp.so libQnnHtpNetRunExtensions.so libQnnHtpV79Skel.so libQnnHtpV79Stub.so libQnnSystem.so tokenizer.json
TB522FU:/data/local/tmp/genie_bundle $ ./genie-t2t-run -c genie_config.json -p "<|im_start|>system"$'\n'$"You are a helpful AI assistant.<|im_end|>"$'\n'$"<|im_start|>user"$'\n'$"What is France's capital?<|im_end|>"$'\n'$"<|im_start|>assistant"$'\n'
Using libGenie.so version 1.2.0

[INFO] "Using create From Binary"
[INFO] "Allocated total size = 312936960 across 8 buffers"
[ERROR] "Could not create context from binary for context index = 0 : err 5000"
[ERROR] "Create From Binary FAILED!"
Failure to initialize model
Failed to create the dialog.
1|TB522FU:/data/local/tmp/genie_bundle $

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions