Skip to content

Unable to load GPTNeoX model Pythia-70m-q4_0.bin #39

Open
@chrisbward

Description

@chrisbward
root@5dac227a29e8:~# LIBRARY_PATH=$PWD C_INCLUDE_PATH=$PWD /usr/local/go/bin/go run /root/go-ggml-transformers.cpp/examples/main.go  -m "/models/pythia-70m-q4_0.bin" -t 14
gpt2_model_load: loading model from '/models/pythia-70m-q4_0.bin'
gpt2_model_load: n_vocab = 50304
gpt2_model_load: n_ctx   = 2048
gpt2_model_load: n_embd  = 512
gpt2_model_load: n_head  = 8
gpt2_model_load: n_layer = 6
gpt2_model_load: ftype   = 16
gpt2_model_load: qntvr   = 0
gpt2_model_load: invalid model file '/models/pythia-70m-q4_0.bin' (bad vocab size 1 != 50304)
gpt2_bootstrap: failed to load model from '/models/pythia-70m-q4_0.bin'
Loading the model failed: failed loading model

I've changed the line in examples to l, err := gpt2.NewGPTNeoX(model) but no luck - what am I missing here?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions