Open
Description
root@5dac227a29e8:~# LIBRARY_PATH=$PWD C_INCLUDE_PATH=$PWD /usr/local/go/bin/go run /root/go-ggml-transformers.cpp/examples/main.go -m "/models/pythia-70m-q4_0.bin" -t 14
gpt2_model_load: loading model from '/models/pythia-70m-q4_0.bin'
gpt2_model_load: n_vocab = 50304
gpt2_model_load: n_ctx = 2048
gpt2_model_load: n_embd = 512
gpt2_model_load: n_head = 8
gpt2_model_load: n_layer = 6
gpt2_model_load: ftype = 16
gpt2_model_load: qntvr = 0
gpt2_model_load: invalid model file '/models/pythia-70m-q4_0.bin' (bad vocab size 1 != 50304)
gpt2_bootstrap: failed to load model from '/models/pythia-70m-q4_0.bin'
Loading the model failed: failed loading model
I've changed the line in examples to l, err := gpt2.NewGPTNeoX(model)
but no luck - what am I missing here?
Metadata
Metadata
Assignees
Labels
No labels