Skip to content

tensor 'blk.25.ffn_down.weight' has invalid ggml type 42 (NONE) #11975

Open
@evaninf

Description

Name and Version

version: 4726 (6dde178)
built with cc (GCC) 14.2.1 20250110 (Red Hat 14.2.1-7) for x86_64-redhat-linux

Operating systems

Linux

GGML backends

CPU

Hardware

AMD Ryzen 7 4800H with Radeon Graphics

Models

Llama3-8B-1.58-100B-tokens-GGUF
Falcon3-10B-Instruct-1.58bit-GGUF

Problem description & steps to reproduce

Trying to use any of the models results in the error.

First Bad Commit

No response

Relevant log output

build: 4726 (6dde1782) with cc (GCC) 14.2.1 20250110 (Red Hat 14.2.1-7) for x86_64-redhat-linux
main: llama backend init
main: load the model and apply lora adapter, if any
gguf_init_from_file_impl: tensor 'blk.25.ffn_down.weight' has invalid ggml type 42 (NONE)
gguf_init_from_file_impl: failed to read tensor info
llama_model_load: error loading model: llama_model_loader: failed to load model from /mnt/model/Llama3-8B-1.58-100B-tokens-q2b1.gguf

llama_model_load_from_file_impl: failed to load model
common_init_from_params: failed to load model '/mnt/model/Llama3-8B-1.58-100B-tokens-q2b1.gguf'
main: error: unable to load model

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions