Skip to content

LLM Quantization Notebook #1057

Open
Open
@Giuseppe5

Description

@Giuseppe5

Is your feature request related to a problem? Please describe.
Currently the LLM entrypoint is very broad with lots of options, at times confusing for new users.

Describe the solution you'd like
It would be nice to have a notebook with some examples on how to quantize LLM with brevitas, which can be basically a simplified version of the LLM entrypoint, with more explanations about the various options and how they combine together.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions