Skip to content

wenbindu/rknn-llm-utils

Repository files navigation

rknn-llm-utils

Solutions

  1. rknn-debert-v3: From microsoft/deberta-v3-base
  2. rknn-cn-roberta: From hfl/chinese-roberta-wwm-ext

Prepare Environments

export HF_ENDPOINT=https://hf-mirror.com

huggingface-cli download --resume-download hfl/chinese-roberta-wwm-ext --local-dir hfl/chinese-roberta-wwm-ext --local-dir-use-symlinks False

rknn-toolkit2

v2.3.0

Build from Dockerfile

Reference: rknn-toolkit2

docker build -t rknn-transformer-v23 .  

Dev

docker run --rm --gpus all --rm -v /hw_data/dean-ws/emotion-bert:/hw_data/dean-ws/emotion-bert --ipc=host  -it rknn-transformer-v23  bash
# install transformers when use bert
pip install transformers
pip install sentencepiece

python

About

关于瑞芯微的模型训练导出转换等相关代码

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published