Skip to content

add bloom models#73

Open
ydli-ai wants to merge 41 commits intoTencent:mainfrom
fengyh3:feat_bloom
Open

add bloom models#73
ydli-ai wants to merge 41 commits intoTencent:mainfrom
fengyh3:feat_bloom

Conversation

@ydli-ai
Copy link
Collaborator

@ydli-ai ydli-ai commented Jul 1, 2023

No description provided.

ydli-ai and others added 30 commits November 24, 2022 10:53
� Conflicts:
�	scripts/convert_vit_from_huggingface_to_tencentpretrain.py
* add lora for pretrain.

* add lora for decoder and fix some bug.

* fix lora deepspeed save model.

---------

Co-authored-by: fengyh3 <648518051@qq.com>
* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* Add support for deepspeed zero-3 (#2)

Co-authored-by: hhou435 <435405393@qq.com>

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

* add llama config

---------

Co-authored-by: hhou435 <435405393@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants