Skip to content

petals integration#23

Open
scicco wants to merge 8 commits intocheshire-cat-ai:mainfrom
scicco:petals
Open

petals integration#23
scicco wants to merge 8 commits intocheshire-cat-ai:mainfrom
scicco:petals

Conversation

@scicco
Copy link

@scicco scicco commented Nov 4, 2024

this is a draft for petals integration.

I need to put petals container command inside a proper Dockerfile

@scicco
Copy link
Author

scicco commented Nov 5, 2024

PR was updated with a Dockerfile, and the additional files that are needed to "customize" the cat to use Petals.

TODO: refactor the changes in llm.py extracting a proper plugin

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants