[WIP] LLaMa-Torchsharp for LLaMa 3 #1380
Replies: 2 comments 2 replies
-
Found a better home for it. The project has migrated to Sample: https://github.com/dotnet/machinelearning/tree/main/docs/samples/Microsoft.ML.GenAI.Samples |
Beta Was this translation helpful? Give feedback.
-
@GeorgeS2019 I'd have to review @LittleLittleCloud 's latest code. If he already took care of Llama 3+, then nothing else in that direction. Other than that, I made a contribution to TorchSharp.PyBridge that would reduce the memory overhead during load time allowing you to load slightly larger models faster. It'd be a matter of ensuring that that my fix made it into PyBridge and making sure TorchSharp llama is using it. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
@LittleLittleCloud
=> question; are there challenges that you find that prevented this project to continue?
https://github.com/LittleLittleCloud/Torchsharp-llama
Continue further:
@ejhg
Beta Was this translation helpful? Give feedback.
All reactions