Skip to content
This repository was archived by the owner on Jan 24, 2024. It is now read-only.

Issues: hyperonym/basaran

Support for v1/embeddings endpoint
#179 by josephrocca was closed Jun 3, 2023
Closed 12
Add support for chat completion API
#140 opened Apr 16, 2023 by peakji
Open 1
Clear current search query, filters, and sorts
13 Open 11 Closed
13 Open 11 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

401 error on llama2 model while access granted question Further information is requested
#289 opened Dec 16, 2023 by tomtomtomtom44
Runpod Serverless question Further information is requested
#288 opened Dec 15, 2023 by stonejohnson
1
Loading basaran on multiple gpus leads to error question Further information is requested
#280 opened Nov 30, 2023 by tanmaylaud
Tried multiple different models but get "The model weights are not tied..." error every time.. question Further information is requested
#266 opened Sep 30, 2023 by jontstaz
Use basaran API as Langchain LLM question Further information is requested
#256 opened Sep 8, 2023 by brightebyte
TypeError: __init__() got an unexpected keyword argument 'load_in_4bit' question Further information is requested
#227 opened Jul 11, 2023 by tanshuai
1
I want use the function prefix_allowed_tokens_fn, where of basaran's source code shall I modify? question Further information is requested
#220 opened Jun 29, 2023 by zoubaihan
1
RuntimeError: expected scalar type Float but found Half question Further information is requested
#215 opened Jun 16, 2023 by DataDropp
Falcon 40B : too slow and random answers question Further information is requested
#204 opened Jun 6, 2023 by ArnaudHureaux
@fardeon
7
in stream mode, the English word has no space after detokenizer and Chinese were messed up question Further information is requested
#197 opened Jun 1, 2023 by lucasjinreal
14
How to set my own parameters in model.generate() in basaran? question Further information is requested
#193 opened May 17, 2023 by zoubaihan
2
Do you have Discord community? question Further information is requested
#185 opened Apr 25, 2023 by karfly
1
:latest version tag question Further information is requested
#138 opened Apr 15, 2023 by mariushosting
2
ProTip! Adding no:label will show everything without a label.