Add this to readme

[mail2harishemail]

new

from openai import OpenAI

client = OpenAI(
api_key="irrelevant", # this must set
base_url = "https://api.kastan.ai/v1" # this must set
)
def custom_completion(prompt):

completion = client.completions.create(
    
    model="llama-2-7b",
    prompt=prompt,
    max_tokens=200,
    temperature=0.7,
    stream=True)

# ⚡️⚡️ streaming
for token in completion:
    print(token.choices[0].text, end='')

custom_completion("what is the capital of france?")

[KastanDay]

I think the format has changed in recent openai python package versions. I'll investigate which versions adhere to which behavior and update the README with 2 install methods (old package and new package). Thanks for the tip.