sample .env. template file will help for arena MaaS use case

[amitlals]

Hello Nick,
I know its a silly Q, I'm setting up arena to test few models comparison, wondering if I must insert API keys in mass_client.py directly or I should have .env file separately? Thanks!

[amitlals]

Below sample will work?

GPT-4o Configuration

GPT_4O_ENDPOINT=https://your-gpt4o-endpoint.openai.azure.com/
GPT_4O_KEY=your_gpt4o_key_here
GPT_4O_API_KEY=your_gpt4o_api_key_here

GPT-4 Turbo Configuration

GPT_4_TURBO_ENDPOINT=https://your-gpt4turbo-endpoint.openai.azure.com/
GPT_4_TURBO_KEY=your_gpt4turbo_key_here
GPT_4_TURBO_API_KEY=your_gpt4turbo_api_key_here

Jamba Instruct Configuration

JAMBA_INSTRUCT_ENDPOINT=https://your-jamba-endpoint.azure.com/
JAMBA_INSTRUCT_KEY=your_jamba_key_here

Command R Configuration

COMMAND_R_ENDPOINT=https://your-commandr-endpoint.azure.com/
COMMAND_R_KEY=your_commandr_key_here

Command R Plus Configuration

COMMAND_R_PLUS_ENDPOINT=https://your-commandrplus-endpoint.azure.com/
COMMAND_R_PLUS_KEY=your_commandrplus_key_here

JAIS 30B Configuration

JAIS_30B_ENDPOINT=https://your-jais30b-endpoint.azure.com/
JAIS_30B_KEY=your_jais30b_key_here

Llama 3.1 Models Configuration

LLAMA_3_1_405B_ENDPOINT=https://your-llama405b-endpoint.azure.com/
LLAMA_3_1_405B_KEY=your_llama405b_key_here

LLAMA_3_1_70B_ENDPOINT=https://your-llama70b-endpoint.azure.com/
LLAMA_3_1_70B_KEY=your_llama70b_key_here

LLAMA_3_1_8B_ENDPOINT=https://your-llama8b-endpoint.azure.com/
LLAMA_3_1_8B_KEY=your_llama8b_key_here

Mistral Models Configuration

MISTRAL_LARGE_ENDPOINT=https://your-mistrallarge-endpoint.azure.com/
MISTRAL_LARGE_KEY=your_mistrallarge_key_here

MISTRAL_LARGE_2407_ENDPOINT=https://your-mistrallarge2407-endpoint.azure.com/
MISTRAL_LARGE_2407_KEY=your_mistrallarge2407_key_here

MISTRAL_NEMO_ENDPOINT=https://your-mistralnemo-endpoint.azure.com/
MISTRAL_NEMO_KEY=your_mistralnemo_key_here

Phi-3 Models Configuration

PHI_3_MEDIUM_128K_INSTRUCT_ENDPOINT=https://your-phi3medium-endpoint.azure.com/
PHI_3_MEDIUM_128K_INSTRUCT_KEY=your_phi3medium_key_here

PHI_3_SMALL_128K_INSTRUCT_ENDPOINT=https://your-phi3small-endpoint.azure.com/
PHI_3_SMALL_128K_INSTRUCT_KEY=your_phi3small_key_here

PHI_3_MINI_4K_INSTRUCT_ENDPOINT=https://your-phi3mini-endpoint.azure.com/
PHI_3_MINI_4K_INSTRUCT_KEY=your_phi3mini_key_here