4o tokeniser issue

[Mizerness]

I tried using AgentLaboratory with 4o but encountered a tokenizer issue.

Inference Exception: 'Could not automatically map 4o to a tokenizer. Please use tiktoken.get_encoding to explicitly get the tokenizer you expect.'

To replicate this, I used:

python ai_lab_repo.py --api-key "API_KEY_HERE" --llm-backend "4o" --research-topic "RESEARCH_IDEA"

Python version: 3.12.2
NEURON version: 8.2.4 (required for proper functioning)

[SamuelSchmidgall]

Hello, to use 4o you should write the full model name: gpt-4o

Change this: python ai_lab_repo.py --api-key "API_KEY_HERE" --llm-backend "4o" --research-topic "RESEARCH_IDEA"
to this: python ai_lab_repo.py --api-key "API_KEY_HERE" --llm-backend "gpt-4o" --research-topic "RESEARCH_IDEA"

[Mizerness]

You're totally right, made stupid mistake ;)

[David-Hoa2023]

I tried using DeepSeek but had tokenizer issue:

Inference Exception: 'Could not automatically map deepseek-chat to a tokeniser. Please use tiktoken.get_encoding to explicitly get the tokeniser you expect.'

To replicate this, I used:
python ai_lab_repo.py --api-key "API_KEY_HERE" --research-topic "RESEARCH_IDEA" --llm-backend "deepseek-chat" --copilot-mode "true"

[bradAGI]

I submitted a fix for that here:
#21