When running any eval command, such as:
python umbrela/gpt_judge.py --qrel dl19-passage --result_file output.txt --prompt_type bing --model gpt-4o --few_shot_count 0
An error crops up:
Traceback (most recent call last):
File "/home/ssubr/RESEARCH/forks/test/umbrela/src/umbrela/gpt_judge.py", line 14, in <module>
from umbrela.llm_judge import LLMJudge
ModuleNotFoundError: No module named 'umbrela'
This is solved by running: pip install -e . in the /umbrela root directory
When running any eval command, such as:
python umbrela/gpt_judge.py --qrel dl19-passage --result_file output.txt --prompt_type bing --model gpt-4o --few_shot_count 0An error crops up:
This is solved by running:
pip install -e .in the /umbrela root directory