evaluation Parameter Parsing problem #1676
Description
"In the latest version of the code, you changed the type of the parameter 'args.tasks' to a string. There is an issue with the validation and handling of this parameter in the intel_extension_for_transformers/transformers/llm/evaluation/lm_eval/accuracy.py file.
'''
elif args.tasks == "list":
eval_logger.info(
"Available Tasks:\n - {}".format("\n - ".join(task_manager.all_tasks))
)
sys.exit()
'''
I think it should be modified as follows:
'''
elif isinstance(args.tasks, list):
eval_logger.info(
"Available Tasks:\n - {}".format("\n - ".join(task_manager.all_tasks))
)
sys.exit()
'''
I believe you should also output a corresponding warning here, informing users who have passed 'args.tasks' as a list, what type of parameter they should input to successfully perform the test.