pip3 install vllm
pip3 install seqevalDataset is present in the dataset directory
Here we take Alpacare model to finetune (AlpaCare ) https://huggingface.co/xz97/AlpaCare-llama1-7b
bash train_instruct.shRun the following scrpit to test the best model
python3 inference_instruct_vllm.pyRun the following script and change the input of the prediction.py file with output obtained by running inference code
python3 prediction.py