Smoothquant for Phi2 and Qwen2#22

Open

ponytaill wants to merge 2 commits intoAniZpZ:mainfrom

ponytaill:smoothquant_phi2_qwen2

Commits on May 18, 2024

Added Smoothquant support for Phi2 and Qwen2 models, and added ppl_eval.py to test results more easily (there were a few issues here that prevented me from using eval_model.py in examples)
ponytaill
committed
Added Smoothquant support for Phi2 and Qwen2 models, and added ppl_eval.py to test results more easily (there were a few issues here that prevented me from using eval_model.py in examples)
ponytaill
committed