PromptWise

Official repository of the paper "PromptWise: Online Learning for Cost-Aware Prompt Assignment in Generative Models"

Xiaoyan Hu, Laren Pick, Ho-fung Leung, Farzan Farnia [Paper]

Usage Examples

PromptWise: python test.py --learner promptwise --kernel_method lin --reg_method mle --cost_para 0.001 --rd_budget 5

PromptWise-KLR: python test.py --learner promptwise --kernel_method rbf --reg_method klr --cost_para 0.001 --rd_budget 5

Acknowledgements

The authors would like to acknowledge the following repositories:

1. HumanEval: https://github.com/openai/human-eval
2. CodeGeeX: https://github.com/zai-org/CodeGeeX
3. BigCodeBench: https://github.com/bigcode-project/bigcodebench

Citation

@misc{hu2025promptwiseonlinelearningcostaware,
      title={PromptWise: Online Learning for Cost-Aware Prompt Assignment in Generative Models}, 
      author={Xiaoyan Hu and Lauren Pick and Ho-fung Leung and Farzan Farnia},
      year={2025},
      eprint={2505.18901},
      archivePrefix={arXiv},
      primaryClass={cs.LG},
      url={https://arxiv.org/abs/2505.18901}, 
}