Empirical-Study-LLM-MR

Hi there👋, this is the repository for the paper "Can Large Language Models Discover Metamorphic Relations? A Large-Scale Empirical Study" (accepted by SANER 2025). You can view the code of each software under test, as well as the scripts that used to instruct LLM for MR identification.

• Docs for scripts
• Docs for software-under-test
• Download exmperimental data (Google Drive)

Citation

@inproceedings{zhang2025can,
    title        = {Can large language models discover metamorphic relations? A large-scale empirical study},
    author       = {Zhang, Jiaming and Sun, Chang-ai and Liu, Huai and Dong, Sijin},
    booktitle    = {2025 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER)},
    pages        = {24--35},
    year         = {2025},
    organization = {IEEE}
}