Metamorphic Testing Papers

Remark: This website is only used for collecting and grouping the related Metamorphic Testing paper.

All Papers

• ASE 2025

  • Metamorphic Testing for Audio Content Moderation Software - abstract / arXiv

• FSE 2025

  • Detecting and Reducing the Factual Hallucinations of Large Language Models with Metamorphic Testing - abstract
  • Hallucination Detection in Large Language Models with Metamorphic Relations - abstract / arXiv

• ICSE 2025

  • ChatGPT Inaccuracy Mitigation during Technical Report Understanding: Are We There Yet? - abstract / arXiv
  • ROSA: Finding Backdoors with Fuzzing - abstract / github.io
  • Metamorphic-Based Many-Objective Distillation of LLMs for Code-related Tasks - abstract / TUDelft

• ISSTA 2025

  • Improving Deep Learning Framework Testing with Model-Level Metamorphic Testing - abstract
  • QTRAN: Extending Metamorphic-Oracle based Logical Bug Detection Techniques for Multiple-DBMS Dialect Support - abstract

• TOSEM 2025

  • Identifying the Failure-Revealing Test Cases in Metamorphic Testing: A Statistical Approach - abstract / ACM

• TSE 2025

  • Using Cooperative Co-evolutionary Search to Generate Metamorphic Test Cases for Autonomous Driving Systems - abstract / arXiv

• SANER 2025

  • Can Large Language Models Discover Metamorphic Relations? A Large-Scale Empirical Study - abstract

• ASE 2024

  • MR-Adopt: Automatic Deduction of Input Transformation Function for Metamorphic Testing - abstract / ACM / IEEE

• FSE 2024

  • Abstraction-Aware Inference of Metamorphic Relations - abstract
  • A Miss Is as Good as A Mile: Metamorphic Testing for Deep Learning Operators - abstract
  • Metamorphic Testing of Secure Multi-Party Computation (MPC) Compilers - abstract

• ICSE 2024

  • EDEFuzz: A Web API Fuzzer for Excessive Data Exposures - abstract

• OOPSLA 2024

  • Drowzee: Metamorphic Testing for Fact-Conflicting Hallucination Detection in Large Language Models - abstract

• TOSEM 2024

  • Word Closure-Based Metamorphic Testing for Machine Translation - abstract
  • MET-MAPF: A Metamorphic Testing Approach for Multi-Agent Path Finding Algorithms - abstract
  • MR-Scout: Automated Synthesis of Metamorphic Relations from Existing Test Cases - abstract

• TSE 2024

  • GenMorph: Automatically Generating Metamorphic Relations via Genetic Programming - abstract

• ICSE 2023

  • MorphQ: Metamorphic Testing of the Qiskit Quantum Computing Platform - abstract
  • MTTM: Metamorphic Testing for Textual Content Moderation Softwar - abstract
  • Metamorphic Shader Fusion for Testing Graphics Shader Compilers - abstract
  • Metamorphic Testing with Causal Graphs - abstract
  • CCTest: Testing and Repairing Code Completion Systems - abstract

• ISSTA 2023

  • Dependency-Aware Metamorphic Testing of Datalog Engines - abstract
  • ECSTATIC: Automatic Configuration-Aware Testing and Debugging of Static Analysis Tools - abstract

• TOSEM 2023

  • Feedback-directed Metamorphic Testing - abstract

• TSE 2023

  • Metamorphic Testing for Web System Security - abstract

• ASE 2022

  • ElecDaug: Electromagnetic Data Augmentation for Model Repair based on Metamorphic Relation - abstract
  • Unveiling Hidden DNN Defects with Decision-Based Metamorphic Testing - abstract

• ISSTA 2022

  • One Step Further: Evaluating Interpreters using Metamorphic Testing - abstract
  • Metamorphic Relations via Relaxations: An Approach to Obtain Oracles for Action-Policy Testing - abstract

• TSE 2022

  • Using Metamorphic Testing to Improve the Quality of Tags in OpenStreetMap - abstract
  • A Declarative Metamorphic Testing Framework for Autonomous Driving - abstract

• ASE 2021

  • Assessing Robustness of ML-Based Program Analysis Tools using Metamorphic Program Transformations - abstract
  • Metamorphic Testing on Multi-module UAV Systems - abstract

• FSE 2021

  • Generating Metamorphic Relations for Cyber-physical Systems with Genetic Programming: An Industrial Case Study - abstract
  • New Visions on Metamorphic Testing after a Quarter of a Century of Inception - abstract
  • Metamorphic Testing of Datalog Engines - abstract

• TSE 2021

  • Enhance Combinatorial Testing With Metamorphic Relations - abstract
  • Metamorphic Robustness Testing: Exposing Hidden Defects in Citation Statistics and Journal Impact Factors - abstract
  • BiasFinder: Metamorphic Test Generation to Uncover Bias for Sentiment Analysis Systems - abstract

• ASE 2020

  • TestMC: Testing Model Counters using Differential and Metamorphic Testing - abstract
  • Metamorphic Object Insertion for Testing Object Detection Systems - abstract

• TSE 2020

  • Theoretical and Empirical Analyses of the Effectiveness of Metamorphic Relation Composition - abstract

• TSE 2019

  • METRIC+: A Metamorphic Relation Identification Technique Based on Input Plus Output Domains - abstract

• ASE 2018

  • DeepRoad: GAN-based Metamorphic Testing and Input Validation Framework for Autonomous Driving Systems - abstract

• CSUR 2018

  • Metamorphic Testing: A Review of Challenges and Opportunities - abstract

• ISSTA 2018

  • Identifying Implementation Bugs in Machine Learning Based Image Classifiers using Metamorphic Testing - abstract

• TSE 2018

  • Metamorphic Relations for Enhancing System Understanding and Use - abstract

• OOPSLA 2017

  • Automated testing of graphics shader compilers - [abstract] / ACM

• JSS 2016

  • METRIC: METamorphic Relation Identification based on the Category-choice framework - abstract

• TSE 2016

  • A Survey on Metamorphic Testing - abstract
  • Metamorphic Testing for Software Quality Assessment: A Study of Search Engines - abstract

• ICSE 2015

  • Metamorphic Model-Based Testing Applied on NASA DAT - An Experience Report - abstract

• ASE 2014

  • Search-based Inference of Polynomial Metamorphic Relations - abstract

• TSE 2013

  • How Effectively Does Metamorphic Testing Alleviate the Oracle Problem? - abstract