Skip to content

README.md

Latest commit

 

History

History
45 lines (38 loc) · 975 Bytes

README.md

File metadata and controls

45 lines (38 loc) · 975 Bytes

Self-Distillation

Installation Instructions

Required :

    python=3.12
    torch=2.4.0 cuda=12.4

Installation :

    > virtualenv self_distil
    > source self_distil/bin/activate
    > pip install -r requirements.txt
    > bash package_install.sh

Run

GNN model :

    > python3 main.py

Self Distillation :

    > python3 main_distil.py

Results:

CORA Dataset

Model Test Accuracy
2 layer GCN 0.801
MLP Based Self Distillation Model 0.84399 
@article{wu2024teacher,
  title={A Teacher-Free Graph Knowledge Distillation Framework with Dual Self-Distillation},
  author={Wu, Lirong and Lin, Haitao and Gao, Zhangyang and Zhao, Guojiang and Li, Stan Z},
  journal={IEEE Transactions on Knowledge and Data Engineering},
  year={2024},
  publisher={IEEE}
}