Skip to content

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

Meta-finetuning and Overtuning in Small Language Models

This repository is a research artifact related to the bachelor thesis by Laith Agbaria, under the supervision of Jan N. van Rijn, Sietse Schroder, and Andreas Paraskeva. The thesis itself could be found on Leiden University: Science Faulty - LIACS thesis repository.

Running an experiment

It builds on the expectation that there will be a HuggingFace token in an .env file added within the repository.

git clone https://github.com/L-Agbaria/meta-finetuning_overfitting

cd ./meta-finetuning_overfitting
python3 -m venv .venv
source .venv/bin/activate
pip install --upgrade pip
pip install -r requirements.txt

# # Optional to customize
# nano final.py
python final.py
# # Optional in case a study combination fails
# nano clean.py
# python clean.py
# python final.py
python aggregate_experiments.py

Then utilize the Jupyter Notebook to create the figures.

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages