(Code/Data) Documentation of the Article "Text Mining Tafsir: Compilation and Preliminary Explorations of a Curated Corpus of 80 Qur’anic Commentaries"

Version: 1.0 (26.05.2025)

This repository includes the code and parts of the data used in the article titled "Text Mining Tafsir: Compilation and Preliminary Explorations of a Curated Corpus of 80 Qur’anic Commentaries," published in the Journal of Digital Islamicate Research. Please note that the Jupyter notebook in this repository are solely intended to document the clustering process. The individual steps can only be replicated with the necessary data, including the Mistral AI embeddings. The data originates from Adrian Bernhard's Tafsir database, available on Zenodo.

This repository includes:

1. The Jupyter notebook Clustering.ipynb used to retrieve embeddings and conduct the clustering analysis.
2. Most of the data, tables, images, and csv files used in the article in the respective subfolders.
3. Smaller parts of the EDA in the Jupyter notebook EDA.ipynb.
4. All embeddings retrieved via the Mistral API (in the form of pickle files) which build the foundation of the clustering analysis.
5. The SQL queries used in the database to create certain statistics (see the file SQL_query.md).

This repository does not include:

1. The original database with the Tafsir data created by Adrian Bernhard. This database can be found here: https://zenodo.org/records/11206706
2. The API services used internally by the A01 team to query the database.
3. The original images taken from the master thesis by Adrian Bernhard (which are also part of the Zenodo repository linked above).

If you have any questions or comments, please write to thomas.jurczyk-q88@rub.de