Python script to load large Excel/CSV datasets into MySQL using Jupyter Notebook, pandas, and SQLAlchemy.
This repository contains a step-by-step Jupyter Notebook that demonstrates how to efficiently load large datasets from Excel or CSV files into a MySQL database using Python.
π§ Tools Used:
- Python (Jupyter Notebook)
- pandas
- SQLAlchemy
- MySQL
- Excel/CSV files
- Clean and transform data using
pandas
- Connect Jupyter Notebook to MySQL with
SQLAlchemy
andPyMySQL
- Insert data in bulk using
to_sql()
method - Handle large files with
chunksize
for efficient uploading
- Data Analysts
- Data Engineers
- Students and beginners working with databases
- Anyone automating data imports into MySQL
π The notebook is well-commented and beginner-friendly.
Feel free to fork, use, and modify it in your own projects. Contributions and suggestions are welcome!
- π« LinkedIn: Aniruddha Biswas