Skip to content

Python script to load large Excel/CSV datasets into MySQL using Jupyter Notebook, pandas, and SQLAlchemy.

Notifications You must be signed in to change notification settings

ANIRUDDHA-BISWAS/Load-Large-Datasets-into-MySQL-using-Python

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

7 Commits
Β 
Β 
Β 
Β 

Repository files navigation

Load Large Datasets into MySQL using Python

Python script to load large Excel/CSV datasets into MySQL using Jupyter Notebook, pandas, and SQLAlchemy.

Excel/CSV to MySQL Using Python

This repository contains a step-by-step Jupyter Notebook that demonstrates how to efficiently load large datasets from Excel or CSV files into a MySQL database using Python.

πŸ”§ Tools Used:

  • Python (Jupyter Notebook)
  • pandas
  • SQLAlchemy
  • MySQL
  • Excel/CSV files

πŸ“Œ Key Features:

  • Clean and transform data using pandas
  • Connect Jupyter Notebook to MySQL with SQLAlchemy and PyMySQL
  • Insert data in bulk using to_sql() method
  • Handle large files with chunksize for efficient uploading

πŸš€ Ideal For:

  • Data Analysts
  • Data Engineers
  • Students and beginners working with databases
  • Anyone automating data imports into MySQL

πŸ“‚ The notebook is well-commented and beginner-friendly.

Feel free to fork, use, and modify it in your own projects. Contributions and suggestions are welcome!

🀝 Connect with Me

About

Python script to load large Excel/CSV datasets into MySQL using Jupyter Notebook, pandas, and SQLAlchemy.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages