Skip to content

natasha8/AWS-automated-data-pipeline

Repository files navigation

Guns Project Summary

This project aims to create an automated data pipeline that will collect data from external sources and store it in a database. The data will be used to predict e-scooter movement.

The pipeline will be built in two phases:

Phase 1: Local Pipeline

  • Collect data with APIs
  • Create a database model
  • Store data on a local MySQL instance

Phase 2: Cloud Pipeline

  • Set up a cloud database
  • Move your scripts to Lambda
  • Automate the pipeline

Tools

  • APIs: City, Airlabs.
  • Database: MySQL.
  • Cloud: AWS RDS.

Read my article on Medium HERE

About

WBS Data Science Project

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published