Skip to content

ramadiansyah/airflow-postgres-bigquery-pipeline

Repository files navigation

airflow-postgres-bigquery-pipeline

Automates ETL pipelines using Apache Airflow. Ingests data to PostgreSQL hourly and loads daily data to BigQuery with incremental and partitioned processing. Implements core data engineering practices like timestamps, foreign keys, and scheduled workflows.

Retail ETL Pipeline

About

Automates ETL pipelines using Apache Airflow. Ingests data to PostgreSQL hourly and loads daily data to BigQuery with incremental and partitioned processing. Implements core data engineering practices like timestamps, foreign keys, and scheduled workflows.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages