A fully containerized Data Lakehouse built on the Medallion Architecture (Bronze → Silver → Gold) using Apache Iceberg as the table format, Nessie as the catalog, MinIO as object storage, and Trino…
End-to-End Data Engineering Pipeline for processing user events using Kafka, NiFi, HDFS, Hive, and Airflow.
Java 1
Automated daily data pipeline to extract EGX30 stock prices, validate them, and load them into Hive using Apache Airflow.
Python 1
As someone deeply fascinated by data-driven insights and user behavior, I embarked on an exciting project to analyze a dataset focused on mobile device usage. This project allowed me to explore var…
Jupyter Notebook 1