Skip to content
View DevLeonardoK's full-sized avatar
🎯
Focusing
🎯
Focusing
8 followers · 7 following

Achievements

Achievement: QuickdrawAchievement: YOLOAchievement: Pull Shark

Achievements

Achievement: QuickdrawAchievement: YOLOAchievement: Pull Shark

Highlights

  • Pro

Block or report DevLeonardoK

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
DevLeonardoK/README.md

Leonardo Kremer

Engenheiro de Dados · Python & Spark · GCP & Azure · Brasil

Engenheiro de dados focado em transformar processos custosos em pipelines enxutos e de alta performance — conectando sistemas, APIs e bancos de dados a ambientes de storage prontos para análise. 2x Oracle Certified.

Destaques

  • ⚡ Redução de 75% na latência de consultas (20s → 5s) reescrevendo SQL com joins, window functions e CTEs
  • 🐳 Substituí um fluxo serverless instável por um microsserviço Docker + Flask — 20s → 1–5s, zero timeouts
  • 🏗️ Pipeline ponta a ponta na arquitetura Medallion: Kafka → Spark → GCS → BigQuery, orquestrado com Airflow

Stack

Python Spark Databricks SQL Airflow Docker GCP Azure AWS OCI

Contato

LinkedIn · Gmail

Pinned Loading

  1. house-sales-airflow-local-pipeline house-sales-airflow-local-pipeline Public

    Pipeline local para consumo e tratamento de dataset, com arquitetura medallion (bronze/silver/gold), usando Airflow, Spark e MinIO orquestrados via Docker Compose.

    Python

  2. kafka-market-data-platform kafka-market-data-platform Public

    Pipeline de dados de mercado com Kafka + Spark Structured Streaming (arquitetura medallion) até o BigQuery.

    Python

  3. airflow-openweather-etl airflow-openweather-etl Public

    Pipeline ETL que extrai dados meteorológicos da OpenWeather API, transforma com pandas e carrega no PostgreSQL, orquestrado com Apache Airflow.

    Jupyter Notebook

  4. crypto-price-medallion-gcp-airflow crypto-price-medallion-gcp-airflow Public

    Pipeline medallion (bronze/silver/gold) que consolida o preço de criptomoedas via CoinGecko, CoinCap e Binance usando Airflow, Spark e GCP.