Skip to content

evgeniimatveev/job-market-pulse

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

56 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

title Job Market Pulse
emoji 📊
colorFrom blue
colorTo indigo
sdk docker
pinned false

Job Market Pulse Banner

📰 Today's Market Report

🗓️ Jul 08 2026  ·  Pipeline run #42  ·  4,620 total records

🏆 Top Stack 💰 Highest Paying 🌐 Most Remote-Friendly
Python — 27,973 listings AWS — $186k avg SQL — 24% remote

Top 5 demand ranking (latest run):

Rank Stack Listings Demand Score
🥇 Python 27,973 38.0/100
🥈 AWS 22,641 30.7/100
🥉 SQL 18,854 25.6/100
4️⃣ Azure 11,589 15.7/100
5️⃣ Tableau 5,960 8.1/100

Auto-updated daily by GitHub Actions · Powered by Adzuna API


Daily tracking of tech job demand, salaries & remote trends across 10 tech stacks × 10 US cities + remote — from API ingestion to a live Streamlit dashboard. Refreshed automatically once a day via GitHub Actions. Zero manual steps after deploy.

"Built an end-to-end market intelligence pipeline: API → transform → DuckDB → visualize → automate. 10 stacks. 11 locations. $0 infrastructure cost."

Live Demo → HuggingFace Spaces


Dashboard

🏆 Hero & KPI Cards

Hero and KPIs

📊 Demand Ranking

Demand Ranking

📈 Demand Trend Over Time

Trend

🌐 Remote Friendliness by Stack

Remote

💰 Salary Intelligence

Salary

🗺️ City Heatmap — Stack × City

City Heatmap


What it tracks

Dimension Detail
Tech stacks Python · SQL · Tableau · Power BI · dbt · Spark · Airflow · Snowflake · AWS · Azure
Cities New York · LA · Chicago · SF · Seattle · Austin · Boston · Denver · Atlanta · Dallas + Remote
Metrics Job count · Demand score · Salary avg/min/max · Remote % · Salary disclosure rate
Cadence Daily at 7:00 AM PST via GitHub Actions

Architecture

Adzuna API  ──►  extract.py  ──►  transform.py  ──►  load.py
                                                        │
                                                   DuckDB file
                                                        │
                    ┌───────────────────────────────────┤
                    │                                   │
             HuggingFace Dataset                 GitHub Actions
             (persistent storage)                (daily cron)
                    │
             HuggingFace Space
             (Streamlit dashboard)

Key design decision: DuckDB file lives on a HuggingFace Dataset — downloaded before each run, updated after. Zero database hosting cost, full history preserved indefinitely.


Demand Score formula

demand_score = (stack_count - min_count) / (max_count - min_count) × 100

Normalized per run so stacks are always comparable regardless of absolute count differences. Python = 100 baseline.


Day 1 findings (May 26 2026)

Rank Stack Jobs Avg Salary Remote %
#1 Python 27,764 $137k 31%
#2 AWS 21,999 $187k 13%
#3 SQL 19,472 $142k 25%
#4 Azure 13,424 $150k 21%
#10 dbt 1,712 $128k 12%

New York dominates every single stack. Python + SQL most remote-friendly. Airflow & dbt most niche.


Tech stack

Python · DuckDB · Streamlit · Plotly · GitHub Actions · HuggingFace Spaces · Docker · Adzuna API


Data from Adzuna · Updated daily · Built by Evgenii Matveev

About

Daily tracking of tech job demand, salaries & remote trends — 10 stacks x 10 US cities. Adzuna API + DuckDB + Streamlit. Updated every morning via GitHub Actions.

Topics

Resources

Stars

8 stars

Watchers

0 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages