Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
93 commits
Select commit Hold shift + click to select a range
da002b1
Init
shubhamnarkhede Jul 18, 2024
86ce4e6
Initial Fraud Detection Logic (30 mins multiple request restriction)
SamirTalkal Aug 11, 2024
34f1374
Containerized the application in Docker
SamirTalkal Aug 25, 2024
4b19c7e
Minikube Implementation
SamirTalkal Oct 2, 2024
74b7dd8
Adding Emergency Numbers dataset
shubhamnarkhede Aug 14, 2024
94332f8
Adding data to db
shubhamnarkhede Aug 14, 2024
cb9ab27
Lang Translation WIP
shubhamnarkhede Sep 10, 2024
f276cd4
Lang Detect and Translation API
shubhamnarkhede Sep 10, 2024
13709c2
Updating Test Branch
SamirTalkal Oct 2, 2024
169ad53
Adding scripts for 3 countries
aarushi-apte Nov 11, 2024
1507cf1
SQL queries and visualizations for Subtask #33
SwathiKrish97 Apr 22, 2025
4274eac
Add FastAPI analytics endpoints with RBAC (Subtask #35 of Task #30)
SwathiKrish97 Apr 29, 2025
363feca
Create ONBOARDING.md
saquibb8 Feb 25, 2026
11780c5
Update ONBOARDING.md
saquibb8 Feb 26, 2026
0e22111
Update ONBOARDING.md
saquibb8 Feb 26, 2026
5dd6f2a
Update ONBOARDING.md
saquibb8 Feb 26, 2026
8f87dd6
Create KnowledgeTransfer.md
saquibb8 Feb 26, 2026
57dc1d7
Restructure: split repo into data-engineering/ and data-analytics/ at…
saquibb8 Feb 26, 2026
53e1463
Clean up: remove pycache/venv, update .gitignore
saquibb8 Feb 26, 2026
163f665
Restructure: organize into src/, datasets/, infrastructure/, notebook…
saquibb8 Feb 26, 2026
94c2c2d
Add .env.example, per-Lambda requirements, deploy scripts, and CONTRI…
saquibb8 Feb 26, 2026
9b8b87d
Update imports and file paths for new project structure
saquibb8 Feb 26, 2026
422b745
Add file creation guidelines to CONTRIBUTING.md
saquibb8 Feb 26, 2026
a715b48
Move ONBOARDING.md to root as DATA_ENGINEERING_ONBOARDING.md
saquibb8 Feb 26, 2026
8a40534
Update DATA_ENGINEERING_ONBOARDING.md
saquibb8 Feb 27, 2026
e3186be
Delete DATA_ENGINEERING_ONBOARDING.md
saquibb8 Feb 27, 2026
267837f
Create README.md
saquibb8 Feb 27, 2026
648f4bf
Delete data-engineering/README.md
saquibb8 Feb 27, 2026
98efa86
Update CONTRIBUTING.md
saquibb8 Feb 27, 2026
9d37b7c
Update KnowledgeTransfer.md
saquibb8 Feb 27, 2026
918ccc1
Create tasktracker.md
saquibb8 Feb 27, 2026
ea987ac
Rename KnowledgeTransfer.md to KNOWLEDGE_TRANSFER.md
saquibb8 Feb 27, 2026
39a1541
Rename tasktracker.md to TASK_TRACKER.md
saquibb8 Feb 27, 2026
6997195
Update README.md
prachi080588 Feb 27, 2026
b02f65b
Update README.md
prachi080588 Feb 27, 2026
1ed3854
Update README.md
saquibb8 Feb 27, 2026
fd62ae8
Update README.md
saquibb8 Feb 27, 2026
6876959
Update README.md
prachi080588 Feb 27, 2026
d5f0857
Update README.md
prachi080588 Feb 27, 2026
fe10148
Update README.md
prachi080588 Feb 27, 2026
3787724
Update README.md
prachi080588 Feb 27, 2026
8e5bd66
Update README.md
prachi080588 Feb 27, 2026
e410c69
Update README.md
prachi080588 Feb 27, 2026
7965f20
Update TASK_TRACKER.md
Ruthwik01 Feb 27, 2026
856785c
Update TASK_TRACKER.md
Ruthwik01 Feb 27, 2026
37f651c
Update README.md
saquibb8 Feb 27, 2026
493ab4f
Add aggregator Lambda code and deploy workflow
saquibb8 Mar 2, 2026
a666e78
Remove heavy dependencies from requirements - use Lambda layers
saquibb8 Mar 2, 2026
84324e1
Add auto-deploy on PR merge + manual trigger
saquibb8 Mar 2, 2026
7752059
Test: bump version to trigger auto-deploy
saquibb8 Mar 2, 2026
c492a20
added lmabda function reference in contributing.md
saquibb8 Mar 2, 2026
97a4f04
Update CONTRIBUTING.md
saquibb8 Mar 2, 2026
3829066
Update CONTRIBUTING.md
anupbpote02 Mar 2, 2026
ed0c1d9
make changes for integration
saquibb8 Mar 3, 2026
6548114
implemented aggregate metrics
saquibb8 Mar 6, 2026
4902ac8
Update helpers.py
saquibb8 Mar 10, 2026
ee680b6
Added Analytics folder structure
prachi080588 Mar 11, 2026
9f502b1
added daatabase tables schema structure
prachi080588 Mar 11, 2026
59e2d80
added database folder
prachi080588 Mar 11, 2026
fce0573
added saayam database table structure
prachi080588 Mar 11, 2026
f82b72c
added lookup_tables folder
prachi080588 Mar 13, 2026
6981123
added lookeup tables
prachi080588 Mar 13, 2026
13187e1
Create MOCKDB.MD
saquibb8 Mar 11, 2026
b485950
Create users.csv
saquibb8 Mar 11, 2026
d9a68f1
Delete data-analytics/sample-data directory
saquibb8 Mar 11, 2026
8ce0483
Create readme.me
saquibb8 Mar 11, 2026
eba2ec6
Rename readme.me to readme.md
saquibb8 Mar 11, 2026
0d09ba6
Add get_tables_info utility and mock-data-generation
saquibb8 Mar 13, 2026
d7b9959
Update TASK_TRACKER.md
janhavi-1111 Mar 24, 2026
a798157
Update TASK_TRACKER.md
janhavi-1111 Mar 24, 2026
8d41a49
Add scripts and csv's
sagarikapatha Mar 24, 2026
85632b7
Update README
sagarikapatha Mar 25, 2026
74ae25a
#100: Add categories config with all predefined categories and subcat…
anupbpote02 Mar 3, 2026
f391abf
#100: Add OpenAI classifier logic for auto-categorizing help requests
anupbpote02 Mar 3, 2026
72fb812
#100: Add Lambda handler entry point for categorizer
anupbpote02 Mar 3, 2026
6062d97
#100: Add openai to categorizer Lambda dependencies
anupbpote02 Mar 3, 2026
ef0fff7
#100: Add python-dotenv to local dev dependencies
anupbpote02 Mar 3, 2026
45f2684
#100: Add 10 diverse test cases for categorizer Lambda
anupbpote02 Mar 17, 2026
6017dc8
code for volunteer details and volunteers assigned
vamsisaigarapati Apr 14, 2026
108c3bb
Add mock data generation for request_guest_details and req_add_info
Apr 14, 2026
c152320
Revert "Add mock data generation for request_guest_details and req_ad…
Apr 16, 2026
3b0be01
#119 Add synthetic Data generator for request_comments and volunteer_…
Nishu2000-hub Apr 17, 2026
da99de3
Revert "#119 Add synthetic Data generator for request_comments and vo…
Nishu2000-hub Apr 17, 2026
3f5fadc
Create beneficiariesTrendAnalysis.py
vighneshsridhar Apr 21, 2026
130cfd0
Create request_application_analytics.py
sana-desai Apr 24, 2026
24d729b
Rename request_application_analytics.py to application_analytics_requ…
sana-desai Apr 24, 2026
9c0b970
Create volunteer_application_analytics.py
sana-desai Apr 24, 2026
390e220
Update volunteer_application_analytics.py
sana-desai Apr 24, 2026
7bb5020
Update application_analytics_request.py.py
sana-desai Apr 24, 2026
06c884e
volunteer details and assigned tables scripts updated
vamsisaigarapati Apr 28, 2026
3241e10
Revert "volunteer details and assigned tables scripts updated"
vamsisaigarapati Apr 28, 2026
d7d1194
Revert "code for volunteer details and volunteers assigned"
vamsisaigarapati Apr 28, 2026
0305e35
#119: Added synthetic data generation for request_comments and volunt…
PavanChandru May 4, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
151 changes: 151 additions & 0 deletions .github/workflows/deploy-lambda.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,151 @@
name: Deploy Lambda Function

on:
pull_request:
types: [closed]
branches: [main]
paths:
- 'data-engineering/src/saayam-org-*/**'

Comment on lines +4 to +9
workflow_dispatch:
inputs:
source_folder:
description: 'Source folder under data-engineering/src/'
required: true
type: string
lambda_function_name:
description: 'AWS Lambda function name'
required: true
type: string

concurrency:
group: deploy-lambda-${{ github.ref }}
cancel-in-progress: true

jobs:
detect-changes:
if: github.event_name == 'pull_request' && github.event.pull_request.merged == true
runs-on: ubuntu-latest
outputs:
lambdas: ${{ steps.find-lambdas.outputs.lambdas }}
steps:
- uses: actions/checkout@v4
with:
fetch-depth: 0

- name: Find changed Lambda folders
id: find-lambdas
run: |
CHANGED=$(git diff --name-only ${{ github.event.pull_request.base.sha }} ${{ github.event.pull_request.head.sha }} \
| grep '^data-engineering/src/saayam-org-' \
| cut -d'/' -f3 \
| sort -u)

if [ -z "$CHANGED" ]; then
echo "lambdas=[]" >> $GITHUB_OUTPUT
else
JSON=$(echo "$CHANGED" | jq -R -s -c 'split("\n") | map(select(length > 0))')
echo "lambdas=$JSON" >> $GITHUB_OUTPUT
echo "📋 Lambdas to deploy: $JSON"
fi

deploy-auto:
needs: detect-changes
if: needs.detect-changes.outputs.lambdas != '[]'
runs-on: ubuntu-latest
strategy:
matrix:
lambda: ${{ fromJson(needs.detect-changes.outputs.lambdas) }}
steps:
- name: Check if authorized
run: |
if [ "${{ github.actor }}" != "saquibb8" ]; then
echo "❌ Unauthorized. Only saquibb8 can deploy."
exit 1
fi

- uses: actions/checkout@v4

- uses: actions/setup-python@v5
with:
python-version: '3.10'

- name: Build deployment package
run: |
mkdir package
if [ -f data-engineering/src/${{ matrix.lambda }}/requirements.txt ]; then
pip install -r data-engineering/src/${{ matrix.lambda }}/requirements.txt -t package/ --quiet
fi
cp -r data-engineering/src/${{ matrix.lambda }}/* package/
[ -d data-engineering/src/utils ] && cp -r data-engineering/src/utils package/
[ -d data-engineering/src/models ] && cp -r data-engineering/src/models package/

- name: Create zip
run: |
cd package && zip -r ../deployment.zip . --quiet && cd ..
echo "📦 Size: $(du -h deployment.zip | cut -f1)"

- uses: aws-actions/configure-aws-credentials@v4
with:
aws-access-key-id: ${{ secrets.AWS_ACCESS_KEY_ID }}
aws-secret-access-key: ${{ secrets.AWS_SECRET_ACCESS_KEY }}
aws-region: ${{ secrets.AWS_REGION }}

- name: Deploy to Lambda
run: |
echo "🚀 Deploying: ${{ matrix.lambda }}"
aws lambda update-function-code \
--function-name "${{ matrix.lambda }}" \
--zip-file fileb://deployment.zip \
--publish --output table
echo "✅ Done!"

deploy-manual:
if: github.event_name == 'workflow_dispatch'
runs-on: ubuntu-latest
steps:
- name: Check if authorized
run: |
if [ "${{ github.actor }}" != "saquibb8" ]; then
echo "❌ Unauthorized."
exit 1
fi

- uses: actions/checkout@v4
with:
ref: main

- uses: actions/setup-python@v5
with:
python-version: '3.10'

- name: Build deployment package
run: |
mkdir package
if [ -f data-engineering/src/${{ inputs.source_folder }}/requirements.txt ]; then
pip install -r data-engineering/src/${{ inputs.source_folder }}/requirements.txt -t package/ --quiet
fi
cp -r data-engineering/src/${{ inputs.source_folder }}/* package/
[ -d data-engineering/src/utils ] && cp -r data-engineering/src/utils package/
[ -d data-engineering/src/models ] && cp -r data-engineering/src/models package/

- name: Create zip
run: |
cd package && zip -r ../deployment.zip . --quiet && cd ..
echo "📦 Size: $(du -h deployment.zip | cut -f1)"

- uses: aws-actions/configure-aws-credentials@v4
with:
aws-access-key-id: ${{ secrets.AWS_ACCESS_KEY_ID }}
aws-secret-access-key: ${{ secrets.AWS_SECRET_ACCESS_KEY }}
aws-region: ${{ secrets.AWS_REGION }}

- name: Deploy to Lambda
run: |
echo "🚀 Deploying: ${{ inputs.lambda_function_name }}"
aws lambda update-function-code \
--function-name "${{ inputs.lambda_function_name }}" \
--zip-file fileb://deployment.zip \
--publish --output table
echo "✅ Done!"

Loading
Loading