Phase 2: Ingestion Pipeline - Ingestion Endpoints and Batcther

[anuragShingare30]

Parent issue #21

Objective

To create ingestion endpoint which validates request body and perform the batch compression

Tasks

• Create POST /ingest handler
• Validate request body (timestamp, service, level, message, tags)
• API key validation middleware → extract project_id
• In-memory buffer per project
• Flush on:
  • Batch size threshold (e.g., 1000 logs)
  • Time threshold (e.g., 30 seconds)
• Compress batch with gzip / zstd

[ChayanDass]

I am taking this! And I want to update some of the functionality. Making it a configurable port, instead of a hardcoded port via a menager!