Skip to content
View swayamg20's full-sized avatar
🚁
helicopter
🚁
helicopter

Block or report swayamg20

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
swayamg20/README.md

Swayam Gupta

Software Engineer II @ ixigo · IIT Kanpur '24

Building AI products at the intersection of real-time systems, decision science, and conversational interfaces.

Portfolio LinkedIn Medium Email


Currently Exploring

  • Decision Intelligence — Training SLMs to extract decision states from conversational signals (decision stage, risk tolerance, hesitation markers)
  • Real-time Voice Systems — VAD-based interruption handling, low-latency STT-LLM-TTS pipelines
  • Backend & Infra — WebRTC streaming, tool sandboxing, vector search, Redis pub/sub patterns
  • Research — Behavioral signal extraction, preference modeling through trade-offs, active learning loops

What I'm Building

VAD-based Conversational AI — Real-time voice assistant with:

  • STT → VAD → LLM → TTS pipeline with interruption handling
  • Tool calling, persistent memory, canvas API for rich UI
  • Working on: LLM re-routing based on complexity, live web search, sandbox code execution
  • Research direction: Decision Intelligence Model — fine-tuning 3-7B SLMs to infer decision psychology from conversations

Experience

Software Engineer II - AI Products @ ixigo (Aug '24 - Present)
Voice AI, real-time streaming, multi-agent orchestration

Founding Engineer @ overlayy AI (Apr '24 - Aug '24)
Built from scratch — LLM pipelines, AWS DevOps, microservices, analytics


Tech

Languages · TypeScript · Python · Elixir · C++
Backend · Node.js · FastAPI · Phoenix · Redis · PostgreSQL · MongoDB
Real-time · WebRTC · WebSockets · SSE · VAD · STT/TTS pipelines
ML/AI · LLM orchestration · Vector search · Fine-tuning · Active learning
Infrastructure · AWS · Docker · CI/CD


Projects

macOS Intelligence MCP — 5 MCP servers for screen intelligence, system control, Apple Shortcuts automation

Reel2Trip (ixigo Hackweek '25) — Instagram Reels → AI-generated travel itineraries

Techkriti'23 — Tech architecture for IIT Kanpur's flagship fest · 350K+ monthly visits

ISRO X-Ray Burst Automation — Solar X-ray burst identification · Silver Medal at Inter IIT


Writing


GitHub


Popular repositories Loading

  1. mcp-framework mcp-framework Public

    TypeScript 2

  2. vad-based-conv-ai vad-based-conv-ai Public

    TypeScript 2

  3. Sharer-Chrome-Extension Sharer-Chrome-Extension Public

    Google Chrome Extension to share images and text on social media

    JavaScript 1

  4. mac-os-automation-mcp mac-os-automation-mcp Public

    JavaScript 1

  5. ashwamedha.github.io ashwamedha.github.io Public

    CSS

  6. projects projects Public archive

    Projects on Development

    JavaScript