I build interactive environments for intelligent agents — spanning browsers, robotics, and real-world systems.
My work focuses on creating software and hardware platforms where learning-based and reinforcement learning agents can observe, act, and be evaluated.
I’m especially interested in GUI agents, tool-using AI, and learning-driven control of real interfaces — from web applications to robots and IoT devices.
- Agent Environments — browser-based GUIs, multi-agent systems, and ROS/Gazebo simulations where agents operate in real state–action spaces
- Reinforcement Learning — training learning-based agents using the Hugging Face Deep RL stack and extending my environments with reward-driven control
- Software-Operating AI — agents that use tools, navigate UIs, call APIs, and complete multi-step tasks
-
Agentic RFP System (LangGraph)
A multi-agent decision environment where a master agent selects actions (query, parse, price, validate) and receives structured outcome signals. -
Browser-Based GUI Agent Environments
Chrome extensions exposing DOM state, user actions, and task completion for agents that learn to operate real websites. -
ROS 2 & Gazebo Drone Environment
A physics-based control environment exposing state (pose, IMU, velocity) and actions (motor thrusts), suitable for learning-based control. -
Smart Helmet (IoT Safety System)
A real-world sensor environment with state, actions, and outcome signals for safety-critical decision making.
- Deep Reinforcement Learning (Hugging Face Deep RL curriculum, policy learning, environment interaction)
- GUI & Tool-Using Agents
- ROS 2, Gazebo, and Robotics Simulation
- LLM-based multi-agent systems (LangChain, LangGraph)
- RL-ready environments
- Agentic systems and tool-using AI
- Robotics + software-controlled environments
- Open-source projects around interactive AI
- Building browser & software environments for agents
- Multi-agent systems and decision orchestration
- ROS 2, Gazebo, and robotics simulation
- Reinforcement learning for real-world systems
- LinkedIn: https://linkedin.com/in/vignesh-kamsala
- GitHub: https://github.com/Vignesh-Kamsala
Python • PyTorch • LangGraph • LangChain • ROS 2 • Gazebo • Chrome Extension APIs • React • TypeScript • FastAPI • OpenCV • ESP32 • BLE • Git