The LLM-powered Robotic Agent

Figure: The overview of the system.

Dokcer environment

• Build the docker image

docker compose -f .docker/docker-compose.yml build

• Allow the docker can access to the X server

xhost +local:root

• Run the docker container

docker compose -f .docker/docker-compose.yml run mcp_ros

Local environment

Installation

• Install the claude desktop client: https://github.com/aaddrick/claude-desktop-debian
• Configre the Claude client: in the ~/.config/Claude/claude_desktop_config.json add the mcp server

Demo

• The ROS2 turtle simulator

ros2 run turtlesim turtlesim_node

• Start the claude desktop client

claude-desktop --no-sandbox

• Control the turtle in the chatbox