Prosus: Agentic Voice Restaurant Ordering Webapp with Groq & LiveKit

This guide helps you build an AI-powered e-commerce app for the Prosus Challenge using Coral Protocol and multi-agent collaboration. Follow step-by-step setup instructions for agents, server, and UI.

Outline

• Setup Coral Server and Coral Studio
  Step-by-step guide to install and run Coral Server and Coral Studio with necessary dependencies (Java, Yarn, Node.js).

• Setup the Agents
  Instructions to install and configure the Interface Agent and Restaurant Voice Agent using uv.

• Run the Agents
  Three available options to run agents:

  • Dev Mode (terminal-based) for easier debugging
  • Custom UI Mode with independent frontend
  • Dev Mode with Coral Studio UI

Introduction

The Prosus Challenge track is centered around building an AI-powered e-commerce application using the Coral Protocol, an open, standardized framework for AI agent collaboration. Coral enables multiple AI agents to communicate, share tasks, and coordinate through a structured messaging layer with threads and mentions. In this track, participants will leverage Coral Server along with specialized agents such as the Interface Agent to handle user instructions and the Restaurant Voice Agent for real-time, voice-based interactions. The solution integrates technologies like Groq and LiveKit to power AI, speech, and communication capabilities, with an optional custom UI to deliver a seamless user experience.

• Agents: Interface Agent | Restaurant Voice Agent
• Demo Video for Running with custom UI
• Demo Video Output of Custom UI

1. Setup Coral Server and Coral Studio

Details

• To setup the Coral Server and Coral Studio UI, follow the steps given in repository to install.

• In order to test if both are working, open the same instance in two terminals and run both simultaneously.

# run studio
yarn dev

• You will see both running like this simultaneously if succesful and should be able to access Coral Studio from your browser.

• On Coral Studio, ensure the connection to Coral Server.

Install Java if UNAVAILABLE in order to run Coral Server

Install Java

# Apt update
sudo apt update

# Install the JDK
sudo apt install openjdk-17-jdk

# Check version
java -version

Run Coral Server

./gradlew run

Install Yarn if UNAVAILABLE in order to run Coral Studio

Install Yarn

# Download and install nvm:
curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.40.3/install.sh | bash

# in lieu of restarting the shell
\. "$HOME/.nvm/nvm.sh"

# Download and install Node.js:
nvm install 22

# Verify the Node.js version:
node -v # Should print "v22.17.0".
nvm current # Should print "v22.17.0".

# Download and install Yarn:
corepack enable yarn

# Verify Yarn version:
yarn -v

# Install from yarn
yarn install

# Allow port for eternal access
sudo ufw allow 5173

Run Coral Studio

yarn dev

2. Setup the Agents

Details

• Terminate the Coral Server and Coral Studio connections from above and start below steps.
• In this example, we are using the agents: Coral Interface Agent and Restaurant Agent.
• Please click on the link and set up the agents by following the setup instructions in the repository.

3. Run the Agents:

You can run it in three modes but Dev mode is preferable for beginner

Option 1: Dev Mode(Running on terminal)

• The Dev Mode allows the Coral Server and all agents to be seaprately running on each terminal without UI support.

• Ensure that the Coral Server is running on your system and run below commands in separate terminals.

• Ensure that you have setup the .env file with required keys.

Make Sure you run both agents at approximately same time:

Run the Interface Agent

# cd to directory
cd Coral-Interface-Agent

# Run the agent using `uv`:
uv run python main.py

Run the Restaurant Agent

# cd to directory
cd Coral-RestaurantVoice-Agent

# Run the agent using `uv`:
uv run main.py console

Option 2: Agents running without Coral-Studio and using custom UI:

Ensure that the Coral Server is running on your system

1. Git clone the repository and install dependencies

# Clone the repository
git clone https://github.com/Coral-Protocol/Prosus-Agentic-Voice-Restaurant-Webapp

# Install `uv`:
pip install uv

For Coral Interface Agent

# Navigate to the interface agent agent directory
cd Coral-InterfaceAgentForWebapp

# Install dependencies from `pyproject.toml` using `uv`:
uv sync

For Restaurant Agent

# Navigate to the monzo agent directory
cd Coral-RestaurantVoice-Agent

# Install dependencies from `pyproject.toml` using `uv`:
uv sync

2. Environment Configuration

For Coral Interface Agent

Get the API Key: Openai/Groq

Create a .env file in the Coral-InterfaceAgentForWebapp directory based on the .env_sample file:

cd Coral-InterfaceAgentForWebapp
cp -r .env_sample .env
# Edit .env with your specific configuration

For Restaurant Agent

Get the api key API_KEY=Openai/Groq.

Note: If you want to use cloud services by Livekit then use Livekit Cloud for these api keys and url but for Self hosting you can check out there documentation for Self Hosting.

LIVEKIT_API_KEY=your_livekit_api_key_here

LIVEKIT_API_SECRET=your_livekit_api_secret_here

LIVEKIT_URL=your_livekit_url_here

Create a .env file in the Coral-RestaurantVoice-Agent directory based on the .env.example file:

cd Coral-RestaurantVoice-Agent
cp -r env.example .env
# Edit .env with your specific configuration

UI Frontend

To use the UI do this setup in a separate terminal:

cd UI
npm install

Create a .env.local file in the UI directory:

# Create .env.local with these variables:

# LiveKit Configuration
LIVEKIT_API_KEY=your_livekit_api_key_here 
LIVEKIT_API_SECRET=your_livekit_api_secret_here  
LIVEKIT_URL=your_livekit_url_here  

# API Endpoint Configuration (for Interface Agent)
NEXT_PUBLIC_CONN_DETAILS_ENDPOINT=/api/connection-details

# Interface Agent API Endpoint (default: http://localhost:8000)
NEXT_PUBLIC_INTERFACE_AGENT_API_ENDPOINT=http://localhost:8000

3. Run Agents in Separate Terminals

Start all three components in their respective terminals:

Terminal 1: Start Coral Interface Agent

cd Coral-InterfaceAgentForWebapp
uv run main.py

Terminal 2: Start Restaurant Voice Agent

cd Coral-RestaurantVoice-Agent
uv run main.py dev

Terminal 3: Start UI Frontend

cd UI
npm run dev

How to Connect to UI:

Click to expand UI app running instructions

• Access the Application: Open your browser and navigate to the UI application (typically http://localhost:3000)

• Try Now Button: Click the "Try Now" button to be directed to the main page

• Start Conversation: On the main page, press the "Start Restaurant Conversation" button for the restaurant agent

• Interact: You can now chat with the agentic system for restaurant-related queries and interactions

How to use:

Click to expand sample input/output

Details

1. Input

Greet the restaurant agent by saying "Hi!".  
You can message the interface agent like this:  
Ask the restaurant agent to tell you the menu for the restaurant.  

You can also talk directly to the restaurant agent using voice, but only when it is not using the "wait for mentions" tool.

2. Output

The restaurant agent will greet you and listen to your queries.  

When using the interface agent, it will communicate with the restaurant agent through Coral tools. The restaurant agent will reply to the interface agent.

For speech-based interaction, you need to talk to the restaurant agent directly.

Option 3: Running in Dev Mode with Coral Studio

If you want to run the Agent using Coral-Studio UI you can do so but it may not support Voice input and outputs from the UI and only the messages sent using Coral tools will be visible.You clone it and run it according to the instructions in the readme and run these two agents in your terminal.

Interface Agent | Restaurant Voice Agent

Support

If you have any questions about anything you can join our discord here, and put something in the dev support channel, if you beleivie it to be a bug or a feate that you want you can add it as a github issue: Discord