AgriAgent - Multimodal AI Agricultural Advisor

A comprehensive AI-powered agricultural advisory system that provides farmers with expert guidance through chat, image analysis, and voice queries in multiple Indian languages.

🌾 Features

• Multilingual Chat: Ask farming questions in Hindi, Bengali, Tamil, Telugu, Marathi, Gujarati, Punjabi, and English
• Image Analysis: Upload crop images for disease detection and treatment recommendations
• Voice Queries: Record voice messages in any supported language for hands-free interaction
• Weather Integration: Real-time weather data for location-specific advice
• Market Insights: Current market prices and trends
• AI-Powered Responses: Advanced machine learning models for accurate recommendations
• Text-to-Speech: Audio responses in the user's preferred language
• Price Prediction : Predict future crop prices using trained ML models.

🚀 Quick Start with Docker

Prerequisites

• Docker and Docker Compose installed
• OpenAI API key (optional but recommended)
• Weather API key (OpenWeatherMap)

1. Clone the Repository

git clone https://github.com/opbot-xd/AgriAgent.git
cd agriagent

2. Create Environment File

Create a .env file in the root directory:

# Database
DATABASE_URL=sqlite+aiosqlite:///./agriagent.db

# Security
SECRET_KEY=your_super_secret_key

# Token
ALGORITHM=HS256
ACCESS_TOKEN_EXPIRE_MINUTES=60

# Google Gemini/Generative AI
GOOGLE_API_KEY=your_google_api_key
GEMINI_API_KEY=your_gemini_api_key

# Dhenu AI
DHENU_API_KEY=your_dhenu_api_key

# Weather API
WEATHER_API_KEY=your_weather_api_key

# CORS
FRONTEND_URL=http://localhost:3000

#huggingface
HF_TOKEN=your_huggingface_token
HF_API_URL=https://api-inference.huggingface.co/models/linkanjarad/mobilenet_v2_10_224-plant-disease-identification

# OpenAI
OPENAI_API_KEY=your_openai_api_key

3. Start the Application

# Build and start all services
docker-compose up --build

# Or run in detached mode
docker-compose up -d --build

4. Access the Application

• Frontend: http://localhost:3000
• Backend API: http://localhost:8000
• API Documentation: http://localhost:8000/docs

🛠️ Manual Setup (Development)

Backend Setup

1. Create Virtual Environment

cd backend
python -m venv venv
source venv/bin/activate  # On Windows: venv\Scripts\activate

2. Install Dependencies

pip install -r requirements.txt

5. Create a .env file

# Database
DATABASE_URL=sqlite+aiosqlite:///./agriagent.db

# Security
SECRET_KEY=your_super_secret_key

# Token
ALGORITHM=HS256
ACCESS_TOKEN_EXPIRE_MINUTES=60

# Google Gemini/Generative AI
GOOGLE_API_KEY=your_google_api_key
GEMINI_API_KEY=your_gemini_api_key

# Dhenu AI
DHENU_API_KEY=your_dhenu_api_key

# Weather API
WEATHER_API_KEY=your_weather_api_key

# CORS
FRONTEND_URL=http://localhost:3000

#huggingface
HF_TOKEN=your_huggingface_token
HF_API_URL=https://api-inference.huggingface.co/models/linkanjarad/mobilenet_v2_1.0_224-plant-disease-identification

# OpenAI
OPENAI_API_KEY=your_openai_api_key

6. Start Backend Server

uvicorn main:app --reload --host 0.0.0.0 --port 8000

Frontend Setup

1. Install Node.js Dependencies

cd frontend
npm install

2. Configure Environment

Create .env in frontend directory:

REACT_APP_API_URL=http://localhost:8000

4. Start Frontend Server

npm start

📁 Project Structure

AgriAgent/
├── backend/ # FastAPI backend
│ ├── dataset/ # Training / data files
│ ├── models/ # AI/ML models
│ ├── routes/ # API route definitions
│ ├── schemas/ # Pydantic schemas
│ ├── services/ # Business logic and services
│ ├── utils/ # Utility/helper functions
│ ├── venv/ # Python virtual environment (local only, not in Docker)
│ ├── agriagent.db # SQLite database (dev)
│ ├── database.py # Database connection setup
│ ├── Dockerfile # Backend Docker configuration
│ ├── main.py # FastAPI entry point
│ ├── requirements.txt # Python dependencies
│ ├── schema.sql # Database schema (optional if using migrations)
│ ├── .env # Environment variables (local)
│ ├── .env.sample # Example environment file
│ └── README.md # Backend documentation
│
├── frontend/ # Next.js frontend
│ ├── app/ # App router (Next.js 13+)
│ ├── components/ # UI components
│ ├── lib/ # Utility libraries
│ ├── public/ # Static assets
│ ├── .next/ # Next.js build output (ignored in git)
│ ├── Dockerfile # Frontend Docker configuration
│ ├── package.json # Node.js dependencies
│ ├── package-lock.json # Lockfile
│ ├── tsconfig.json # TypeScript configuration
│ ├── next.config.ts # Next.js config
│ ├── eslint.config.mjs # ESLint config
│ ├── postcss.config.mjs # PostCSS config
│ ├── tailwind.config.js # Tailwind CSS configuration
│ ├── components.json # ShadCN components registry
│ ├── .env # Frontend environment variables
│ ├── .env.sample # Example environment file
│ └── README.md # Frontend documentation
│
├── docker-compose.yml # Docker services configuration
├── README.md # Main project documentation
└── .gitignore # Git ignore file

🔧 Configuration – API Keys

AgriAgent requires several API keys for different features.
All keys should be added in the .env file located in the backend/ directory.

1. Database

• DATABASE_URL
  Default: sqlite+aiosqlite:///./agriagent.db
  You can change this to PostgreSQL, MySQL, etc. if required.

---

2. Security

• SECRET_KEY – Any random secure string for JWT tokens.
• ALGORITHM – Default: HS256
• ACCESS_TOKEN_EXPIRE_MINUTES – Token validity in minutes (default: 60).

---

3. Google Gemini / Generative AI

• GOOGLE_API_KEY

  • Sign up at Google AI Studio
  • Generate an API key
  • Add it here.

• GEMINI_API_KEY

  • Alternative Gemini key (if using a different project setup).

---

4. Dhenu AI

• DHENU_API_KEY
  • Required if using Dhenu AI services.

---

5. Weather API

• WEATHER_API_KEY
  • Sign up at OpenWeather
  • Generate a free API key
  • Add it here.

---

6. CORS

• FRONTEND_URL
  • The URL of your frontend app.
  • Example: http://localhost:3000

---

7. Hugging Face

• HF_TOKEN

  • Get token from Hugging Face
  • Required for model access.

• HF_API_URL

  • Default:

    https://api-inference.huggingface.co/models/linkanjarad/mobilenet_v2_1.0_224-plant-disease-identification
    

  • Used for plant disease detection.

---

8. OpenAI

• OPENAI_API_KEY
  • Sign up at OpenAI
  • Generate API key
  • Add it here.

---

🌐 API Endpoints

Authentication

• POST /auth/signup - Register new user
• POST /auth/login - User login

Core Features

• POST /chat - Text chat queries and also voice queries
• POST /upload - Image analysis
• POST /forecast - predict future rates of your crop

API Documentation

Visit http://localhost:8000/docs for interactive API documentation.

🌍 Supported Languages

• English (en)
• Hindi (hi)
• Bengali (bn)
• Tamil (ta)
• Telugu (te)
• Marathi (mr)
• Gujarati (gu)
• Punjabi (pa)

🔒 Security Features

• JWT-based authentication
• Password hashing with bcrypt
• HTTPS support (configure in production)
• Input validation and sanitization
• Rate limiting (Redis-based)

🐛 Troubleshooting

Common Issues

1. Database Connection Error

   • Ensure PostgreSQL is running
   • Check DATABASE_URL configuration
   • Verify user permissions

2. Redis Connection Error

   • Ensure Redis server is running
   • Check REDIS_URL configuration

3. AI Model Loading Issues

   • Ensure sufficient disk space (models can be large)
   • Check internet connection for model downloads
   • Verify write permissions in models directory

4. Audio Processing Issues

   • Install ffmpeg: sudo apt-get install ffmpeg
   • Check microphone permissions in browser

🤝 Contributing

1. Fork the repository
2. Create feature branch (git checkout -b feature/amazing-feature)
3. Commit changes (git commit -m 'Add amazing feature')
4. Push to branch (git push origin feature/amazing-feature)
5. Open Pull Request

📝 License

This project is licensed under the MIT License - see the LICENSE file for details.

🆘 Support

For support and questions:

• Create an issue on GitHub
• Check documentation at /docs endpoint
• Review troubleshooting section above

🎯 Roadmap

Phase 1 (Current)

• ✅ Multilingual chat support (Hindi, Bengali, Tamil, Telugu, Marathi, Gujarati, Punjabi, English)
• ✅ Crop image upload and disease detection (Hugging Face model)
• ✅ Voice query support with text-to-speech responses
• ✅ Weather integration and market insights
• ✅ AI-powered price prediction

Phase 2 (Planned)

• SMS/WhatsApp/IVR integration for wider accessibility
• Farmer community features for peer-to-peer learning and sharing
• Mobile application (Flutter) for better farmer experience
• Improved ML models for accurate disease diagnosis and recommendations

Phase 3 (Future)

• Offline/low-connectivity mode for remote villages
• Partnerships with NGOs, AgriTech companies, and government bodies
• Advanced analytics dashboard for farmers
• Continuous AI learning from farmer queries and images

🙏 Acknowledgments

• OpenAI and Google Gemini for providing powerful AI language models.
• Hugging Face for open-source transformer models and APIs.
• Weather APIs (for real-time weather and climate data integration).
• Dhenu – for agri advices
• The agricultural research community for datasets, insights, and continued innovation.
• Open-source contributors whose projects, tools, and libraries made this work possible.

---

AgriAgent