Add Octotools integration with the CUA Sample App

[jmanhype]

🛠️ Integrate Octotools Framework with CUA Sample App

📋 Overview

This PR adds integration with the Octotools framework to enhance the reasoning and problem-solving capabilities of the CUA Sample App. Octotools provides a collection of specialized tools that can be leveraged by the agent to perform complex tasks, analyze web content, generate code, and more.

🔧 Changes

• Octotools Integration: Added core integration with the Octotools framework
• Multiple Wrapper Options: Included simple, minimal, and complete wrapper implementations
• Agent Enhancement: Enhanced the Agent class to optionally use Octotools for complex reasoning
• CLI Support: Added command-line arguments to enable Octotools integration
• New Tools Support: Added support for various Octotools tools including:
  • Text Detection
  • URL Text Extraction
  • Python Code Generation
  • Generalist Solution Generation
  • Nature News Fetching
• Documentation: Added comprehensive integration documentation in docs/octotools_integration_guide.md

📚 Usage

To run the CUA Sample App with Octotools integration:

python main.py --use-octotools

For more advanced usage with specific tools:

python run_octotools_agent.py --tools "Python_Code_Generator_Tool,Text_Detector_Tool,URL_Text_Extractor_Tool"

🧪 Testing

Tests have been added to verify the Octotools integration:

• test_octotools.py: Basic integration tests
• test_simple_octotools.py: Tests for the simple wrapper
• test_full_octotools.py: Tests for the complete wrapper

🔍 Future Work

• Add more specialized tools from the Octotools ecosystem
• Improve the tool selection logic based on query analysis
• Add integration with more LLM providers

📝 Note

This integration requires additional API keys for certain tools, which are documented in the integration guide.

[ibigio]

tl;dr please adhere to new computer structure and contributing process

Hi! Thanks for your contribution – we'd love to get it reviewed and merged. To better support custom CUA computers we've created a contrib directory to co-locate community contributions and automatically run basic smoke tests.

Please make sure you complete the three main steps:

1. Move computers/contrib and update configs
2. Pass tests & do manual testing
3. Submit PR with required information

These are explained in detail in the contributing section of the README.

Thanks again!