Vision: The most flexible, powerful, and developer-friendly agentic SDK in the ecosystem
This document outlines Allos's development roadmap from MVP through advanced capabilities. We're building in the open and welcome community input on priorities.
| Phase | Focus | Timeline | Status |
|---|---|---|---|
| Phase 1: MVP | Core functionality | Weeks 1-8 | ✅ 96.79% Complete |
| Phase 2: Enhanced Features | Essential capabilities | Weeks 9-14 | 📋 Planned |
| Phase 3: Advanced Tooling | Developer experience | Weeks 15-20 | 📋 Planned |
| Phase 4: Enterprise & Scale | Production features | Weeks 21-28 | 🔮 Future |
| Phase 5: Ecosystem Integration | Framework compatibility | Weeks 29-36 | 🔮 Future |
| Phase 6: Innovation | Cutting-edge features | Ongoing | 🔮 Future |
Timeline: Weeks 1-8 Status: 96.79% Complete (7/8 phases done, only demo video remaining) Goal: Ship working provider-agnostic agentic SDK
See MVP_ROADMAP.md for detailed breakdown.
- ✅ Core architecture
- ✅ OpenAI & Anthropic providers
- ✅ Essential tools (file, shell)
- ✅ Basic agentic loop
- ✅ CLI interface
- ✅ Session management
- ✅ Comprehensive Testing
- ✅ Documentation
- ✅ Security audit (path traversal, shell injection, API keys)
- ✅ Basic context window management (proactive checks)
- ✅ Token usage tracking (via provider metadata)
- ✅ Error recovery (implicit via LLM intelligence)
- ✅ Known limitations documented
- ⏳ Launch: Awaiting demo video (96.79% complete)
Completion Target: End of Week 8 Current Status: 96.79% complete - All technical work done, demo video in progress Expected Launch: Upon demo video completion
For a comprehensive list of intentionally excluded features, see the Known Limitations section in README.md.
These limitations are by design and are addressed in subsequent phases of this roadmap.
Timeline: Weeks 9-14 (6 weeks) Status: 📋 Planned Goal: Add essential capabilities for production use
Motivation: Enable completely local, private AI agents
-
allos/providers/ollama.py- Connect to local Ollama server
- Support all Ollama models (Llama, Mistral, Qwen, etc.)
- Handle model pulling/downloading
- Streaming support
- Context window detection per model
- Tool calling emulation for models without native support
- Documentation for local setup
- Examples with popular local models
Impact: Run agents completely offline, no API costs
# Install Ollama
curl -fsSL https://ollama.ai/install.sh | sh
# Pull a model
ollama pull qwen2.5-coder:7b
# Use with Allos
allos --provider ollama --model qwen2.5-coder:7b "Create a FastAPI app"-
allos/providers/google.py- Google Gemini Pro support
- Google Gemini Ultra support (when available)
- Vertex AI integration
- Native tool calling
- Token counting
- Cohere (initial support)
- Azure OpenAI (endpoint configuration)
- Together AI (OpenAI-compatible)
- Anyscale (OpenAI-compatible)
Impact: Support for 7+ providers, maximum flexibility
Motivation: Enable agents to search and fetch web content
-
allos/tools/web/search.py- Integration with search APIs (DuckDuckGo, Brave, Google)
- Result parsing and summarization
- Safe search filtering
- Configurable result limits
-
allos/tools/web/fetch.py- HTTP/HTTPS fetching
- HTML parsing and extraction
- Markdown conversion
- PDF text extraction
- Image description (future)
- Rate limiting
- Respect robots.txt
Impact: Agents can research and gather information from the web
agent = Agent(AgentConfig(
provider="anthropic",
model="claude-sonnet-4-5",
tools=["web_search", "web_fetch", "write_file"]
))
agent.run("Research current AI trends and write a summary")Note
The MVP includes basic context window checking with proactive ContextWindowExceededError.
This phase focuses on advanced optimization techniques beyond basic prevention.
Motivation: Handle large codebases, long conversations and reduce token costs
-
allos/context/compactor.py(enhance)- Smart truncation (keep important messages)
- Summarization of old messages
- Tool result compression
- Importance scoring
- Context window optimization per provider
-
allos/context/analyzer.py- Analyze conversation flow
- Identify key information
- Suggest context optimization
- Token usage analytics
Impact: Handle 10x larger conversations efficiently
Motivation: Make Allos easily configurable for teams
-
.allos/config.yamlsupport- Default provider and model
- Tool configurations
- Permission presets
- Custom system prompts
- API endpoints
-
.allos/config.jsonalternative format - Environment-specific configs (dev, prod)
- Config validation with Pydantic
- Config inheritance (project → user → system)
# .allos/config.yaml
default:
provider: anthropic
model: claude-sonnet-4-5
temperature: 0.7
tools:
enabled:
- read_file
- write_file
- shell_exec
permissions:
shell_exec: ask
write_file: ask
read_file: always_allow
system_prompt: |
You are an expert Python developer.
Focus on writing clean, tested code.
providers:
anthropic:
api_key: ${ANTHROPIC_API_KEY}
openai:
api_key: ${OPENAI_API_KEY}
base_url: nullImpact: Teams can share configurations, consistent behavior
Motivation: Enable community extensions
-
allos/plugins/base.pyBasePlugininterface- Plugin lifecycle hooks
- Plugin metadata
-
allos/plugins/loader.py- Auto-discover plugins
- Load from directories
- Dependency management
-
allos/plugins/manager.py- Enable/disable plugins
- Plugin configuration
- Plugin isolation
- Tool Plugins: Add new tools
- Provider Plugins: Add new providers
- Hook Plugins: Intercept events
- Command Plugins: Add CLI commands
Impact: Community can extend Allos without forking
# Example plugin structure
my-allos-plugin/
├── setup.py
└── my_plugin/
├── __init__.py
└── tools.py
# Install and use
pip install my-allos-plugin
allos --plugins my_plugin "Use my custom tool"Timeline: Weeks 15-20 (6 weeks) Status: 📋 Planned Goal: Best-in-class developer experience and advanced features
Motivation: React to agent events and customize behavior
-
allos/hooks/manager.py- Hook registration
- Event dispatching
- Async hook support
-
before_tool_call- Modify tool arguments -
after_tool_call- Process tool results -
before_llm_call- Modify prompts -
after_llm_call- Process responses -
on_error- Custom error handling -
on_token_limit- Context window warnings
# .allos/config.yaml
hooks:
before_tool_call:
- log_to_database
- check_permissions
after_tool_call:
- send_notificationImpact: Deep customization without modifying core code
Motivation: Complex tasks need specialized agents
-
allos/agent/subagent.py- Create specialized agents
- Delegate tasks to subagents
- Aggregate results
- Subagent communication protocol
-
allos/templates/(expand)- Code review agent
- Security audit agent
- Documentation writer agent
- Test generator agent
- Refactoring agent
-
allos/tools/delegation/delegate.pyDelegateToSubagentTool- Automatic subagent selection
- Task routing
Impact: Handle complex, multi-step workflows
# Main agent delegates to specialists
agent = Agent(AgentConfig(
provider="anthropic",
model="claude-opus-4",
tools=["delegate", "read_file", "write_file"]
))
agent.run("""
1. Review the codebase for security issues (delegate to security agent)
2. Generate tests for critical functions (delegate to test agent)
3. Write a summary report
""")Motivation: Reusable expertise for agents
-
.allos/skills/directory support -
SKILL.mdformat (inspired by Claude Code)- Skill description
- Required tools
- Best practices
- Example usage
- Skill loader and injector
- Skill marketplace (future)
- Python Development skill
- API Design skill
- Database Operations skill
- DevOps skill
Impact: Agents learn domain-specific expertise
# .allos/skills/python-expert/SKILL.md
# Python Expert Skill
## Description
Expert Python developer with focus on best practices, testing, and performance.
## Guidelines
- Always write type hints
- Include docstrings
- Write unit tests
- Use modern Python features (3.9+)
- Follow PEP 8
## Tools Required
- read_file
- write_file
- shell_exec (for running tests)Motivation: Agents should remember context across sessions
-
CLAUDE.md/ALLOS.mdsupport- Project-level instructions
- Codebase context
- Convention guidelines
- Persistent across sessions
-
.allos/memory/directory- Store learnings
- Cache frequent operations
- Remember user preferences
-
~/.allos/profile.md- User preferences
- Common patterns
- Global instructions
Impact: Agents understand your projects better over time
# ALLOS.md (in project root)
# Project: MyAPI
## Overview
FastAPI-based REST API for user management.
## Conventions
- Use SQLAlchemy for database
- All endpoints require authentication
- Tests in tests/ directory
- Follow REST principles
## Architecture
- `app/`: Main application code
- `models/`: Database models
- `routes/`: API routes
- `services/`: Business logicMotivation: Quick actions without full prompts
-
.allos/commands/directory support - Built-in commands:
/review- Code review current file/test- Generate tests/fix- Fix linting issues/explain- Explain code/refactor- Refactor code/docs- Generate documentation
- Custom command creation
- Command aliases
Impact: Faster common operations
# Interactive mode
allos --interactive
You: /review main.py
Agent: [Reviews main.py and provides feedback]
You: /test --file utils.py
Agent: [Generates unit tests for utils.py]
You: /fix
Agent: [Fixes linting issues in current directory]Motivation: Better UX for long-running tasks
- Streaming responses from LLMs
- Real-time output
- Progressive rendering
- Cancel mid-stream
- Progress indicators
- Tool execution progress
- Token generation progress
-
allos/agent/streaming.py- Async agent implementation
- Stream tool results
-
async def run_async()- Async agent execution
- Concurrent tool execution
- Parallel subagents
Impact: Better user experience, faster execution
import asyncio
from allos import AsyncAgent, AgentConfig
async def main():
agent = AsyncAgent(AgentConfig(...))
# Stream response
async for chunk in agent.run_stream("Create a web app"):
print(chunk, end='', flush=True)
# Or parallel execution
results = await asyncio.gather(
agent.run("Task 1"),
agent.run("Task 2"),
agent.run("Task 3")
)
asyncio.run(main())Timeline: Weeks 21-28 (8 weeks) Status: 🔮 Future Goal: Production-ready for enterprise deployments
Motivation: Interoperability with other tools and data sources
-
allos/tools/mcp/client.py- Connect to MCP servers
- Discover available tools
- Call MCP tools
- Handle MCP responses
-
allos/tools/mcp/server.py- Expose Allos tools as MCP server
- MCP protocol implementation
- Authentication
- Filesystem MCP (local files)
- GitHub MCP (repositories, issues, PRs)
- Slack MCP (messages, channels)
- Google Drive MCP (documents, sheets)
- Jira MCP (issues, projects)
- Database MCP (SQL queries)
- Figma MCP (designs)
Impact: Access to enterprise data sources
agent = Agent(AgentConfig(
provider="anthropic",
model="claude-sonnet-4-5",
tools=["read_file", "write_file"],
mcp_servers=[
"github://my-org/my-repo",
"slack://my-workspace",
"drive://my-drive"
]
))
agent.run("Check GitHub issues, update the roadmap in Drive, and notify team on Slack")Motivation: Production visibility and debugging
-
allos/monitoring/tracer.py- OpenTelemetry integration
- Distributed tracing
- Span creation for operations
-
allos/monitoring/metrics.py- Prometheus metrics
- Token usage tracking
- Cost tracking
- Latency metrics
- Success/failure rates
-
allos/monitoring/logger.py(enhance)- Structured logging
- JSON log format
- Log levels per component
- Log sampling
- Datadog integration
- Grafana dashboards
- Sentry error tracking
- LangSmith traces
Impact: Debug production issues, optimize costs
from allos.monitoring import setup_monitoring
setup_monitoring(
provider="datadog",
api_key=os.getenv("DD_API_KEY"),
tags=["env:production", "team:ai"]
)
agent = Agent(...) # Automatically tracedMotivation: Safe deployments in production
- Rate limiting
- Per-provider rate limits
- Token budget enforcement
- Cost limits
- Retry logic
- Exponential backoff
- Circuit breakers
- Fallback providers
- Validation
- Input sanitization
- Output validation
- Tool result verification
- Audit logging
- All actions logged
- Compliance ready
- Tamper-proof logs
Note
The MVP includes implicit error recovery where tool errors are fed back into the agent's context, allowing the LLM to self-correct. Advanced features below add explicit retry strategies and self-healing capabilities.
Impact: Safe to run in production
Motivation: Support multiple users/teams safely
- User contexts
- Per-user configurations
- Per-user permissions
- Per-user budgets
- Team workspaces
- Shared configurations
- Team-level permissions
- Resource quotas
- Sandboxing
- Container-based execution
- Resource limits (CPU, memory)
- Network isolation
Impact: SaaS-ready architecture
Motivation: Easy cloud deployments
- Docker support
- Official Docker images
- Docker Compose examples
- Kubernetes manifests
- AWS deployment
- CloudFormation templates
- Lambda functions
- ECS/Fargate support
- GCP deployment
- Cloud Run support
- Terraform modules
- Azure deployment
- Container Instances
- ARM templates
Impact: Deploy anywhere
# Deploy to Cloud Run
allos deploy --provider gcp --service cloud-run --name my-agent
# Deploy to AWS Lambda
allos deploy --provider aws --service lambda --name my-agent
# Deploy to Kubernetes
kubectl apply -f allos-deployment.yamlMotivation: Reduce costs and latency
-
allos/context/cache.py(enhance)- Prompt caching (provider-specific)
- Response caching
- Tool result caching
- Cache invalidation strategies
- Cache backends
- Memory cache (default)
- Redis cache
- Database cache
- Parallel tool execution
- Request batching
- Token optimization
- Lazy loading
Impact: 50% cost reduction, 3x faster
Timeline: Weeks 29-36 (8 weeks) Status: 🔮 Future Goal: Interoperability with existing frameworks
Motivation: Leverage Pydantic AI's structured outputs
-
allos/integrations/pydantic_ai.py- Use Pydantic AI models with Allos
- Structured output validation
- Type-safe tool arguments
- Validation error handling
- Automatic schema generation
- Validation of agent responses
- Type hints for tools
- Structured logging
Impact: Type-safe, validated agent outputs
from pydantic import BaseModel
from allos.integrations.pydantic_ai import PydanticAgent
class CodeReview(BaseModel):
issues: list[str]
suggestions: list[str]
security_score: int
agent = PydanticAgent(
config=AgentConfig(...),
response_model=CodeReview
)
result: CodeReview = agent.run("Review this code")
print(f"Found {len(result.issues)} issues")Motivation: Interop with HuggingFace's agent framework
-
allos/integrations/smolagents.py- Allos agents as Smolagents
- Smolagent tools in Allos
- Protocol translation
- Import Smolagents tools
- Export Allos tools to Smolagents
- Shared tool registry
- Agent composition
Impact: Access to HuggingFace ecosystem
from smolagents import load_tool
from allos import Agent, AgentConfig
# Use HuggingFace tools in Allos
hf_tool = load_tool("image-generator")
agent = Agent(AgentConfig(
provider="anthropic",
model="claude-sonnet-4-5",
tools=["read_file", hf_tool]
))Motivation: Use LangChain tools and chains
-
allos/integrations/langchain.py- LangChain tools → Allos tools
- LangChain chains → Allos workflows
- LangChain memory → Allos context
Impact: Access to 1000+ LangChain tools
Motivation: Autonomous agent capabilities
-
allos/integrations/autogpt.py- AutoGPT plugins in Allos
- Autonomous mode
- Goal-driven planning
Impact: Long-running autonomous agents
Motivation: Native IDE experience
-
allos-vscode/package- Sidebar chat interface
- Inline code suggestions
- File watching and sync
- Quick actions
- Provider selection UI
- JetBrains plugin
- Neovim plugin
- Emacs package
Impact: Seamless development workflow
Timeline: Ongoing Status: 🔮 Future Goal: Cutting-edge capabilities
Motivation: Handle images, audio, video
- Image understanding
- Screenshot analysis
- Diagram generation
- OCR capabilities
- UI/UX analysis
- Voice commands
- Audio transcription
- Text-to-speech output
Impact: Richer interactions
agent = Agent(AgentConfig(
provider="openai",
model="gpt-4-vision",
tools=["read_file", "analyze_image"]
))
agent.run("Analyze this UI screenshot and suggest improvements",
image="screenshot.png")Motivation: Accelerate common patterns
- Project scaffolding
- Component generators
- Boilerplate reduction
- Framework-specific templates
- FastAPI REST API
- React component
- Django app
- Next.js page
- Python package
- Docker setup
Impact: 10x faster project setup
allos generate --template fastapi-crud --name UserService
# Creates complete FastAPI CRUD serviceMotivation: Share and discover agents
- Public agent registry
- Agent publishing
- Agent discovery
- Ratings and reviews
- Usage statistics
- One-click deployment
Impact: Community-driven agent ecosystem
Motivation: Customize models for specific tasks
- Data collection from sessions
- Training data generation
- Fine-tuning API integration
- Model evaluation
- A/B testing
Impact: Domain-specific performance
Motivation: Better task decomposition
- Hierarchical planning
- Graph-based planning
- Constraint satisfaction
- Resource optimization
- Plan visualization
Impact: Smarter task execution
Motivation: Measure agent performance
- Benchmark suite
- Task success metrics
- Cost efficiency tracking
- Quality scoring
- Comparison reports
Impact: Data-driven improvements
We prioritize features based on:
- User Impact: How many users benefit?
- Differentiation: What makes Allos unique?
- Effort: Implementation complexity
- Dependencies: What's needed first?
- Community Demand: What are users asking for?
- ✅ Local models (Ollama)
- ✅ Web tools (search, fetch)
- ✅ MCP support
- ✅ Configuration system
- ✅ Plugin system
- ✅ Subagents
- Pydantic AI integration
- Advanced monitoring
- Multi-modal support
- IDE integrations
- Production safeguards
- Cloud deployment
- Smolagents compatibility
- Fine-tuning support
- Agent marketplace
- Advanced planning
- Evaluation framework
- Providers: 7+ supported
- Tools: 10+ available
- Performance: Context handling 10x larger
- Adoption: 1K+ downloads
- Plugins: 20+ community plugins
- Skills: 50+ skills available
- Complexity: Handle multi-step workflows
- Adoption: 5K+ downloads
- Production: 10+ production deployments
- Scale: Handle 1M+ requests/month
- Reliability: 99.9% uptime
- Adoption: 10K+ downloads
- Integrations: 5+ framework integrations
- Compatibility: Works with existing tools
- Ecosystem: 100+ community tools
- Adoption: 50K+ downloads
- Capabilities: Industry-leading features
- Recognition: Conference talks, articles
- Community: 500+ contributors
- Adoption: 100K+ downloads
We're building Allos in the open! Here's how you can help:
- 🐛 Bug reports: Find and report issues
- 📖 Documentation: Improve guides and examples
- 🧪 Testing: Test with different providers and scenarios
- 💡 Ideas: Suggest features and improvements
- 🔧 Providers: Add new LLM providers
- 🛠️ Tools: Create and share tools
- 🎨 Templates: Build agent templates
- 🔌 Plugins: Develop plugins
- 📝 Content: Write tutorials and guides
- Check Issues for open tasks
- Read CONTRIBUTING.md for guidelines
- Join Discussions
- Submit PRs with your improvements
This roadmap is a living document. We update it:
- Monthly: Based on progress and feedback
- Quarterly: Based on community priorities
- After major releases: Based on learnings
- 👍 Upvote features in Discussions
- 💬 Comment on roadmap issues
- 📊 Participate in surveys
- 🗳️ Vote on feature polls
- v0.x: MVP and stabilization (current)
- v1.0: Production-ready with core features
- v2.0: Advanced features and enterprise support
- v3.0: Ecosystem integrations
- vX.X: Innovation features
- Minor versions (0.x): Every 2-3 weeks
- Patch versions (0.0.x): As needed for bugs
- Major versions (x.0): Every 6-12 months
We're inspired by and learning from:
- Anthropic Claude Code: User experience, tool quality
- LangChain: Ecosystem, integrations
- AutoGPT: Autonomous agents, planning
- Cursor/GitHub Copilot: IDE integration
- Vercel AI SDK: Developer experience
- HuggingFace: Community, marketplace
Vision: Allos becomes the standard for building AI agents
-
Universal Compatibility
- Works with any LLM provider (proprietary or open source)
- Supports any framework (Pydantic AI, LangChain, Smolagents)
- Runs anywhere (local, cloud, edge)
-
Best-in-Class DX
- 5-minute setup to first agent
- Rich IDE integrations
- Excellent documentation
- Thriving community
-
Production Ready
- Enterprise-grade reliability
- Comprehensive monitoring
- Battle-tested security
- Cost-efficient
-
Innovation Leader
- Latest AI capabilities
- Cutting-edge features
- Research collaborations
- Open source ethos
- ✅ 100K+ monthly active users
- ✅ 1000+ contributors
- ✅ 10K+ stars on GitHub
- ✅ 100+ production deployments
- ✅ Featured in major AI conferences
- ✅ Industry standard for agentic frameworks
We want to hear from you!
- What features excite you?
- What's missing from this roadmap?
- What should we prioritize?
- What problems can we solve for you?
Share your thoughts:
- GitHub Discussions
- Discord Community (coming soon)
- Twitter @allos_sdk (coming soon)
- v1.0 (Current) - Initial comprehensive roadmap
- Future updates will be tracked here and complete changelog is at CHANGELOG
Building the future of AI agents, together 🚀
Back to README • MVP Roadmap • Contributing
Last Updated: November 07, 2025
Next Review: November 30, 2025