[Social Engine] Implement Voice-Based Interaction using ElevenLabs for Explanations

[dineshpinto]

• Description:
  Enhance the Social Engine's interaction capabilities by adding a voice interface. This interface will leverage an integration with ElevenLabs (or a similar high-quality text-to-speech service) to enable the AI agent to verbally explain blockchain concepts, Flare-specific operations, or summarize social insights.
• Acceptance Criteria:
  • Integration with the ElevenLabs API (or chosen TTS provider) for dynamic text-to-speech generation is successfully implemented.
  • The AI agent can receive textual input (e.g., a question or a summary to vocalize) and generate a clear, natural-sounding voice response.
  • The voice interface can be used to explain pre-defined Flare concepts, summarize recent social sentiment, or answer queries about Flare operations.
  • (Note: Speech-to-text for voice commands is not explicitly in this scope but would be a prerequisite for full voice-based conversation).
• Key Files/Modules Involved (Tentative):
  • flare_ai_kit/social/eleven_labs.py (New file to be created)
  • flare_ai_kit/social/settings_models.py
• Tasks / Implementation Steps:
  • Create flare_ai_kit/social/eleven_labs.py defining connections to the Eleven Labs API (if needed this can also be added as a dependency under the social optional-dependency category in pyproject.toml)
  • Any API Keys should be specified in in flare_ai_kit/social/settings_models.py

[sambitsargam]

Hi there! I’d love to tackle this voice-interaction feature. Here’s my concise plan:

Approach

1. Add Pydantic settings (FLARE_ELEVENLABS_API_KEY, voice ID) in settings_models.py.
2. Build a lightweight ElevenLabs client in flare_ai_kit/social/eleven_labs.py to synthesize text to speech (raw bytes or file).
3. Integrate the client into the Social Engine to generate verbal explanations on demand.
4. Add unit tests (mocking HTTP) and update documentation with setup and usage examples.

Why Me?

• 1+ years of Python API and TTS integrations (Google, AWS Polly, ElevenLabs)
• Strong Pydantic and requests expertise
• Passionate about making blockchain concepts accessible via voice

I’m confident I can deliver a clean, tested solution. Thanks for considering me!