Skip to content

Enhance embedding functionality with LiteLLM support#32

Merged
howethomas merged 5 commits intomainfrom
CON-43-litellm-embeddings
Apr 14, 2026
Merged

Enhance embedding functionality with LiteLLM support#32
howethomas merged 5 commits intomainfrom
CON-43-litellm-embeddings

Conversation

@pavanputhra
Copy link
Copy Markdown
Contributor

  • Updated environment variables in .env.example to include LiteLLM proxy settings.
  • Modified embed-vcons.ts to support LiteLLM as an embedding provider, updating the provider detection logic and embedding functions.
  • Adjusted test-semantic-search.ts to allow embedding generation via LiteLLM or OpenAI.
  • Updated Supabase functions to prioritize LiteLLM for embeddings, ensuring proper error handling and API integration.
  • Enhanced sync-to-s3 function to include LiteLLM in the provider priority logic.

pavanputhra and others added 5 commits February 25, 2026 17:49
- Updated environment variables in .env.example to include LiteLLM proxy settings.
- Modified embed-vcons.ts to support LiteLLM as an embedding provider, updating the provider detection logic and embedding functions.
- Adjusted test-semantic-search.ts to allow embedding generation via LiteLLM or OpenAI.
- Updated Supabase functions to prioritize LiteLLM for embeddings, ensuring proper error handling and API integration.
- Enhanced sync-to-s3 function to include LiteLLM in the provider priority logic.
- Introduced a new shared module for embedding functions, consolidating logic for LiteLLM, OpenAI, Azure OpenAI, and Hugging Face.
- Updated embed-vcons.ts to utilize the shared embedding functions, improving code maintainability and reducing duplication.
- Modified Supabase functions to call shared embedding utilities, ensuring consistent handling of API keys and options.
- Removed redundant embedding logic from Supabase functions, streamlining the codebase.
… search embedding generation

- Replace ConsoleSpanExporter/ConsoleMetricExporter with NullSpanExporter/
  NullMetricExporter to prevent OTEL trace data from polluting MCP stdio
- Gate DiagConsoleLogger behind OTEL_EXPORTER_TYPE=otlp check
- Fix pino-pretty destination: move to transport options so worker thread
  writes to stderr (fd 2) instead of stdout
- Fix ROUND(double precision, N) -> ROUND(expr::numeric, N) in
  getContentVolumeTrends to resolve pg error 42883
- Add generateEmbedding() to search handlers so search_vcons_semantic and
  search_vcons_hybrid auto-generate embeddings from query text via OpenAI

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
- Remove stale "not yet implemented" note from search.md (semantic search
  now generates embeddings automatically)
- Fix broken cross-references in search.md pointing to wrong directory
- Add historical warning banner to embeddings.md; update all SQL from
  ada-002/1536-dim to text-embedding-3-small/384-dim
- Fix CORRECTED_SCHEMA.md: version 0.3.0->0.4.0, mimetype->mediatype,
  appended->amended, must_support->critical throughout
- Update tools.md examples: vcon version 0.3.0->0.4.0, must_support->critical
- Add LiteLLM as priority-1 provider to INGEST_AND_EMBEDDINGS.md with
  env vars and --provider=litellm example; fix spec version reference
- Add LiteLLM env vars and provider priority order to installation.md

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
…h handlers, and schema docs

- Fix ObservabilityConfig interface and logger alias dropped during merge resolution
- Resolve conflict in CORRECTED_SCHEMA.md (column comment wording)
- Build verified clean after all conflict resolutions

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@howethomas howethomas merged commit 991a352 into main Apr 14, 2026
4 of 6 checks passed
@howethomas howethomas deleted the CON-43-litellm-embeddings branch April 14, 2026 17:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants