Skip to content

feat: add configurable search filters for remote Weaviate datasets#91

Merged
shubham3121 merged 4 commits into
mainfrom
feat/remote-weaviate-filters
Feb 25, 2026
Merged

feat: add configurable search filters for remote Weaviate datasets#91
shubham3121 merged 4 commits into
mainfrom
feat/remote-weaviate-filters

Conversation

@shubham3121

@shubham3121 shubham3121 commented Feb 24, 2026

Copy link
Copy Markdown
Member

This pull request introduces a new, flexible filter schema and logic for the Remote Weaviate dataset type, enabling advanced filtering capabilities in search queries. It also improves configuration schema generation for frontend forms, ensures filter validation, and includes minor code cleanups. The most important changes are grouped below:

Weaviate Remote Filtering Enhancements

  • Added a new module filters.py defining filter schemas (FilterCondition, FilterGroup) and logic for constructing Weaviate filter objects, supporting advanced, type-safe, and nested filter conditions. (backend/syft_space/components/dataset_types/weaviate_remote/filters.py)
  • Updated RemoteWeaviateConfiguration to accept a filters field, allowing users to specify filters in dataset configuration. (backend/syft_space/components/dataset_types/weaviate_remote/weaviate_type.py)
  • Integrated the new filter logic into the search flow: filters are validated, built into Weaviate filter objects, and passed to the query API. (backend/syft_space/components/dataset_types/weaviate_remote/weaviate_type.py) [1] [2] [3] [4]

Configuration Schema Generation Improvements

  • Modified ConfigSchemaGenerator to preserve $defs in generated schemas, ensuring $ref pointers remain valid for frontend dynamic form rendering, rather than inlining all references. (backend/syft_space/components/shared/utils.py) [1] [2]

Minor Code Cleanups

  • Simplified import statements in marketplaces/handlers.py and chromadb_type.py for clarity and consistency. (backend/syft_space/components/marketplaces/handlers.py [1] backend/syft_space/components/dataset_types/chromadb_local/chromadb_type.py [2]
  • Minor formatting and readability improvements in frontend code for update messages and dataset browser logic. (frontend/src/pages/UpdatesPage.vue [1] [2]; frontend/src/composables/useDatasetBrowser.ts [3]

@shubham3121 shubham3121 force-pushed the feat/remote-weaviate-filters branch from 9759b4f to b6687df Compare February 25, 2026 12:00
@shubham3121 shubham3121 merged commit 1f99f0d into main Feb 25, 2026
2 checks passed
@shubham3121 shubham3121 deleted the feat/remote-weaviate-filters branch February 25, 2026 12:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant