File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -282,15 +282,15 @@ search_engines:
282282 - name : elastic
283283 from : elasticsearch
284284 kind :
285- - vector
286285 - text
286+ - vector
287287 params :
288- endpoint : http://localhost:9200
289- user : elastic
290- pass : spiceai
288+ elasticsearch_endpoint : http://localhost:9200
289+ elasticsearch_user : elastic
290+ elasticsearch_pass : spiceai
291291` ` `
292292
293- Datasets reference it by name in ` columns[]. vectors.engine` and `columns[].full_text_search.engine`:
293+ Datasets reference the engine by name in the top-level ` vectors:` block and in `columns[].full_text_search.engine`:
294294
295295` ` ` yaml
296296datasets:
@@ -301,18 +301,40 @@ datasets:
301301 acceleration:
302302 enabled: true
303303 engine: arrow
304+
305+ vectors:
306+ enabled: true
307+ engine: elastic
308+ params:
309+ elasticsearch_index: vector_index
310+ elasticsearch_vector_field: content_embedding
311+
304312 columns:
305313 - name: content
306314 embeddings:
307315 - from: openai_embeddings
308- engine: es_hybrid # vector index → Elasticsearch dense_vector
309- params:
310- index: articles_vectors
311- vector_field: content_embedding
316+ row_id:
317+ - id
318+ chunking:
319+ enabled: true
320+ target_chunk_size: 256
321+ overlap_size: 64
322+ full_text_search:
323+ enabled: true
324+ engine: elastic
325+ params:
326+ elasticsearch_index: fts_index
327+ row_id:
328+ - id
329+
330+ - name: title
312331 full_text_search:
313332 enabled: true
314- row_id: id
315- engine: es_hybrid
333+ engine: elastic
334+ params:
335+ elasticsearch_index: fts_index
336+ row_id:
337+ - id
316338` ` `
317339
318340This means a single Elasticsearch cluster serves all search modalities, keeping infrastructure simple while enabling powerful hybrid queries.
You can’t perform that action at this time.
0 commit comments