You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: sample-applications/video-search-and-summarization/docs/user-guide/overview-architecture-search-and-summary.md
Copy file name to clipboardExpand all lines: sample-applications/video-search-and-summarization/docs/user-guide/overview-architecture-search.md
+7-7Lines changed: 7 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -33,7 +33,7 @@ See details on the system architecture and customizable options [here](./overvie
33
33
3. How components interact and support extensibility.
34
34
-->
35
35
36
-
Video Search pipeline is a combination of the core LangChain application logic that implements the Video Search pipeline and the set of microservices that implements the salient blocks of the video search pipeline. The following figures illustrate the setup. The Video Search UI communicates with the Video Search backend microservice. The Embedding microservice is provided as part of Intel Edge AI inference microservices catalog supporting a rich set of open-source models that can be downloaded from popular model hubs. For example, the [Hugging Face OpenVINO toolkit](https://huggingface.co/OpenVINO), a model from Hugging Face\* Model Hub that has been optimized using Intel's OpenVINO™ toolkit. The visual data prep. microservice can ingest common video formats, convert it into embedding space, and store it in the vector database. You can also save a copy of the video to the object store.
36
+
Video Search pipeline is a combination of the core LangChain application logic that implements the Video Search pipeline and the set of microservices that implements the salient blocks of the Video Search pipeline. The following figures illustrate the setup. The Video Search UI communicates with the Video Search backend microservice. The Embedding microservice is provided as part of Intel's Edge AI inference microservices catalog supporting a rich set of open-source models that can be downloaded from popular model hubs. For example, the [Hugging Face OpenVINO toolkit](https://huggingface.co/OpenVINO), a model from Hugging Face\* Model Hub that has been optimized using Intel's OpenVINO™ toolkit. The visual data prep. microservice can ingest common video formats, convert it into embedding space, and store it in the vector database. You can also save a copy of the video to the object store.
37
37
38
38
### Technical Architecture Diagram
39
39

@@ -58,7 +58,7 @@ Video Search pipeline is a combination of the core LangChain application logic t
58
58
59
59
-**Ask a query**: The UI microservice provides a prompt window for user queries. The queries can be saved for any future reference and usage. It is possible to enable up to 8 queries to run in the background continuously on any new video being ingested. This is a critical capability required in using this pipeline for agentic reasoning.
60
60
61
-
-**Execute the search pipeline**: The Video Search backend microservice does the following to generate the output response using the search pipeline:
61
+
-**Execute the Video Search pipeline**: The Video Search backend microservice does the following to generate the output response using the Video Search pipeline:
62
62
- Converts the query into an embedding space using the Embeddings microservice.
63
63
64
64
- Does a semantic retrieval to fetch the relevant videos from the vector database. Currently, the top-k (with k being configurable) video is used. Does not use a reranker microservice currently.
@@ -79,7 +79,7 @@ The following figure shows the application flow, including the APIs and data sha
79
79
- Explain how it contributes to the application and its benefits.
80
80
-->
81
81
82
-
1.**Intel Edge AI Inference microservices**:
82
+
1.**Intel's Edge AI Inference microservices**:
83
83
-**What it is**: Inference microservices are the embeddings and reranker microservices that run the chosen models on the hardware, optimally.
84
84
-**How it is used**: Each microservice uses OpenAI\* APIs to support their functionality. The microservices are configured to use the required models and are ready. The Video Search backend accesses these microservices in the LangChain\* application which creates a chain out of these microservices.
85
85
-**Benefits**: Intel guarantees that the sample application's default microservices configuration is optimal for the chosen models and the target deployment hardware. Standard OpenAI APIs ensure easy portability of different inference microservices.
@@ -91,11 +91,11 @@ The following figure shows the application flow, including the APIs and data sha
91
91
92
92
3.**Video Search backend microservice**:
93
93
-**What it is**: Video Search backend microservice is a LangChain framework-based implementation of Video Search's RAG pipeline, which handles user queries.
94
-
-**How it is used**: The UI frontend uses a REST API endpoint to send user queries and trigger the search pipeline.
95
-
-**Benefits**: The microservice provides a reference on using the LangChain framework for implementing Video Search through Intel Edge AI inference microservices.
94
+
-**How it is used**: The UI frontend uses a REST API endpoint to send user queries and trigger the Video Search pipeline.
95
+
-**Benefits**: The microservice provides a reference on using the LangChain framework for implementing Video Search through Intel's Edge AI inference microservices.
96
96
97
97
4.**Video Search UI**:
98
-
-**What it is**: A reference frontend providing an interface for you to interact with the Video Search search pipeline.
98
+
-**What it is**: A reference frontend providing an interface for you to interact with the Video Search pipeline.
99
99
-**How it is used**: The UI microservice runs on the deployed platform on a certain configured port. Accessing the specific URL allows you to use the UI.
100
100
-**Benefits**: This microservice must be treated as a sample reference implementation.
101
101
@@ -121,4 +121,4 @@ Intel designed the Video Search sample application with modularity, allowing dev
121
121
- Follow the system requirements guidelines on the different options available.
0 commit comments