Skip to content

Commit 17df1cc

Browse files
committed
Merge branch 'release/0.5.2' into 0.5.x
2 parents 0ca4853 + 2e12840 commit 17df1cc

31 files changed

+5902
-605
lines changed

README.md

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,7 @@ The mlrun/demos repository provides full end-to-end ML demo use-case application
1313
- [Churn Demo: Real-Time Customer-Churn Prediction](#demo-churn)
1414
- [NetOps Demo: Predictive Network Operations/Telemetry](#demo-netops)
1515
- [Stock-Analysis Demo](#demo-stocks)
16+
- [Model deployment Pipeline: Real-time operational Pipeline](#demo-model-deployment)
1617

1718
<a id="overview"></a>
1819
## Overview
@@ -187,4 +188,28 @@ The demo include the following steps:
187188

188189
<p><img src="./stock-analysis/assets/images/stocks-demo-pipeline.png" alt="Stock-analysis pipeline output" width="500"/></p>
189190

191+
<a id="demo-model-deployment"></a>
190192

193+
## Model deployment Pipeline: Real-time operational Pipeline
194+
195+
This demo shows how to deploy a model with streaming information.
196+
197+
This demo is comprised of several steps:
198+
199+
<p><img src="./model-deployment-pipeline/assets/model-deployment-pipeline.png" alt="Model deployment Pipeline Real-time operational Pipeline" width="500"/></p>
200+
201+
202+
While this demo covers the use case of 1<sup>st</sup>-day churn, it is easy to replace the data, related features and training model and reuse the same workflow for different business cases.
203+
204+
These steps are covered by the following pipeline:
205+
206+
- **1. Data generator** — Generates events for the training and serving and Create an enrichment table (lookup values).
207+
- **2. Event handler** - Receive data from the input. This is a common input stream for all the data. This way, one can easily replace the event source data (in this case we have a data generator) without affecting the rest of this flow. It also store all incoming data to parquet files.
208+
- **3. Stream to features** - Enrich the stream using the enrichment table and Update aggregation features using the incoming event handler.
209+
- **4. Optional model training steps -**
210+
- **4.1 Get Data Snapshot** - Takes a snapshot of the feature table for training.
211+
- **4.2 Describe the Dataset** - Runs common analysis on the datasets and produces plots suche as histogram, feature importance, corollation and more.
212+
- **4.3 Training** - Runing training with multiple classification models.
213+
- **4.4 Testing** - Testing the best performing model.
214+
- **5. Serving** - Serve the model and process the data from the enriched stream and aggregation features.
215+
- **6. Inference logger** - We use the same event handler function from above but only its capability to store incoming data to parquet files.

image-classification-with-distributed-training/horovod-project.ipynb

Lines changed: 298 additions & 244 deletions
Large diffs are not rendered by default.

image-classification-with-distributed-training/project.yaml

Lines changed: 119 additions & 108 deletions
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)