Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions cli/utils/step_item_template.yaml.j2
Original file line number Diff line number Diff line change
Expand Up @@ -14,4 +14,5 @@ spec:
filename: {{ filename|default('') }} {# Implementation file #}
image: mlrun/mlrun {# Base image name #}
requirements: [] {# List of Pythonic library requirements #}
kind: '' {# Step kind #}
version: 1.0.0 {# Step version, should follow standard semantic versioning schema #}
2 changes: 1 addition & 1 deletion functions/src/arc_to_parquet/function.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -94,7 +94,7 @@ spec:
disable_auto_mount: false
metadata:
categories:
- utils
- utilities
name: arc-to-parquet
tag: ''
verbose: false
2 changes: 1 addition & 1 deletion functions/src/arc_to_parquet/item.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
apiVersion: v1
categories:
- utils
- utilities
description: retrieve remote archive, open and save as parquet
doc: ''
example: arc_to_parquet.ipynb
Expand Down
2 changes: 1 addition & 1 deletion functions/src/azureml_utils/function.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -242,6 +242,6 @@ kind: job
metadata:
categories:
- model-serving
- utils
- utilities
tag: ''
name: azureml-utils
2 changes: 1 addition & 1 deletion functions/src/azureml_utils/item.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
apiVersion: v1
categories:
- model-serving
- utils
- utilities
description: Azure AutoML integration in MLRun, including utils functions for training
models on Azure AutoML platfrom.
doc: ''
Expand Down
2 changes: 1 addition & 1 deletion functions/src/github_utils/function.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ metadata:
labels:
author: Iguazio
categories:
- utils
- utilities
spec:
command: ''
args: []
Expand Down
2 changes: 1 addition & 1 deletion functions/src/github_utils/item.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
apiVersion: v1
categories:
- utils
- utilities
description: add comments to github pull request
doc: ''
example: github_utils.ipynb
Expand Down
2 changes: 1 addition & 1 deletion functions/src/mlflow_utils/function.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ spec:
metadata:
categories:
- model-serving
- utils
- utilities
name: mlflow-utils
tag: ''
kind: serving
2 changes: 1 addition & 1 deletion functions/src/mlflow_utils/item.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
apiVersion: v1
categories:
- model-serving
- utils
- utilities
description: Mlflow model server, and additional utils.
doc: ''
example: mlflow_utils.ipynb
Expand Down
2 changes: 1 addition & 1 deletion functions/src/onnx_utils/function.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
kind: job
metadata:
categories:
- utils
- utilities
- deep-learning
name: onnx-utils
tag: ''
Expand Down
2 changes: 1 addition & 1 deletion functions/src/onnx_utils/item.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
apiVersion: v1
categories:
- utils
- utilities
- deep-learning
description: ONNX intigration in MLRun, some utils functions for the ONNX framework,
optimizing and converting models from different framework to ONNX using MLRun.
Expand Down
2 changes: 1 addition & 1 deletion functions/src/open_archive/function.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -41,5 +41,5 @@ spec:
metadata:
name: open-archive
categories:
- utils
- utilities
tag: ''
2 changes: 1 addition & 1 deletion functions/src/open_archive/item.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
apiVersion: v1
categories:
- utils
- utilities
description: Open a file/object archive into a target directory
doc: ''
example: open_archive.ipynb
Expand Down
2 changes: 1 addition & 1 deletion functions/src/send_email/function.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ metadata:
labels:
author: Iguazio
categories:
- utils
- utilities
spec:
command: ''
args: []
Expand Down
2 changes: 1 addition & 1 deletion functions/src/send_email/item.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
apiVersion: v1
categories:
- utils
- utilities
description: Send Email messages through SMTP server
doc: ''
example: send_email.ipynb
Expand Down
36 changes: 28 additions & 8 deletions modules/src/agent_deployer/agent_deployer.py
Original file line number Diff line number Diff line change
Expand Up @@ -22,8 +22,17 @@
from mlrun.datastore.datastore_profile import (
DatastoreProfileV3io,
DatastoreProfileKafkaStream,
DatastoreProfileTDEngine,
)

# TimescaleDB support (mlrun >= 1.11), fallback to TDEngine for older versions
try:
from mlrun.datastore.datastore_profile import DatastoreProfilePostgreSQL

_USE_TIMESCALEDB = True
except ImportError:
from mlrun.datastore.datastore_profile import DatastoreProfileTDEngine

_USE_TIMESCALEDB = False
from mlrun.utils import logger


Expand Down Expand Up @@ -87,13 +96,24 @@ def configure_model_monitoring(self):
)
if mlconf.is_ce_mode():
mlrun_namespace = os.environ.get("MLRUN_NAMESPACE", "mlrun")
tsdb_profile = DatastoreProfileTDEngine(
name="tdengine-tsdb-profile",
user="root",
password="taosdata",
host=f"tdengine-tsdb.{mlrun_namespace}.svc.cluster.local",
port="6041",
)
if _USE_TIMESCALEDB:
tsdb_profile = DatastoreProfilePostgreSQL(
name="timescaledb-tsdb-profile",
user="postgres",
password="postgres",
host=f"timescaledb.{mlrun_namespace}.svc.cluster.local",
port="5432",
database="postgres",
)
else:
# Fallback for older mlrun versions
tsdb_profile = DatastoreProfileTDEngine(
name="tdengine-tsdb-profile",
user="root",
password="taosdata",
host=f"tdengine-tsdb.{mlrun_namespace}.svc.cluster.local",
port="6041",
)

stream_profile = DatastoreProfileKafkaStream(
name="kafka-stream-profile",
Expand Down
2 changes: 1 addition & 1 deletion modules/src/agent_deployer/requirements.txt
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
mlrun==1.10.0-rc41
mlrun==1.10.0
pytest~=8.2
1 change: 1 addition & 0 deletions steps/src/verify_schema/item.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -17,4 +17,5 @@ spec:
filename: verify_schema.py
image: mlrun/mlrun
requirements:
kind: generic
version: 1.0.0