[module][langchain_mlrun] First version (#963)

* [Build] Fix html links, Add <function>.html as source in documentation

* Update CI temporarily and update index

* [XGB-Custom] Fix test artifact key name

* [XGB-Serving][XGB-Test][XGB-Trainer] Fix tests - artifact key

* [Build] Install python 3.9 when testing (#618)

* [Build] Update python version in CI (#620)

* [Build] Install python 3.9 when testing

* [Build] Update python version in CI

* .

* Revert "[Build] Update python version in CI (#620)" (#621)

This reverts commit 0cd1f15.

* Revert "[Build] Install python 3.9 when testing (#618)" (#619)

This reverts commit 3301415.

* [Build] Build with python 3.9 (#622)

* [Build] Build with python 3.9

* .

* [onnx utils] update onnx utils packages

* [Noise-reduction] Add new function to hub (#765)

* [Noise-reduction] Add new function to hub

* fix test

* added multiprocessing and silence removal to function

* delete `load_dask` (#822)

* [feature selection] update function yaml

* [feature selection] update function yaml

* Revert "[onnx utils] update onnx utils packages"

This reverts commit 8872798.

* [feature selection] update function yaml

* [feature selection] update function yaml

* Delete unsupported functions from the hub (#824)

* delete EOS functions

* bring back validate_great_expectations

* bring back load_dataset

* Update feature_selection/test_feature_selection.py

Co-authored-by: Eyal Danieli <eyald@iguazio.com>

* Update item.yaml

* Align to master branch (#826)

* [Category] Fix and add categories to functions (#808)

* [Category] Fix and add categories to functions

* bump version in structured

* test is not valid in huggingface_serving

* Fix duplicated footer

* Fix duplicated footer

* revert python version change as it will be done in another PR

* comments

* comments

* Bump python:3.6 to python:3.9 (#810)

* [Describe] Align describe to new pandas version (#812)

* [Describe] Align describe to new pandas version

* minor test fix

* update mlrun version

* add dask to requirements

* remove dask

* update numpy version

* debug

* debug

* debug

* remove dask tests

* remove debug code

* [get_offline_features] Updated to mlrun 1.6.3 (#813)

* [Feature-selection] Replace matplotlib with plotly (#815)

* Iguazio-cicd user token updated

Iguazio-cicd user token updated in repo secrets:
https://github.com/mlrun/functions/settings/secrets/actions
MARKETPLACE_ACCESS_TOKEN_V3
new token gh...Zmf was set around April

* forcing iguazio-cicd auth

forcing iguazio-cicd to deal with Author identity unknown

* checkout@v3 to v4 and echo

* [Mlflow_utils] - mlflow model server (#811)

* mlflow server

* small fix to test

* small fixes to ms and nb

* small fixes to mlrun version

* update requirements lightgbm

* added req

* Added xgboost to req

---------

Co-authored-by: Avi Asulin <34214569+aviaIguazio@users.noreply.github.com>

* [Mlflow] Remove mlflow tag  (#825)

* remove mlflow tag

* remove mlflow tag

---------

Co-authored-by: Avi Asulin <34214569+aviaIguazio@users.noreply.github.com>

* align feature_selection yaml

---------

Co-authored-by: Avi Asulin <34214569+aviaIguazio@users.noreply.github.com>
Co-authored-by: Yonatan Shelach <92271540+yonishelach@users.noreply.github.com>
Co-authored-by: rokatyy <ekaterina_molchanova@mckinsey.com>
Co-authored-by: Katerina Molchanova <35141662+rokatyy@users.noreply.github.com>
Co-authored-by: nashpaz123 <44337075+nashpaz123@users.noreply.github.com>
Co-authored-by: ZeevRispler <73653682+ZeevRispler@users.noreply.github.com>

* set `navigation_with_keys` to False (#829)

* remove xgb and churn functions (#830)

* [Batch Infer V2] Adjust function to 1.7 (#832)

* adjust batch infer v2

* update docs in NB

* bring back deprecated params and add warn (#834)

* fix PyYAML loading (#837)

* [text to audio generator] Replaced bark with openai tts models (#836)

* [Text to audio generator] Add speech engine (#838)

* [text to audio generator] Replaced bark with openai tts models

* [text to audio generator] Fix base url env var

* fix version

* Add speech engine

* after review

* [auto-trainer] update test requirements (#839)

* [Build] Fix html links, Add <function>.html as source in documentation

* Update CI temporarily and update index

* [XGB-Custom] Fix test artifact key name

* [XGB-Serving][XGB-Test][XGB-Trainer] Fix tests - artifact key

* [Build] Install python 3.9 when testing (#618)

* [Build] Update python version in CI (#620)

* [Build] Install python 3.9 when testing

* [Build] Update python version in CI

* .

* Revert "[Build] Update python version in CI (#620)" (#621)

This reverts commit 0cd1f15.

* Revert "[Build] Install python 3.9 when testing (#618)" (#619)

This reverts commit 3301415.

* [Build] Build with python 3.9 (#622)

* [Build] Build with python 3.9

* .

* Update requirements.txt

* [Feature Selection] Fix deprecated `get_offline_features`  (#844)

* fix feature_selection

* fix feature_selection

* fix feature_selection nb

* update yaml name

* fix test

* fix test

* limit torchaudio for unit test (#845)

* Update requirements.txt (#843)

* [Open Archive] Fix arbitrary file vulnerability  (#847)

* fix arbitrary file vulnerability

* fix arbitrary file vulnerability

* fix test

* [open_archive] Add traversal attack test  (#849)

* add traversal test

* add traversal test

* add traversal test

* first version

* run upg to pydantic v2

* added kafka and mlrun-ce code preparation

* Eyal review

* LangChain MLRun Integration with Kafka Support (CE Mode) (#1)

* docstring syntax fixes

* Add initial Kafka support for MLRun CE
Implement _KafkaMLRunEndPointClient with KafkaProducer
Add kafka_broker and kafka_topic to MLRunTracerClientSettings
Add Kafka parameters to setup_langchain_monitoring()
Update notebook to auto-detect CE/Enterprise mode
Add kafka-python, orjson, uuid-utils to requirements.txt

* added KAFKA_BROKER and DatastoreProfileTDEngine for registering kafka and tsdb profiles

* clear output

* use get_kafka_topic for the project name
remove "raises:" docstring
added kafka flush
added s3fs to requirements.txt

* adaptive notebook for local execution
- AWS_ENDPOINT_URL_S3 env variable in deployment
- port forwarding scripts

* Replace kafka_broker/kafka_topic with stream_profile_name
 - Update _KafkaMLRunEndPointClient to use DatastoreProfileKafkaStream
 - Fetch Kafka config (broker, topic, SASL, SSL) from registered profile
 - Auto-retrieve stream_profile_name from model monitoring credentials
 - Update MLRunTracerClientSettings with new stream_profile_name field
 - Update setup_langchain_monitoring() to use profile-based config
 - Update notebook to use simplified API

* Add get_kafka_stream_profile_name() utility to auto-detect Kafka profile

* Move dependencies from requirements.txt to item.yaml

* generalize env variables

* Deploy monitoring app once instead of redeploy
Unify profile variable naming for CE and Enterprise modes

* _KafkaMLRunEndPointClient constructor - keep project handling NONE able with parent class handling in

* revert removal of raise docstring
enforce usage of stream_profile_name

* change stream_profile_name to kafka_stream_profile_name
revert ValueError message

* Revert ValueError message
Added mechanism to flush stream upon root run (instead of each monitor call)

* ensure self._mlrun_client is not None before flush

* revert double deploy

* Add configurable kafka_linger_ms for hybrid flush control

Adds kafka_linger_ms parameter to control message delivery timing:
 - Explicit flush mode (linger_ms=0, default): flush after each root run
 - Kafka-managed mode (linger_ms>0): Kafka controls delivery timing

The flush() method now handles the mode internally - it's a no-op when Kafka-managed mode is enabled, keeping the tracer code simple.

* fix double deploy in notebook (set the in-cluster MinIO endpoint before deploying)

* Simplify Kafka flush behavior and enable batching by default
- Always flush at end of root run (removed conditional linger_ms check)
- Set default kafka_linger_ms to 500ms for message batching
- Simplify KafkaProducer initialization (pop bootstrap_servers instead of lambda)

* remove local module import from notebook
remove redundant requirements from item.yaml

* move env variables setup to top of the notebook

* renamed env vars

* fix test

* gilad review

---------

Co-authored-by: yonishelach <yonatanshelach@gmail.com>
Co-authored-by: Yoni Shelach <92271540+yonishelach@users.noreply.github.com>
Co-authored-by: Avi Asulin <avia@iguazio.com>
Co-authored-by: Eyal Danieli <eyald@iguazio.com>
Co-authored-by: Avi Asulin <34214569+aviaIguazio@users.noreply.github.com>
Co-authored-by: rokatyy <ekaterina_molchanova@mckinsey.com>
Co-authored-by: Katerina Molchanova <35141662+rokatyy@users.noreply.github.com>
Co-authored-by: nashpaz123 <44337075+nashpaz123@users.noreply.github.com>
Co-authored-by: ZeevRispler <73653682+ZeevRispler@users.noreply.github.com>
Co-authored-by: daniels290813 <78727943+daniels290813@users.noreply.github.com>
Co-authored-by: Tomer Weitzman <81749152+tomerbv@users.noreply.github.com>

Author: 9 people

modules/src/langchain_mlrun/item.yaml

@@ -0,0 +1,24 @@
+apiVersion: v1
+categories:
+- langchain
+- langgraph
+- tracing
+- monitoring
+- llm
+description: LangChain x MLRun integration - Orchestrate your LangChain code with MLRun.
+example: langchain_mlrun.ipynb
+generationDate: 2026-01-08:12-25
+hidden: false
+labels:
+  author: Iguazio
+mlrunVersion: 1.10.0
+name: langchain_mlrun
+spec:
+    filename: langchain_mlrun.py
+    image: mlrun/mlrun
+    kind: generic
+    requirements:
+    - langchain~=1.2
+    - pydantic-settings~=2.12
+    - kafka-python~=2.3
+version: 0.0.1