llm-traceguard is an open-source Python library that provides Open Telemetry integration with Large Language Models (LLMs). It is designed to facilitate tracing and safeguarding applications that leverage LLMs, ensuring better monitoring and reliability.
- Easy integration with Open Telemetry for LLM applications.
- Real-time tracing and monitoring of LLM-based systems.
- Enhanced safeguards and insights for your LLM applications.
To install llm-traceguard, simply use pip:
pip install llm-traceguardHere's a basic example of how to use llm-traceguard in your project:
import llm_traceguard
llm_traceguard.instrument()- Python 3.8 or higher
- opentelemetry-api
- opentelemetry-sdk
Contributions are welcome! For major changes, please open an issue first to discuss what you would like to change. Please make sure to update tests as appropriate.
llm-traceguard is licensed under the Apache-2.0 License. See LICENSE for more details.
For support or any questions, feel free to contact us at support@whylabs.ai.