Skip to content

Add support for generator http client#2

Open
christinaexyou wants to merge 55 commits intotrustyai-explainability:mainfrom
christinaexyou:generator-http
Open

Add support for generator http client#2
christinaexyou wants to merge 55 commits intotrustyai-explainability:mainfrom
christinaexyou:generator-http

Conversation

@christinaexyou
Copy link
Copy Markdown
Collaborator

No description provided.

declark1 and others added 30 commits October 3, 2024 11:37
Signed-off-by: declark1 <daniel.clark@ibm.com>
…rom tls config

Co-authored-by: Mateus Devino <mdevino@ibm.com>
Signed-off-by: declark1 <daniel.clark@ibm.com>
Signed-off-by: Mateus Devino <mdevino@ibm.com>
Signed-off-by: declark1 <daniel.clark@ibm.com>
Signed-off-by: declark1 <daniel.clark@ibm.com>
Signed-off-by: declark1 <daniel.clark@ibm.com>
…e OpenAI-specific items, drop Completions API.

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>
Co-authored-by: Gaurav Kumbhat <kumbhat.gaurav@gmail.com>
Signed-off-by: Dan Clark <44146800+declark1@users.noreply.github.com>
Co-authored-by: Gaurav Kumbhat <kumbhat.gaurav@gmail.com>
Signed-off-by: Dan Clark <44146800+declark1@users.noreply.github.com>
Co-authored-by: Gaurav Kumbhat <kumbhat.gaurav@gmail.com>
Signed-off-by: Dan Clark <44146800+declark1@users.noreply.github.com>
Co-authored-by: Gaurav Kumbhat <kumbhat.gaurav@gmail.com>
Signed-off-by: Dan Clark <44146800+declark1@users.noreply.github.com>
…pe and example config

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>
…drop GenerationProvider::OpenAi variant

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>
Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>
…alth_client to detector clients and OpenAiClient

Co-authored-by: Paul Scoropan <1paulscoropan@gmail.com>

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>
Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>
)

* otlp initial setup

Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>

* small tweaks

Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>

* some refactoring

Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>

* missed fmting

Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>

* Added telemetry ADR doc

Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>

* review comments

Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>

* missed nit

Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>

* doc nits

Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>

* rebase fix

Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>

* docs traceparent update

Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>

---------

Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>
Signed-off-by: gkumbhat <kumbhat.gaurav@gmail.com>
Signed-off-by: gkumbhat <kumbhat.gaurav@gmail.com>
Signed-off-by: gkumbhat <kumbhat.gaurav@gmail.com>
Signed-off-by: gkumbhat <kumbhat.gaurav@gmail.com>
…_doc_chunk

🐛 Fix whole_doc_chunker missing from client list
)

Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>
Signed-off-by: Mateus Devino <mdevino@ibm.com>
Signed-off-by: Mateus Devino <mdevino@ibm.com>
Signed-off-by: Mateus Devino <mdevino@ibm.com>
This reverts commit 1cfcc1e.

Signed-off-by: Mateus Devino <mdevino@ibm.com>
Signed-off-by: Mateus Devino <mdevino@ibm.com>
Signed-off-by: Mateus Devino <mdevino@ibm.com>
mdevino and others added 25 commits October 17, 2024 20:17
Signed-off-by: Mateus Devino <mdevino@ibm.com>
Co-authored-by: Gaurav Kumbhat <kumbhat.gaurav@gmail.com>
Signed-off-by: Mateus Devino <19861348+mdevino@users.noreply.github.com>
Co-authored-by: Gaurav Kumbhat <kumbhat.gaurav@gmail.com>
Signed-off-by: Mateus Devino <19861348+mdevino@users.noreply.github.com>
Signed-off-by: Mateus Devino <mdevino@ibm.com>
Signed-off-by: Mateus Devino <mdevino@ibm.com>
Signed-off-by: gkumbhat <kumbhat.gaurav@gmail.com>
Signed-off-by: gkumbhat <kumbhat.gaurav@gmail.com>
…hold_passthrough

🐛 Fix threshold getting passed through beyond orchestrator proces…
)

* ✨ Pass along detector_params for text contents and generation

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>

* ✨✅ Not pass on threshold param

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>

* 🐛 Mutable threshold not intuitive

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>

* Update src/clients/detector/text_chat.rs

Co-authored-by: Mateus Devino <19861348+mdevino@users.noreply.github.com>
Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>

* 💡🎨 Update params comment and remove unnecessary clones

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>

* ✅ Threshold re-call not problematic

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>

---------

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>
Co-authored-by: Mateus Devino <19861348+mdevino@users.noreply.github.com>
Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>
Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>
Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>
Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>
Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>
Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>
Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>
Signed-off-by: Paul Scoropan <1paulscoropan@gmail.com>
…-telemetry

Integrate telemetry client instrumentation and traceparent propagation in orchestrator
…k#230)

* Add initial stream handling for OpenAiClient

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>

* Update OpenAiClient types and fix streaming request

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>

* Add OpenAiError and parse error message, order dependencies

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>

* Drop openai client tests module

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>

* Telemetry rebase and updates

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>

* Return SSE events directly from OpenAiClient stream

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>

* Add headers to OpenAiClient chat_completions method

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>

---------

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>
* added error messages to various unwraps

Signed-off-by: resoluteCoder <resolutecoder@gmail.com>

* added detector id vars to expect

Signed-off-by: resoluteCoder <resolutecoder@gmail.com>

* changed expects to unwrap or else due to lint

Signed-off-by: resoluteCoder <resolutecoder@gmail.com>

---------

Signed-off-by: resoluteCoder <resolutecoder@gmail.com>
* Implement Chat Completions API

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>

* Conditionally enable chat completions endpoint

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>

* Update chat completions to chat completions detection, rename items for alignment

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>

---------

Signed-off-by: declark1 <44146800+declark1@users.noreply.github.com>
* 📝 Document tags for detectors API

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>

* 🚧 Start stream content API and ADR

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>

* 📝 Update content stream response

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>

* 📝 Document content for request event

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>

* 📝 Update stream content API and decisions

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>

* 🚚 Rename field

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>

* 📝 Update types and clarify indices

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>

---------

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>
…stack#251)

Signed-off-by: Evaline Ju <69598118+evaline-ju@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants