You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/CONTRIBUTING.md
-25Lines changed: 0 additions & 25 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -16,28 +16,3 @@ If a related issue doesn't exist, you can open a new issue using a relevant [iss
16
16
17
17
## Pull requests
18
18
Follow the guidelines in [Developer guide](DEVELOPER_GUIDE.md)
19
-
20
-
21
-
## Adding new runtime
22
-
To add a new runtime, you need to:
23
-
1. Add a new file under [manifests](../utilities/manifests) directory.
24
-
2. Add `<runtime>_INFERENCE_CONFIG` dict with:
25
-
```code
26
-
"support_multi_default_queries": True|False, # Optioanl, if set to True, `default_query_model` should contains a dict with corresponding inference_type
27
-
"default_query_model": {
28
-
"query_input": <default query to be sent to the model>,
29
-
"query_output": <expected output>,
30
-
"use_regex": True|False, # Optional, if set to True, `query_output` should be a regex
31
-
},
32
-
"<query type, for example: all-tokens>": {
33
-
"<protocol, for example HTTP>": {
34
-
"endpoint": "<model endpoint>",
35
-
"header": "<model required headers>",
36
-
"body": '{<model expected body}',
37
-
"response_fields_map": {
38
-
"response_output": <output field in response>,
39
-
"response": <response field in response - optional>,
40
-
},
41
-
},
42
-
```
43
-
3. See [caikit_standalone](../utilities/manifests/caikit_standalone.py) for an example
Copy file name to clipboardExpand all lines: docs/DEVELOPER_GUIDE.md
+32Lines changed: 32 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -176,3 +176,35 @@ Run tox:
176
176
```bash
177
177
tox
178
178
```
179
+
180
+
## Adding new runtime
181
+
To add a new runtime, you need to:
182
+
1. Add a new file under [manifests](../utilities/manifests) directory.
183
+
2. Add `<runtime>_INFERENCE_CONFIG` dict with:
184
+
```code
185
+
"support_multi_default_queries": True|False, # Optioanl, if set to True, `default_query_model` should contains a dict with corresponding inference_type
186
+
"default_query_model": {
187
+
"query_input": <default query to be sent to the model>,
188
+
"query_output": <expected output>,
189
+
"use_regex": True|False, # Optional, if set to True, `query_output` should be a regex
190
+
},
191
+
"<query type, for example: all-tokens>": {
192
+
"<protocol, for example HTTP>": {
193
+
"endpoint": "<model endpoint>",
194
+
"header": "<model required headers>",
195
+
"body": '{<model expected body}',
196
+
"response_fields_map": {
197
+
"response_output": <output field in response>,
198
+
"response": <response field in response - optional>,
199
+
},
200
+
},
201
+
```
202
+
3. See [caikit_standalone](../utilities/manifests/caikit_standalone.py) for an example
203
+
204
+
## AI Usage
205
+
If using AI tooling to assist you in the process of writing or reviewing code:
206
+
1. Understand what you are doing --as a developer, you are ultimately responsible for the code. Always assume the code produced by the AI tools is unsafe and incorrect, and always double-check it.
207
+
2. We support [AGENTS.md](../AGENTS.md), an [open format](https://agents.md/) for guiding coding agents. If you use any proprietary tool that do not support `AGENTS.md` (e.g. Claude Code, Qwen Code, Gemini Code), you can create a symlink:
0 commit comments