Skip to content

Commit f501734

Browse files
author
David Goodwin
committed
Fix what's new
1 parent 9717094 commit f501734

File tree

1 file changed

+13
-7
lines changed

1 file changed

+13
-7
lines changed

README.rst

+13-7
Original file line numberDiff line numberDiff line change
@@ -41,19 +41,25 @@ server.
4141
What's New In 0.10.0 Beta
4242
-------------------------
4343

44+
* `Custom backend support
45+
<https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/model_repository.html#custom-backends>`_.
46+
TRTIS allows individual models to be implemented with custom
47+
backends instead of by a deep-learning framework. With a custom
48+
backend a model can implement any logic desired, while still
49+
benefiting from the GPU support, concurrent execution, dynamic
50+
batching and other features provided by TRTIS.
51+
52+
Features
53+
--------
54+
55+
The inference server provides the following features.
56+
4457
* `Multiple framework support
4558
<https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/model_repository.html#framework-model-definition>`_. The
4659
server can manage any number and mix of models (limited by system
4760
disk and memory resources). Supports TensorRT, TensorFlow GraphDef,
4861
TensorFlow SavedModel and Caffe2 NetDef model formats. Also supports
4962
TensorFlow-TensorRT integrated models.
50-
* `Custom backend support
51-
<https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/model_repository.html#custom-backends>`_. TRTIS
52-
allows individual models to be implemented with custom backends
53-
instead of by a deep-learning framework. With a custom backend a
54-
model can implement any logic desired, while still benefiting from
55-
the GPU support, concurrent execution, dynamic batching and other
56-
features provided by TRTIS.
5763
* TRTIS `monitors the model repository
5864
<https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/model_repository.html#modifying-the-model-repository>`_
5965
for any change and dynamically reloads the model(s) when necessary,

0 commit comments

Comments
 (0)