Add TRITONSERVER_ServerOptionsSetLogCallback API #463
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adds a C API for registering a log callback, allowing applications using the Triton C API to capture log messages programmatically.
Motivation
Applications embedding Triton often have their own logging infrastructure and need to integrate Triton's logs rather than having them go to stdout/stderr or a separate file. The current workarounds (parsing log files, named pipes) are clunky and lose metadata like log levels. See triton-inference-server/server#8304.
API
Usage
Setting
replace_default_logger=truesuppresses default stdout/stderr output. Setting it tofalsecalls the callback in addition to normal logging.Dependencies
Requires triton-inference-server/common#149 for the underlying Logger changes.