## Problem `InferenceNode` does not support conversational-only models like Zephyr that require chat completion APIs. ## Workaround Must use `FnNode` combined with `InferenceClient.chat.completions` to work with these models. ## Expected Behavior `InferenceNode` should have built-in support for conversational/chat-completion models, or provide a clear API for specifying the inference mode.
Problem
InferenceNodedoes not support conversational-only models like Zephyr that require chat completion APIs.Workaround
Must use
FnNodecombined withInferenceClient.chat.completionsto work with these models.Expected Behavior
InferenceNodeshould have built-in support for conversational/chat-completion models, or provide a clear API for specifying the inference mode.