feat: Structured output with Outlines and xgrammar #45
Description
-
Allow Outlines and XGrammar to mask the logits before sampling a new token
-
Try to default to XGrammar for much better performance on the hot path
{{ message }}
Allow Outlines and XGrammar to mask the logits before sampling a new token
Try to default to XGrammar for much better performance on the hot path