Skip to content

Latest commit

 

History

History
39 lines (31 loc) · 1.5 KB

perplexity.md

File metadata and controls

39 lines (31 loc) · 1.5 KB
description
Instructions for using language models hosted on Perplexity with Spice.

Perplexity Models

To use a language model hosted on Perplexity, specify perplexity in the from field.

To use a specific model, include its model ID in the from field (see example below). If not specified, the default model is sonar.

models:
  - name: webs
    from: perplexity:sonar
    params:
      perplexity_auth_token: ${ secrets:SPICE_PERPLEXITY_AUTH_TOKEN }

The following parameters are specific to Perplexity models:

Parameter Description Default
perplexity_auth_token The Perplexity API authentication token. -
perplexity_* Additional, perplexity specific parameters to use on all requests. See Perplexity API Reference -

Note: Like other models in Spice, Perplexity can set default overrides for OpenAI parameters. See Parameter Overrides.

Example Configuration

models:
  - name: webs
    from: perplexity:sonar
    params:
      perplexity_auth_token: ${ secrets:SPICE_PERPLEXITY_AUTH_TOKEN }
      perplexity_search_domain_filter:
       - docs.spiceai.org
       - huggingface.co
      openai_temperature: 0.3141595