Skip to content

Where do you apply the chat template in the example? #1451

Open
@wendlerc

Description

📚 Documentation

In https://captum.ai/tutorials/Llama2_LLM_Attribution it seems like Llama2-chat is used but it seems like the chat template is never applied. Do I see this correctly or is it applied somewhere in the background? If it is not applied I'd expect suboptimal results.

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions