qwen3 tokenizer think token

[00HS]

In the Hugging Face Qwen3-8B code, I see the following:

text = tokenizer.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True,
enable_thinking=True # Switches between thinking and non-thinking modes. Default is True.
)

From the docs, it looks like enable_thinking toggles thinking vs. non-thinking modes.
When I train with torchtune, the tokenizer seems to inherit from the Qwen2 tokenizer.

My questions are:

Does this mean the default setting already includes thinking mode?

At inference time, is there a way to disable/remove thinking mode when using this tokenizer?

[happypanda94]

The issue seems to be closed, but I do not really see any answer. I am also trying to finetune Qwen3-8B full (I already completed a few epochs), when I try to infer it starts thinking. How do I disable it? Is there a way to do so in the yaml config files? If thinking is on by default, should I have disabled it during fine tuning as well? If so, how to do it in the config?

[00HS]

@happypanda94 I was able to stop the thinking behavior during inference by setting enable_thinking=False, but I’m still unsure how it affects fine-tuning.
I’ll reopen the issue to hear from others who may know more about this.