Can someone please explain to me the different number of nuclei templates in the different tools? API, CLI, AI-templates?

[JWebDev]

Hi,

I would like to understand for myself the number of templates.
So, I installed the latest version of nuclei and updated all templates.

Nuclei => v3.3.9
Nuclei Templates => v10.1.3.

Counted the number of nuclei -tl | wc -l and i got 7707 templates.

Checked https://cloud.projectdiscovery.io => 9939 templates
Checked https://github.com/projectdiscovery/nuclei-templates => 10220 files(templates?)
Checked https://github.com/projectdiscovery/nuclei-templates-ai => 2529 templates

Checked https://api.projectdiscovery.io/v1/template/public => 9763 templates
Checked https://api.projectdiscovery.io/v1/template/early => 42 templates

My main questions are.
Why does the cloud platform present 9939 templates and I only have 7707 locally?
Are nuclei-templates-ai included in cloud.projectdiscovery.io? If so, if we take 7707 + 2529 = 10236 - more than the announced total number.
How do I get all 9939 or 10220 locally instead of 7707?

In general, I need to understand for myself why the number of templates is different?

Thanks!

[dogancanbakir]

Hi there- some templates are excluded by default for reasons like optimizations. If you use the -code flag, you'll see a different outcome:

$ nuclei -silent -tl | wc -l      
    7731

$ nuclei -silent -tl -code | wc -l
    9133

ref:

• https://github.com/projectdiscovery/nuclei-templates/blob/f62307e377877b090ea4ff15fc65bfc22dc688be/.nuclei-ignore#L4
• https://github.com/projectdiscovery/nuclei/releases/tag/v3.3.6

[JWebDev]

Thanks for the answer, but it does not answer my questions fully.
Why on the cloud 9939 templates, if we subtract not released(early) then we will get 9898 and it is more than 9133

[dogancanbakir]

I ran all the options I could recall and got a result close to what's on the cloud, but I may be missing something:

$ nuclei -silent -tl -code -file -esc -egm -headless -dast -passive -itags bruteforce,local,dos,fuzz | wc -l
    9715

[JWebDev]

@dogancanbakir Thanks. As I wrote in my first message.
https://api.projectdiscovery.io/v1/template/public => 9763 templates
and
https://api.projectdiscovery.io/v1/template/early => 42 templates

Total: 9763 + 42 = 9805 and it is not 9939 as I can see in cloud

[ehsandeep]

@JWebDev It’s unrelated to cloud but rather a difference between the total templates in the nuclei-templates project and the number of templates Nuclei loads by default. Using the example command below, you’ll see the same number of templates locally, but not all of them run by default. Users decide which templates to run based on the type of scan and target, as Nuclei supports multiple scan types.

$ tree ~/nuclei-templates/ | grep .yaml | wc -l
    9916

The difference between 9939 and 9916 is due to unreleased templates (main branch vs. tagged release). We expose these unreleased templates via API to cloud platform and plan to include them in the CLI as well.

[JWebDev]

@ehsandeep Hi. Thanks for the answer. With your tree command I see 9897. And understood what you say. Thanks.

How about cloud?
As I wrote in my first message.
https://api.projectdiscovery.io/v1/template/public => 9763 templates
and
https://api.projectdiscovery.io/v1/template/early => 42 templates

Total: 9763 + 42 = 9805 and it is not 9939 as I can see in cloud on the main page. Where is the rest 9939-9805=134?
Or this is the templates from tagged release and they cannot be accessed by the API? But it sounds for me not really logic. They should be in /early.

Thanks for explanation regarding the cloud.

[JWebDev]

Hi @ehsandeep,

thanks for the help.

I've updated the templates and double-checked them. Now everything seems to work from the console, but I want to understand how to enable all templates and selectively scan only the ones I have selected.

Now I have
tree ~/nuclei-templates/ | grep .yaml | wc -l => 9897 + 42(early templates) = 9939 and this is the cloud count.

But if I check the number of templates that nuclei-templates loads, I get a completely different number. I want to understand how I can run all templates using nuclei, not how many folders I have in the /nuclei-templates/ folder.

If I do it like this, I only get 9550(excluding 20 headless templates).

nuclei -tl -code -file -esc -egm -dast -passive | wc -l
WARNING:(ast) sonic only supports go1.17~1.23, but your environment is not suitable

                     __     _
   ____  __  _______/ /__  (_)
  / __ \/ / / / ___/ / _ \/ /
 / / / / /_/ / /__/ /  __/ /
/_/ /_/\__,_/\___/_/\___/_/   v3.3.9

                projectdiscovery.io


Listing available v10.1.3 nuclei templates for /home/jdev/nuclei-templates
9550

With SDK i get the same result - 9550

	ne, err := nuclei.NewNucleiEngineCtx(context.Background(), []nuclei.NucleiSDKOptions{
		nuclei.EnableCodeTemplates(),
		nuclei.EnableSelfContainedTemplates(),
		nuclei.EnableFileTemplates(),
		nuclei.EnableGlobalMatchersTemplates(),
		//nuclei.EnableHeadlessWithOpts(nil),
		//nuclei.EnablePassiveMode(),
	}...)
	//nuclei.DASTMode(),

	if err != nil {
		panic(err)
	}

	allTemplates := ne.GetTemplates()
	log.Println(allTemplates)

How should I configure SDK to at least get 9897 - 20(headless templates)?

Thanks!