Merge remote-tracking branch 'origin/3409-align-enqueuelinksoptions-with-crawlee-python'

Reconcile the local v4 merge with the rebased remote feature branch.
The remote branch is based on an older v4 (IRequestList / RequestProvider /
SitemapRequestList), while the local branch carries the latest v4 tip
(IRequestLoader / IRequestManager / SitemapRequestLoader). Resolved all
conflicts in favor of the newer v4 API, since the include/exclude feature
logic is identical on both sides:
- enqueue_links.ts, click-elements.ts (pw/pptr): keep IRequestManager import
- sitemap_request_loader.ts: keep SitemapRequestLoader rename + IRequestLoader
- sitemap_request_loader.test.ts: keep SitemapRequestLoader / new method names

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

Author: l2ysho

docs/examples/crawl_some_links.mdx

@@ -7,7 +7,7 @@ import RunnableCodeBlock from '@site/src/components/RunnableCodeBlock';
 import ApiLink from '@site/src/components/ApiLink';
 import CrawlSource from '!!raw-loader!roa-loader!./crawl_some_links.ts';
 
-This <ApiLink to="cheerio-crawler/class/CheerioCrawler">`CheerioCrawler`</ApiLink> example uses the <ApiLink to="core/interface/EnqueueLinksOptions#globs">`globs`</ApiLink> property in the <ApiLink to="cheerio-crawler/interface/CheerioCrawlingContext#enqueueLinks">`enqueueLinks()`</ApiLink> method to only add links to the <ApiLink to="core/class/RequestQueue">`RequestQueue`</ApiLink> queue if they match the specified pattern.
+This <ApiLink to="cheerio-crawler/class/CheerioCrawler">`CheerioCrawler`</ApiLink> example uses the <ApiLink to="core/interface/EnqueueLinksOptions#include">`include`</ApiLink> property in the <ApiLink to="cheerio-crawler/interface/CheerioCrawlingContext#enqueueLinks">`enqueueLinks()`</ApiLink> method to only add links to the <ApiLink to="core/class/RequestQueue">`RequestQueue`</ApiLink> queue if they match the specified pattern.
 
 <RunnableCodeBlock className="language-js" type="cheerio">
 	{CrawlSource}

docs/introduction/03-adding-urls.mdx

@@ -130,7 +130,7 @@ await enqueueLinks({
 
 ### Filter URLs with patterns
 
-For even more control, you can use `globs`, `regexps` and `pseudoUrls` to filter the URLs. Each of those arguments is always an `Array`, but the contents can take on many forms. <ApiLink to="core/interface/EnqueueLinksOptions">See the reference</ApiLink> for more information about them as well as other options.
+For even more control, you can use `include` and `exclude` to filter the URLs. Each accepts an `Array` of glob pattern strings, `{ glob: string }` objects, `RegExp` instances, or `{ regexp: RegExp }` objects. <ApiLink to="core/interface/EnqueueLinksOptions">See the reference</ApiLink> for more information about them as well as other options.
 
 :::caution Defaults override
 

test/e2e/adaptive-playwright-default/actor/main.js

@@ -40,7 +40,7 @@ const crawler = new AdaptivePlaywrightCrawler({
         await context.pushData({ url, heading, requestHandlerMode });
 
         await context.enqueueLinks({
-            globs: ['**/next/examples/*'],
+            include: ['**/next/examples/*'],
         });
     },
 });

test/e2e/adaptive-playwright-robots-file/actor/main.js

@@ -18,7 +18,7 @@ crawler.router.addDefaultHandler(async ({ log, request, enqueueLinks, pushData }
     log.info(`Processing ${request.loadedUrl}`);
     await enqueueLinks({
         // '/cart' is disallowed by robots.txt
-        globs: ['**/cart', '**/collections/*'],
+        include: ['**/cart', '**/collections/*'],
     });
     await pushData({ url: request.url, loadedUrl: request.loadedUrl });
 });

test/e2e/cheerio-default-ts/actor/main.ts

@@ -13,7 +13,7 @@ const crawler = new CheerioCrawler();
 crawler.router.addDefaultHandler(async ({ $, enqueueLinks, request, log }) => {
     const { url } = request;
     await enqueueLinks({
-        globs: ['https://crawlee.dev/js/docs/**'],
+        include: ['https://crawlee.dev/js/docs/**'],
     });
 
     const pageTitle = $('title').first().text();

test/e2e/cheerio-default/actor/main.js

@@ -20,7 +20,7 @@ await Actor.main(async () => {
         async requestHandler({ $, enqueueLinks, request, log }) {
             const { url } = request;
             await enqueueLinks({
-                globs: ['https://crawlee.dev/js/docs/**'],
+                include: ['https://crawlee.dev/js/docs/**'],
             });
 
             const pageTitle = $('title').first().text();

test/e2e/cheerio-enqueue-links-base/actor/main.js

@@ -21,7 +21,7 @@ await Actor.main(async () => {
             await Dataset.pushData({ url, loadedUrl, pageTitle });
 
             await enqueueLinks({
-                globs: [
+                include: [
                     'https://www.jamesallen.com/about-us/**',
                     'https://www.jamesallen.com/terms-of-use/**',
                     'https://www.jamesallen.com/guarantee/**',

test/e2e/cheerio-ignore-ssl-errors/actor/main.js

@@ -21,7 +21,8 @@ await Actor.main(async () => {
             if (label === 'START') {
                 log.info('Bad ssl page opened!');
                 await enqueueLinks({
-                    globs: [{ glob: 'https://*.badssl.com/', userData: { label: 'DETAIL' } }],
+                    include: ['https://*.badssl.com/'],
+                    label: 'DETAIL',
                     selector: '.group a.bad',
                 });
             } else if (label === 'DETAIL') {

test/e2e/cheerio-page-info/actor/main.js

@@ -14,7 +14,7 @@ const router = createCheerioRouter();
 router.addHandler('START', async ({ enqueueLinks }) => {
     await enqueueLinks({
         label: 'DETAIL',
-        globs: ['**/examples/accept-user-input'],
+        include: ['**/examples/accept-user-input'],
     });
 });
 

test/e2e/cheerio-request-queue-v2/actor/main.js

@@ -14,7 +14,7 @@ await Actor.main(async () => {
         async requestHandler({ $, enqueueLinks, request, log }) {
             const { url } = request;
             await enqueueLinks({
-                globs: ['https://crawlee.dev/js/docs/**'],
+                include: ['https://crawlee.dev/js/docs/**'],
             });
 
             const pageTitle = $('title').first().text();