The Charlotte Tilbury Selenium Link Scraper is a generic template-style scraper built with Selenium that fetches product links from shophouse pages of Charlotte Tilbury (or similar ecommerce sites). It collects URLs of product listings and outputs a structured list of links for further processing. Great for product discovery, catalog building, or feeding into more detailed scrapers down the line.
Created by Bitbash, built to showcase our approach to Scraping and Automation!
If you are looking for Charlotte Tilbury Selenium Link Scraper you've just found your team — Let's Chat. 👆👆
This actor uses a headless browser (via Selenium) to load pages that may include dynamic content, render JavaScript, and navigate paginated collections. Its primary purpose is to extract all product URLs from provided start pages so downstream workflows can fetch full product data. It’s a useful building block for ecommerce crawls or catalog aggregation.
- Loads category or collection pages (or any start URL) in a browser context.
- Handles dynamic loading or JS-rendered content (makes it more robust than static scrapers).
- Extracts all product listing URLs from each page.
- Outputs a structured JSON list of links, ready for use in other scraping steps.
| Feature | Description |
|---|---|
| Selenium-Driven Scraping | Uses a headless browser to render JS-heavy pages accurately. |
| Link Extraction | Collects all product listing URLs from given start pages. |
| Pagination and Multi-Page Support | Able to traverse multiple pages if needed. |
| Proxy & Anti-Block Support | Compatible with proxy configuration to avoid IP blocking. |
| Structured Output | Returns clean JSON array of URLs for easy integration. |
| Ease of Integration | Acts as first step (link discovery) before deeper product scraping. |
| Field Name | Field Description |
|---|---|
| url | A product listing URL found on the start pages. |
[
{
"url": "https://www.charlottetilbury.com/us/product/example-lipstick"
},
{
"url": "https://www.charlottetilbury.com/us/product/example-eye-shadow"
}
]
charlotte-tilbury-selenium-link-scraper/
├── src/
│ ├── main.js (or main.py depending on implementation)
│ ├── scraper/
│ │ ├── browser_launcher.js
│ │ ├── link_extractor.js
│ │ └── pagination_handler.js
│ └── config/
│ └── input_schema.json
├── package.json (or requirements.txt)
└── README.md
- Catalog builders gather all product links before feeding them into detailed scrapers.
- Market researchers map product offerings by collecting URLs across categories.
- Ecommerce tools assemble product link databases for price tracking or alerts.
- Scraper pipelines use link output as input for a second-stage product data extractor.
Does this scraper fetch full product details?
No — this actor only extracts product URLs (links). Use a separate product scraper to get details like price, description, images.
Is it suitable for JS-heavy websites?
Yes — since it uses Selenium (headless browser), it handles JavaScript and dynamic loading.
Can it follow pagination?
Yes — it supports multi-page crawling if the site uses paginated collections.
What output format does it use?
A JSON array of objects with a single url field per item, suitable for chaining into other scrapers or pipelines.
"Bitbash is a top-tier automation partner, innovative, reliable, and dedicated to delivering real results every time." Nathan Pennington
|
"Bitbash delivers outstanding quality, speed, and professionalism, truly a team you can rely on." Eliza
|
"Exceptional results, clear communication, and flawless delivery. Syed
|