Skip to content

Commit ebbf0e0

Browse files
VinciGit00MrAliHasansemantic-release-botKhadyotTakaleclaude
authored
Add Italian README translation and fix outdated links (#1070) (#1071)
* feat: add OpenAI Batch API support for SmartScraperMultiGraph (#1036) Add SmartScraperMultiBatchGraph that uses the OpenAI Batch API for LLM calls, providing ~50% cost savings when real-time results aren't needed. Key features: - SmartScraperMultiBatchGraph: 3-phase pipeline (fetch/parse → batch submit → merge) that separates HTML fetching from LLM generation - BatchGenerateAnswerNode: collects prompts from all URLs and submits them as a single OpenAI Batch API request - utils/batch_api.py: helpers for creating, polling, and retrieving batch results with doc_id → URL mapping - Per-document error handling: partial failures don't break the batch - Configurable polling interval and max wait time - OpenAI-only validation (rejects non-OpenAI providers gracefully) - Results sorted by custom_id for consistent ordering - 18 unit tests with 100% pass rate Usage: graph = SmartScraperMultiBatchGraph( prompt='Extract key points', source=['https://url1.com', 'https://url2.com'], config={'llm': {'model': 'openai/gpt-4o-mini'}} ) result = graph.run() Closes #1036 * ci(release): 1.60.0-beta.2 [skip ci] ## [1.60.0-beta.2](v1.60.0-beta.1...v1.60.0-beta.2) (2026-02-24) ### Features * add OpenAI Batch API support for SmartScraperMultiGraph ([#1036](#1036)) ([9d4eba1](9d4eba1)) * fix: update broken test imports to match current API - Replace removed ScrapeGraph with SmartScraperGraph in scrape_graph_test.py - Replace renamed convert_to_csv/convert_to_json with export_to_csv/export_to_json in xml_scraper_openai_test.py * ci(release): 1.60.0-beta.3 [skip ci] ## [1.60.0-beta.3](v1.60.0-beta.2...v1.60.0-beta.3) (2026-03-15) ### Bug Fixes * update broken test imports to match current API ([536e5ad](536e5ad)) * ci(release): 1.76.0-beta.1 [skip ci] ## [1.76.0-beta.1](v1.75.1...v1.76.0-beta.1) (2026-04-07) ### Features * add OpenAI Batch API support for SmartScraperMultiGraph ([#1036](#1036)) ([9d4eba1](9d4eba1)) ### Bug Fixes * update broken test imports to match current API ([536e5ad](536e5ad)) ### CI * **release:** 1.60.0-beta.2 [skip ci] ([54d1473](54d1473)), closes [#1036](#1036) * **release:** 1.60.0-beta.3 [skip ci] ([637c696](637c696)) * reduce GitHub Actions costs by ~85% on PRs ([403080a](403080a)) * ci(release): 2.1.0-beta.1 [skip ci] ## [2.1.0-beta.1](v2.0.0...v2.1.0-beta.1) (2026-04-19) ### Features * add OpenAI Batch API support for SmartScraperMultiGraph ([#1036](#1036)) ([9d4eba1](9d4eba1)) ### Bug Fixes * update broken test imports to match current API ([536e5ad](536e5ad)) ### CI * **release:** 1.60.0-beta.2 [skip ci] ([54d1473](54d1473)), closes [#1036](#1036) * **release:** 1.60.0-beta.3 [skip ci] ([637c696](637c696)) * **release:** 1.76.0-beta.1 [skip ci] ([35ec272](35ec272)), closes [#1036](#1036) [#1036](#1036) * Add Italian README translation and fix outdated links (#1070) * fix(batch): use langchain_core.prompts for PromptTemplate import langchain 1.x removed langchain.prompts; import from langchain_core to fix ModuleNotFoundError causing all test collection to fail. * ci(release): 2.2.0-beta.1 [skip ci] ## [2.2.0-beta.1](v2.1.1...v2.2.0-beta.1) (2026-05-16) ### Features * add OpenAI Batch API support for SmartScraperMultiGraph ([#1036](#1036)) ([9d4eba1](9d4eba1)) ### Bug Fixes * update broken test imports to match current API ([536e5ad](536e5ad)) * **batch:** use langchain_core.prompts for PromptTemplate import ([24127da](24127da)) ### CI * **release:** 1.60.0-beta.2 [skip ci] ([54d1473](54d1473)), closes [#1036](#1036) * **release:** 1.60.0-beta.3 [skip ci] ([637c696](637c696)) * **release:** 1.76.0-beta.1 [skip ci] ([35ec272](35ec272)), closes [#1036](#1036) [#1036](#1036) * **release:** 2.1.0-beta.1 [skip ci] ([a2ea9eb](a2ea9eb)), closes [#1036](#1036) [#1036](#1036) [#1036](#1036) [#1036](#1036) --------- Co-authored-by: MrAliHasan <mrali.hassan997@gmail.com> Co-authored-by: semantic-release-bot <semantic-release-bot@martynus.net> Co-authored-by: khadyottakale <khadyottakale@gmail.com> Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Co-authored-by: Gabriele Maria Bellavia <gabriele.bellavia.m@gmail.com>
1 parent 4dea92e commit ebbf0e0

10 files changed

Lines changed: 1484 additions & 10 deletions

File tree

CHANGELOG.md

Lines changed: 40 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,24 @@
1+
## [2.2.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v2.1.1...v2.2.0-beta.1) (2026-05-16)
2+
3+
4+
### Features
5+
6+
* add OpenAI Batch API support for SmartScraperMultiGraph ([#1036](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/1036)) ([9d4eba1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/9d4eba1f154953e401982da7eff85686293b9a48))
7+
8+
9+
### Bug Fixes
10+
11+
* update broken test imports to match current API ([536e5ad](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/536e5adcde179a12ec146bd8a10cbf654e0eeeaa))
12+
* **batch:** use langchain_core.prompts for PromptTemplate import ([24127da](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/24127dad8c049601befd0e9157ec8a26609b45e1))
13+
14+
15+
### CI
16+
17+
* **release:** 1.60.0-beta.2 [skip ci] ([54d1473](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/54d147309dc7a1ce1b191c3e4feb927ee3ff4392)), closes [#1036](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/1036)
18+
* **release:** 1.60.0-beta.3 [skip ci] ([637c696](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/637c696da77da1bb916a4ece03bd66fea50be47e))
19+
* **release:** 1.76.0-beta.1 [skip ci] ([35ec272](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/35ec272b6f267a164fac67a26787396db548e2a7)), closes [#1036](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/1036) [#1036](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/1036)
20+
* **release:** 2.1.0-beta.1 [skip ci] ([a2ea9eb](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/a2ea9eb45f1406aac054e057c19a6bbf806fc38a)), closes [#1036](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/1036) [#1036](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/1036) [#1036](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/1036) [#1036](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/1036)
21+
122
## [2.1.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v2.1.0...v2.1.1) (2026-05-10)
223

324

@@ -17,6 +38,25 @@
1738

1839
* **docs:** drop Sphinx/RTD setup, point doc links to docs.scrapegraphai.com ([efe336e](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/efe336ec3f88da90dcc4923776e7da088278147b))
1940

41+
## [2.1.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v2.0.0...v2.1.0-beta.1) (2026-04-19)
42+
43+
44+
### Features
45+
46+
* add OpenAI Batch API support for SmartScraperMultiGraph ([#1036](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/1036)) ([9d4eba1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/9d4eba1f154953e401982da7eff85686293b9a48))
47+
48+
49+
### Bug Fixes
50+
51+
* update broken test imports to match current API ([536e5ad](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/536e5adcde179a12ec146bd8a10cbf654e0eeeaa))
52+
53+
54+
### CI
55+
56+
* **release:** 1.60.0-beta.2 [skip ci] ([54d1473](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/54d147309dc7a1ce1b191c3e4feb927ee3ff4392)), closes [#1036](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/1036)
57+
* **release:** 1.60.0-beta.3 [skip ci] ([637c696](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/637c696da77da1bb916a4ece03bd66fea50be47e))
58+
* **release:** 1.76.0-beta.1 [skip ci] ([35ec272](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/35ec272b6f267a164fac67a26787396db548e2a7)), closes [#1036](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/1036) [#1036](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/1036)
59+
2060
## [2.0.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.76.0...v2.0.0) (2026-04-19)
2161

2262

README.md

Lines changed: 10 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -10,21 +10,22 @@
1010
</a>
1111
</p>
1212

13-
[English](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/README.md) | [中文](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/docs/chinese.md) | [日本語](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/docs/japanese.md)
14-
| [한국어](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/docs/korean.md)
15-
| [Русский](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/docs/russian.md) | [Türkçe](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/docs/turkish.md)
13+
[English](https://github.com/ScrapeGraphAI/Scrapegraph-ai/blob/main/README.md) | [中文](https://github.com/ScrapeGraphAI/Scrapegraph-ai/blob/main/docs/chinese.md) | [日本語](https://github.com/ScrapeGraphAI/Scrapegraph-ai/blob/main/docs/japanese.md)
14+
| [한국어](https://github.com/ScrapeGraphAI/Scrapegraph-ai/blob/main/docs/korean.md)
15+
| [Русский](https://github.com/ScrapeGraphAI/Scrapegraph-ai/blob/main/docs/russian.md) | [Türkçe](https://github.com/ScrapeGraphAI/Scrapegraph-ai/blob/main/docs/turkish.md)
1616
| [Deutsch](https://www.readme-i18n.com/ScrapeGraphAI/Scrapegraph-ai?lang=de)
1717
| [Español](https://www.readme-i18n.com/ScrapeGraphAI/Scrapegraph-ai?lang=es)
1818
| [français](https://www.readme-i18n.com/ScrapeGraphAI/Scrapegraph-ai?lang=fr)
19-
| [Português](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/docs/portuguese.md)
19+
| [Português](https://github.com/ScrapeGraphAI/Scrapegraph-ai/blob/main/docs/portuguese.md)
20+
| [Italiano](https://github.com/ScrapeGraphAI/Scrapegraph-ai/blob/main/docs/italian.md)
2021

2122
[![PyPI Downloads](https://static.pepy.tech/personalized-badge/scrapegraphai?period=total&units=INTERNATIONAL_SYSTEM&left_color=BLACK&right_color=GREEN&left_text=downloads)](https://pepy.tech/projects/scrapegraphai)
2223

2324
[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg?style=for-the-badge)](https://opensource.org/licenses/MIT)
2425
[![](https://dcbadge.vercel.app/api/server/gkxQDAjfeX)](https://discord.gg/gkxQDAjfeX)
2526

2627
<p align="center">
27-
<a href="https://trendshift.io/repositories/9761" target="_blank"><img src="https://trendshift.io/api/badge/repositories/9761" alt="VinciGit00%2FScrapegraph-ai | Trendshift" style="width: 250px; height: 55px;" width="250" height="55"/></a>
28+
<a href="https://trendshift.io/repositories/15078" target="_blank"><img src="https://trendshift.io/api/badge/repositories/15078" alt="ScrapeGraphAI%2FScrapegraph-ai | Trendshift" style="width: 250px; height: 55px;" width="250" height="55"/></a>
2829
<p align="center">
2930

3031
[ScrapeGraphAI](https://scrapegraphai.com) is a *web scraping* python library that uses LLM and direct graph logic to create scraping pipelines for websites and local documents (XML, HTML, JSON, Markdown, etc.).
@@ -162,7 +163,7 @@ The documentation for ScrapeGraphAI can be found [here](https://docs.scrapegraph
162163

163164
Feel free to contribute and join our Discord server to discuss with us improvements and give us suggestions!
164165

165-
Please see the [contributing guidelines](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/CONTRIBUTING.md).
166+
Please see the [contributing guidelines](https://github.com/ScrapeGraphAI/Scrapegraph-ai/blob/main/CONTRIBUTING.md).
166167

167168
[![My Skills](https://skillicons.dev/icons?i=discord)](https://discord.gg/uJN7TYcpNa)
168169
[![My Skills](https://skillicons.dev/icons?i=linkedin)](https://www.linkedin.com/company/scrapegraphai/)
@@ -186,7 +187,7 @@ The Official API Documentation can be found [here](https://docs.scrapegraphai.co
186187
We collect anonymous usage metrics to enhance our package's quality and user experience. The data helps us prioritize improvements and ensure compatibility. If you wish to opt-out, set the environment variable SCRAPEGRAPHAI_TELEMETRY_ENABLED=false. For more information, please refer to the documentation [here](https://docs.scrapegraphai.com/introduction).
187188

188189
## ❤️ Contributors
189-
[![Contributors](https://contrib.rocks/image?repo=VinciGit00/Scrapegraph-ai)](https://github.com/VinciGit00/Scrapegraph-ai/graphs/contributors)
190+
[![Contributors](https://contrib.rocks/image?repo=ScrapeGraphAI/Scrapegraph-ai)](https://github.com/ScrapeGraphAI/Scrapegraph-ai/graphs/contributors)
190191

191192
## 🎓 Citations
192193
If you have used our library for research purposes please quote us with the following reference:
@@ -195,7 +196,7 @@ If you have used our library for research purposes please quote us with the foll
195196
author = {Lorenzo Padoan, Marco Vinciguerra},
196197
title = {Scrapegraph-ai},
197198
year = {2024},
198-
url = {https://github.com/VinciGit00/Scrapegraph-ai},
199+
url = {https://github.com/ScrapeGraphAI/Scrapegraph-ai},
199200
note = {A Python library for scraping leveraging large language models}
200201
}
201202
```
@@ -208,7 +209,7 @@ If you have used our library for research purposes please quote us with the foll
208209

209210
## 📜 License
210211

211-
ScrapeGraphAI is licensed under the MIT License. See the [LICENSE](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/LICENSE) file for more information.
212+
ScrapeGraphAI is licensed under the MIT License. See the [LICENSE](https://github.com/ScrapeGraphAI/Scrapegraph-ai/blob/main/LICENSE) file for more information.
212213

213214
## Acknowledgements
214215

0 commit comments

Comments
 (0)