Skip to content

Releases: ScrapeOps/scrapeops-scrapy-sdk

Scrapy Deprecation Fix

23 Apr 18:32

Choose a tag to compare

scrapeops_scrapy.middleware.retry.RetryMiddleware no longer emits ScrapyDeprecationWarning on Scrapy 2.15+.

Scrapy 2.15 warns whenever a
downloader middleware requires a spider argument on process_response /
process_exception, as that argument will stop being passed in a future
Scrapy release.

The middleware now stores the crawler (via
from_crawler) and accesses the running spider through
self.crawler.spider; the spider parameter is kept with a default of
None so existing and future Scrapy versions are both supported.
Behaviour is unchanged — the same ScrapeOps signals are emitted with the

Dependency Updates - v0.6.0

23 Apr 15:22

Choose a tag to compare

v0.6.0

Dependency and Python-support modernisation; no runtime behaviour changes.

Dependencies

  • Bumped floors: tld>=0.13.2, requests>=2.32.3, itemadapter>=0.11.0.
  • Removed json5 from install_requires (unused).
  • Removed the direct urllib3 pin — a compatible urllib3 is now resolved transitively via requests. The old pin was only needed as a workaround for requests 2.29.0 (psf/requests#6432), which is no longer relevant.
  • No upper bounds on any runtime dep.

Python support

  • Dropped Python 3.8 (EOL October 2024). python_requires is now >=3.9.
  • Added classifiers for Python 3.12 and 3.13.

Housekeeping

  • setup.py and scrapeops_scrapy/__init__.py are now aligned on the same version string.

Upgrading

Users on Python 3.9+ can upgrade with pip install -U scrapeops-scrapy; no config or code changes needed. Users on Python 3.8 should upgrade their interpreter or pin scrapeops-scrapy<0.6.

Fixes Release - 0.5.7

23 Apr 15:00

Choose a tag to compare

Fixed silent failure in scrapeops-scrapy when settings Contain Non-Serializable objects

0.5.6

22 Jul 15:44

Choose a tag to compare

Fixed the dependency issue with urllib3 - #13
Merged fix for issue #12

Version: 0.5.4 Latest

14 Nov 17:52

Choose a tag to compare

Fixed 2 user reported issues:
#10
#9

Updated dependencies to latest versions
Python minimum version needed now 3.8

Beta Version: 0.3.5

13 Jan 17:11

Choose a tag to compare

Changes

  • Bug fix with exception logging when middleware not enabled

Beta Version: 0.3.3

14 Dec 10:34

Choose a tag to compare

Changes

  • Added support for Scrapy stats parsing
  • Changed API auth from query parameters to headers
  • Fixed issue when API key invalid

0.3.1

13 Dec 15:49

Choose a tag to compare

Changes

  • Added support for all Scrapy Item types (data classes, etc.)
  • Expanded exclusion list for Scrapy settings not to be logged

Beta Version: 0.3

06 Dec 16:15

Choose a tag to compare

ScrapeOps SDK Beta Version:

  • Job Monitoring (Pages, Items, Runtimes, Status Codes, Errors, Latencies)
  • Item Validation
  • Health Checks and Alerts via ScrapeOps
  • Scrapyd Integration via ScrapeOps