Scrapy
Scrapy: S3DownloadHandler sends signed S3 requests over plaintext HTTP by default
Scrapy is a high-level web crawling and scraping framework for Python. Prior to 2.17.0, in scrapy/core/downloader/handlers/s3.py, Scrapy's S3DownloadHandler converts an S3-scheme bucket and key request into a plaintext HTTP request to the corresponding S3 endpoint unless request.meta["is_secure"] is explicitly enabled, then signs and sends the plaintext request with configured AWS credentials. A network attacker who can observe traffic between Scrapy and S3 can read the bucket and key path, AWS Authorization header, X-Amz-Security-Token when temporary credentials are used, S3 object contents, and S3 response headers. An active man-in-the-middle attacker can also modify the plaintext S3 response body, status code, and headers before Scrapy processes them, causing scraped-data poisoning, poisoned exports, HTTP cache poisoning when caching is enabled, or influence over later crawl targets through forged redirects or attacker-controlled links. Users making S3-scheme requests with AWS credentials are affected. This issue is fixed in version 2.17.0.
Affected versions and mitigation
From the CVE record and the vendor's references.Affected
- < 2.17.0
Fixed in 2.17.0
Mitigation
Upgrade scrapy to 2.17.0 or later.
References
- Vendor advisory github.com/scrapy/scrapy/security/advisories/G…
- Patch github.com/scrapy/scrapy/commit/9523e1ec8c41fd…
- Release notes github.com/scrapy/scrapy/releases/tag/2.17.0
Timeline
Days relative to CVE publicationNo public PoC found yet; not in CISA KEV.
PoC repositories
Found on GitHub.No PoC repositories found yet.