Registry / http-networking / scrapinghub

scrapinghub

JSON →
library2.7.0pypypi✓ verified 84d ago

Client interface for the Scrapinghub API, used to manage and monitor scraping jobs, collections, items, and more. Current version is 2.7.0, requires Python >=3.10. Release cadence is irregular.

pip install scrapinghub
INSTALL
IMPORT
SIG · SCRAPINGHUB
S
scrapinghub
http-networkingpythonv2.7.0
Install
2.2s avg
Import
679ms
Disk
20MB
Pass rate
10/ 10
Env Coverage10 / 10
glibc
3.93.13
musl
3.93.13
Install & Compatibility
Where this runs
tested against v2.7.0 · pip install
no network on importno background threads
Install × environment matrix
Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux
musl
py 3.103.95 runs
installs and imports cleanly · install 0.0s · import 0.722s · 21.6MB
glibc
py 3.103.95 runs
installs and imports cleanly · install 2.2s · import 0.636s · 22MB
20MB installed
● package 20MB
Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

ScrapinghubClient
from scrapinghub import ScrapinghubClient
from scrapinghub.client import ScrapinghubClient
Old or incorrect import path. The main class is directly under the package.

Initialize client with API key, fetch a project, and list jobs.

from scrapinghub import ScrapinghubClient api_key = os.environ.get('SHUB_APIKEY', '') client = ScrapinghubClient(api_key) # Access a project project = client.get_project(123456) print(project.key) # List jobs (spiders) in a project for job in project.jobs.iter(): print(job['key'])
Debug
Known issues
deprecatedThe 'hubstorage' package is deprecated and merged into scrapinghub since version 1.9.0. Use 'scrapinghub' instead.
fix
Replace 'from hubstorage import HubstorageClient' with 'from scrapinghub import ScrapinghubClient'.
affects: <1.9.0
breakingPython 3.3 and 3.4 support dropped in version 2.3.1 and 2.0.0 respectively.
fix
Upgrade to Python 3.10+.
affects: >=2.0.0 <2.3.1
gotchaThe API key can be provided via environment variable 'SH_APIKEY' or 'SHUB_JOBAUTH'. If both are missing, client initialization will fail.
fix
Set either SH_APIKEY or SHUB_JOBAUTH environment variable before creating a client.
affects: all
gotchaJob IDs are strings in the format 'project_id/spider_id/job_id', not just numeric.
fix
Use full job key strings when referencing jobs in API calls.
affects: all
Errors
Common errors & fixes
ModuleNotFoundError: No module named 'hubstorage'
The hubstorage package is deprecated and merged into scrapinghub.
fix
pip install scrapinghub and change imports to 'from scrapinghub import ScrapinghubClient'.
ImportError: cannot import name 'ScrapinghubClient' from 'scrapinghub.client'
Incorrect import path; ScrapinghubClient is at the top-level package.
fix
from scrapinghub import ScrapinghubClient
ScrapinghubError: ('Connection error: ...')
Often due to invalid API key or network issues.
fix
Verify SH_APIKEY environment variable is set correctly and that you have internet access.
Upgrade
Version history
2.7.0latest on PyPI · released Apr 7, 2026
Audit
Dependencies
msgpackrequiredserialization of data
requestsrequiredHTTP client
retryingrequiredretry logic for HTTP errors
Agent activity
6 hits · last 30 days
node
4
OpenAI (training)
1
Resources
scrapinghub — pip install scrapinghub · libregistry