Registry / networking / spatie-crawler

spatie-crawler

library9.3.2phppackagistunverified

Crawl all internal links found on a website

composer require spatie/crawler

INSTALL

IMPORT

SIG · SPATIE-CRAWLER

spatie-crawler

networkingphpv9.3.2

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

Crawler

✓ use Spatie\Crawler\Crawler;

Crawl a website and observe each crawled URL.

use Spatie\Crawler\Crawler; Crawler::create() ->setCrawlObserver(new YourObserver()) ->startCrawling('https://example.com');

Debug

Known issues

breakingRequires PHP 8.0+ and ext-curl

fix

Upgrade to PHP 8.0+ and install curl extension

affects: >=9.0.0

Upgrade

Version history

9.3.2latest on Packagist

Audit

Dependencies

No dependency data recorded yet.

Agent activity

15 hits · last 30 days

node

Amazon

OpenAI (training)

Resources