Registry / networking / spidr

spidr

JSON →
library0.7.2rbrubygemsunverified

A versatile Ruby web spidering library for crawling sites, domains, or specific links.

networkinghttp-client
gem install spidr
github ↗homepage ↗docs ↗
INSTALL
IMPORT
SIG · SPIDR
S
spidr
networkingrubyv0.7.2
harness data pending
Install & Compatibility
Where this runs

No compatibility data collected yet for this library.

Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

Spidr
✓ require 'spidr'

Crawls a website and prints each page URL.

require 'spidr' Spidr.site('https://example.com') do |spider| spider.every_page { |page| puts page.url } end
Debug
Known issues

No known issues recorded.

Upgrade
Version history
0.7.2latest on RubyGems
Audit
Dependencies

No dependency data recorded yet.

Agent activity
19 hits · last 30 days
node
16
Amazon
1
Resources
githubhttps://github.com/postmodern/spidr ↗
homepagehttps://github.com/postmodern/spidr#readme ↗
docshttp://www.rubydoc.info/gems/spidr/ ↗
spidr — gem install spidr · libregistry