Registry / networking / webrobots

webrobots

JSON →
library0.1.2rbrubygemsunverified

This library helps write robots.txt compliant web robots in Ruby.

networkingutility
gem install webrobots
github ↗homepage ↗docs ↗
INSTALL
IMPORT
SIG · WEBROBOTS
W
webrobots
networkingrubyv0.1.2
harness data pending
Install & Compatibility
Where this runs

No compatibility data collected yet for this library.

Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

WebRobots
✓ require 'webrobots'

Check if a URL is allowed by robots.txt

require 'webrobots' robot = WebRobots.new('MyBot') robot.allowed?('https://example.com/')
Debug
Known issues

No known issues recorded.

Upgrade
Version history
0.1.2latest on RubyGems
Audit
Dependencies

No dependency data recorded yet.

Agent activity
18 hits · last 30 days
node
16
OpenAI (training)
1
Resources
githubhttps://github.com/knu/webrobots ↗
homepagehttps://github.com/knu/webrobots ↗
docshttp://www.rubydoc.info/gems/webrobots/ ↗
webrobots — gem install webrobots · libregistry