Registry / llm-agents / llama-index-readers-web

llama-index-readers-web

library0.6.0pypypi✓ verified 84d ago

A collection of web-based data readers for LlamaIndex, enabling ingestion from URLs, web pages, and online documents. Currently at version 0.6.0, released under the LlamaIndex ecosystem. Release cadence is irregular, tied to LlamaIndex updates.

llm-agents ai-ml

pip install llama-index-readers-web

package ↗

INSTALL

IMPORT

SIG · LLAMA-INDEX-READER

llama-index-readers-web

llm-agentspythonv0.6.0

Install

35.5s avg

Import

8038ms

Disk

531MB

Pass rate

5/ 10

Env Coverage5 / 10

glibc

3.9–3.13

musl

3.9–3.13

Install & Compatibility

Where this runs

tested against v0.6.0 · pip install

no network on importno background threads

Install × environment matrix

Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux

musl

py 3.10–3.95 runs

build_error

glibc

py 3.10–3.95 runs

installs and imports cleanly · install 35.5s · import 6.430s · 523MB

531MB installed

● package 531MB

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

BeautifulSoupWebReader

✓ from llama_index.readers.web import BeautifulSoupWebReader

✗ from llama_index.readers.web.BeautifulSoupWebReader import BeautifulSoupWebReader

Wrong nesting; correct is direct import from web module.

SimpleWebPageReader

✓ from llama_index.readers.web import SimpleWebPageReader

✗ from llama_index.web import SimpleWebPageReader

Old top-level import path removed in recent versions.

TrafilaturaWebReader

✓ from llama_index.readers.web import TrafilaturaWebReader

Correct import path.

Load a web page into a Document object using SimpleWebPageReader.

from llama_index.readers.web import SimpleWebPageReader reader = SimpleWebPageReader() docs = reader.load_data(urls=["https://example.com"]) print(docs[0].text[:100])

Debug

Known issues

breakingImport paths changed in v0.10+. Readers are now under llama_index.readers.web, not top-level llama_index.web.

fix

Use 'from llama_index.readers.web import ...' instead of 'from llama_index import ...'.

affects: >=0.10.0

deprecatedSimpleWebPageReader requires requests and beautifulsoup4 as dependencies; they are not installed by default.

fix

Install extra dependencies: pip install llama-index-readers-web[beautifulsoup4] or pip install beautifulsoup4 requests.

affects: all

gotchaSome readers (e.g., BeautifulSoupWebReader) require additional dependencies like lxml for certain parsers.

fix

Install lxml if you encounter parser errors: pip install lxml.

affects: all

Errors

Common errors & fixes

ModuleNotFoundError: No module named 'llama_index.readers.web'

Older version of llama-index-readers-web or incorrect import path.

fix

Upgrade to latest version (>=0.10.0) and use correct import: from llama_index.readers.web import ...

ImportError: cannot import name 'SimpleWebPageReader' from 'llama_index'

Using old top-level import path from before v0.10.

fix

Change import to: from llama_index.readers.web import SimpleWebPageReader

ValueError: You must provide at least one URL.

Called load_data() with an empty list or no urls parameter.

fix

Pass a non-empty list of URL strings: reader.load_data(urls=['https://example.com'])

Upgrade

Version history

0.6.0latest on PyPI · released Mar 12, 2026

Audit

Dependencies

llama-index-coreoptionalCore LlamaIndex abstractions (Document, BaseReader) are required.

Agent activity

13 hits · last 30 days

node

OpenAI (training)

Resources

packagehttps://pypi.org/project/llama-index-readers-web/ ↗