razdel

library0.5.0pypypi✓ verified 86d ago

Rule-based tokenizer and sentence segmenter for Russian text, splitting into tokens, sentences, and sections. Version 0.5.0 is the latest release, with stable API and infrequent updates.

ai-ml data

pip install razdel

github ↗package ↗

INSTALL

IMPORT

SIG · RAZDEL

razdel

ai-mlpythonv0.5.0

Install

1.5s avg

Import

17ms

Disk

16MB

Pass rate

10/ 10

Env Coverage10 / 10

glibc

3.9–3.13

musl

3.9–3.13

Install & Compatibility

Where this runs

tested against v0.5.0 · pip install

no network on importno background threads

Install × environment matrix

Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux

musl

py 3.10–3.95 runs

installs and imports cleanly · install 0.0s · import 0.018s · 18MB

glibc

py 3.10–3.95 runs

installs and imports cleanly · install 1.5s · import 0.016s · 18MB

16MB installed

● package 16MB

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

tokenize

✓ from razdel import tokenize

sentenize

✓ from razdel import sentenize

Basic usage: tokenize and sentenize a short Russian text.

from razdel import tokenize, sentenize text = "Привет! Как дела?" tokens = list(tokenize(text)) sentences = list(sentenize(text)) print(tokens) print(sentences)

Debug

Known issues

breakingData files are required but may be missing if installed via pip without proper wheels. Ensure your environment has the data files (razdel/data).

fix

Install using pip without flags; verify by running `from razdel import tokenize` and calling it. If error about missing data, reinstall or use the GitHub source.

affects: all

deprecatedThe `sectionize` function is experimental and may be removed or changed in future versions.

fix

Avoid relying on `sectionize` for production; use `tokenize` and `sentenize` instead.

affects: 0.5.0

Errors

Common errors & fixes

ModuleNotFoundError: No module named 'razdel'

razdel not installed.

fix

pip install razdel

FileNotFoundError: [Errno 2] No such file or directory: 'razdel/data/...'

Missing data files; installation may have been corrupted or incomplete.

fix

Reinstall razdel: pip install --force-reinstall razdel

Upgrade

Version history

0.5.0latest on PyPI · released Mar 26, 2020

Audit

Dependencies

No dependency data recorded yet.

Agent activity

22 hits · last 30 days

node

OpenAI (training)

Resources

githubhttps://github.com/natasha/razdel ↗

packagehttps://pypi.org/project/razdel/ ↗