lindera

library3.0.7rscratesunverified

A morphological analysis library for Japanese text, supporting tokenization and linguistic analysis.

# Cargo.toml
[dependencies]
lindera = "3.0.7"

github ↗homepage ↗docs ↗

INSTALL

IMPORT

SIG · LINDERA

lindera

utilityrustv3.0.7

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

Tokenizer

✓ use lindera::tokenizer::Tokenizer;

Tokenizes a Japanese sentence using Lindera's default dictionary.

use lindera::tokenizer::Tokenizer; fn main() { let tokenizer = Tokenizer::new().unwrap(); let tokens = tokenizer.tokenize("日本語のテキスト").unwrap(); for token in tokens { println!("{}", token.text); } }

Debug

Known issues

gotchaRequires dictionary files; default dictionary may be large.

fix

Use lindera with the 'ipadic' feature or download a dictionary.

affects: >=3.0.0

Upgrade

Version history

3.0.7latest on crates.io

Audit

Dependencies

No dependency data recorded yet.

Agent activity

6 hits · last 30 days

node

Resources

githubhttps://github.com/lindera/lindera ↗

homepagehttps://github.com/lindera/lindera ↗

docshttps://docs.rs/lindera/ ↗