Registry / ai-ml / sudachidict-small

sudachidict-small

JSON →
library20260428pypypi✓ verified 83d ago

A small-sized dictionary for use with SudachiPy, the Japanese morphological analyzer. This package provides the dictionary core required by sudachipy to perform tokenization and part-of-speech tagging. Current version 20260428 is regularly updated (monthly) with neologisms and synonyms. It is the recommended dictionary for most use cases, balancing coverage and performance.

ai-ml
pip install sudachidict-small
github ↗package ↗
INSTALL
IMPORT
SIG · SUDACHIDICT-SMALL
S
sudachidict-small
ai-mlpythonv20260428
Install
2.8s avg
Import
48ms
Disk
138MB
Pass rate
5/ 10
Env Coverage5 / 10
glibc
3.9–3.13
musl
3.9–3.13
Install & Compatibility
Where this runs
tested against v20260428 · pip install
no network on importno background threads
Install × environment matrix
Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux
musl
py 3.10–3.95 runs
build_error
glibc
py 3.10–3.95 runs
installs and imports cleanly · install 2.8s · import 0.048s · 140MB
138MB installed
● package 138MB
Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

SudachiPy
✓ from sudachipy import tokenizer from sudachipy import dictionary
✗ import sudachidict_small
sudachidict-small is not imported directly; it is used automatically by sudachipy when set as dict_type.

Initialize SudachiPy tokenizer using the small dictionary and tokenize a sample sentence.

from sudachipy import tokenizer from sudachipy import dictionary # Instantiate tokenizer with the small dictionary tokenizer_obj = tokenizer.Tokenizer() # Or explicitly: tokenizer_obj = tokenizer.Tokenizer(dict_type='small') morphemes = tokenizer_obj.tokenize('本日は晴天なり') for m in morphemes: print(f"{m.surface()}\t{m.part_of_speech()}")
Debug
Known issues
breakingRemoval of legacy dict_type names: 'small', 'core', 'full' used to be set directly; now they are replaced by package names (e.g., 'sudachidict-small'). If you set dict_type='small' in old code, it may break.
fix
Use the new style: tokenizer.Tokenizer(dict_type='sudachidict-small') or omit (defaults to small).
affects: <= 20230807
gotchaDo not import sudachidict_small directly. The dictionary package only contains data files; importing it yields no useful symbols and may cause confusion.
fix
Always use sudachipy to access the dictionary. The package is automatically loaded by sudachipy based on dict_type.
affects: all
Errors
Common errors & fixes
ImportError: cannot import name 'Small' from 'sudachidict_small'
Trying to import a class from the dictionary package, which does not expose Python symbols.
fix
Do not import from sudachidict_small. Instead, import from sudachipy and specify dict_type='small'.
sudachipy.errors.MultipleDictionaryError: multiple dictionaries found for 'small'
Having both sudachidict-small and sudachidict-core installed simultaneously with the same dict_type name.
fix
Uninstall the extra dictionary: pip uninstall sudachidict-core (or use distinct dict_type names).
Upgrade
Version history
20260428latest on PyPI · released Apr 30, 2026
Audit
Dependencies
sudachipyrequiredThis dictionary is a data package; sudachipy is required to use it.
Agent activity
14 hits · last 30 days
node
10
OpenAI (training)
1
Resources
githubhttps://github.com/WorksApplications/SudachiDict ↗
packagehttps://pypi.org/project/sudachidict-small/ ↗
sudachidict-small — pip install sudachidict-small · libregistry