Registry / ai-ml / proces

proces

JSON →
library0.1.7pypypiunverified

proces is a Python library (version 0.1.7) designed for efficient text preprocessing. It offers a flexible `TextCleaner` class with various options to clean, normalize, and prepare raw text data for natural language processing (NLP) tasks, including removing HTML, URLs, mentions, hashtags, numbers, punctuation, and handling case conversion and whitespace. As a 0.x.x release, its API might evolve.

pip install proces
INSTALL
IMPORT
SIG · PROCES
P
proces
ai-mlpythonv0.1.7
Install
1.6s avg
Import
Disk
17MB
Pass rate
10/ 10
Env Coverage10 / 10
glibc
3.93.13
musl
3.93.13
Install & Compatibility
Where this runs
tested against v0.1.7 · pip install
no network on importno background threads
Install × environment matrix
Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux
musl
py 3.103.920 runs
installs and imports cleanly · install 0.0s · import 0.000s · 19.9MB
glibc
py 3.103.920 runs
installs and imports cleanly · install 1.6s · import 0.000s · 20MB
17MB installed
● package 17MB
Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

TextCleaner
from proces import TextCleaner
from proces.preprocess import TextCleaner

Demonstrates basic and advanced usage of the TextCleaner class to preprocess a sample string, applying various cleaning rules and replacement tokens.

from proces import TextCleaner # Basic cleaning: lowercase, remove punctuation, strip whitespace cleaner = TextCleaner(lower=True, remove_punctuation=True, strip_whitespace=True) text_input = " Hello, World! This is a Sample Text with HTML <br> tags. And @mentions, #hashtags, links: http://example.com 123 " cleaned_text = cleaner.clean(text_input) print(f"Original: {text_input}") print(f"Cleaned (basic): {cleaned_text}") # Advanced cleaning: remove HTML, URLs, mentions, hashtags, numbers, replace with tokens advanced_cleaner = TextCleaner( lower=True, remove_html=True, remove_urls=True, remove_mentions=True, remove_hashtags=True, remove_numbers=True, remove_punctuation=True, strip_whitespace=True, replace_numbers_with='<NUM>', replace_urls_with='<URL>', replace_mentions_with='<MENTION>', replace_hashtags_with='<HASHTAG>' ) cleaned_advanced_text = advanced_cleaner.clean(text_input) print(f"Cleaned (advanced): {cleaned_advanced_text}")
Debug
Known issues
breakingAs a library in early development (version 0.x.x), the API of 'proces' is subject to change without strict backward compatibility guarantees. Future minor versions might introduce breaking changes.
fix
Pin your project's dependency to a specific patch version (e.g., 'proces==0.1.7') or be prepared to adapt code when upgrading to new minor versions.
affects: 0.1.x
gotchaThe generic package name 'proces' can easily be confused with Python's built-in 'multiprocessing' module or other process management libraries. Ensure you are importing the correct 'proces' for text preprocessing.
fix
Always use specific imports like `from proces import TextCleaner` to avoid namespace collisions and clarify intent. Double-check your `pip install` command to ensure you're installing 'proces' from PyPI (text preprocessing) and not a similarly named package.
affects: All versions
gotchaThe `TextCleaner` class allows for removing stopwords, but it does not come with a default set of stopwords. If `remove_stopwords=True` is set without providing a `stopwords_list`, it will have no effect.
fix
To enable stopwords removal, you must provide your own list of stopwords (e.g., `cleaner = TextCleaner(remove_stopwords=True, stopwords_list=['a', 'the', 'is'])`) or download them via `nltk` and pass them in.
affects: All versions
Upgrade
Version history
0.1.7latest on PyPI · released Sep 9, 2023
Audit
Dependencies
nltkoptionalOptional dependency for advanced text processing features like stopwords removal, requires additional data downloads.
Agent activity
17 hits · last 30 days
node
16
Resources
proces — pip install proces · libregistry