dataprofiler

library0.13.4pypypiunverified

DataProfiler is an open-source library by Capital One for data profiling: detecting schema, statistics, and entities (PII) in structured and unstructured data. Current version is 0.13.4, supporting Python >=3.9. Released quarterly.

analytics devops

pip install dataprofiler

github ↗homepage ↗

INSTALL

IMPORT

SIG · DATAPROFILER

dataprofiler

analyticspythonv0.13.4

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

Data

✓ from dataprofiler import Data

✗ from dataprofiler.data import Data

Data is a top-level class, not in submodule.

Profiler

✓ from dataprofiler import Profiler

✗ from dataprofiler.profilers import Profiler

Profiler is exported at package level as of 0.10+.

ProfilerOptions

✓ from dataprofiler import ProfilerOptions

✗ from dataprofiler.options import ProfilerOptions

Options class moved to top level in 0.9.0.

Profiles a small in-memory dataset with multiprocessing disabled to avoid OS-specific issues.

from dataprofiler import Data, Profiler import os data = Data(data=[[1, 'hello'], [2, 'world']]) profiler_options = ProfilerOptions() profiler_options.structured_options.multiprocess.is_enabled = False profiler = Profiler(data, options=profiler_options) print(profiler.report())

Debug

Known issues

breakingIn version 0.10.0, the import path for Profiler changed from `dataprofiler.profilers.profiler` to `dataprofiler`. Old code breaks.

fix

Use `from dataprofiler import Profiler` instead of `from dataprofiler.profilers.profiler import Profiler`.

affects: <0.10

deprecatedThe function `profiler.parse_file()` is deprecated as of 0.12.0. Use `Data(filepath)` instead.

fix

Replace `profiler.parse_file('data.csv')` with `Data('data.csv')`.

affects: >=0.12

gotchaProfiler may hang or raise a RuntimeError on Windows if multiprocessing is enabled. This is a known issue due to fork limitations.

fix

Disable multiprocessing: `profiler_options.structured_options.multiprocess.is_enabled = False`

affects: all

gotchaFor large datasets, setting `profile_options.structured_options.multiprocess.is_enabled = True` can cause memory blowup.

fix

Use multiprocessing only on machines with sufficient RAM, or disable it.

affects: all

Upgrade

Version history

0.13.4latest on PyPI · released Jul 30, 2025

Audit

Dependencies

scikit-learnoptionalUsed for entity recognition models

tensorflowoptionalUsed for deep learning entity models

Agent activity

34 hits · last 30 days

node

OpenAI (training)

Resources

githubhttps://github.com/capitalone/data-profiler ↗

homepagehttps://github.com/capitalone/data-profiler ↗