Registry / data / parquet-tools

parquet-tools

library0.2.16pypypi✓ verified 82d ago

A command-line tool and Python library for inspecting, merging, and converting Parquet files. Version 0.2.16 requires Python 3.9+, maintains quarterly releases.

data serialization

pip install parquet-tools

github ↗package ↗

INSTALL

IMPORT

SIG · PARQUET-TOOLS

parquet-tools

datapythonv0.2.16

Install

14.2s avg

Import

—

Disk

366MB

Pass rate

10/ 10

Env Coverage10 / 10

glibc

3.9–3.13

musl

3.9–3.13

Install & Compatibility

Where this runs

tested against v0.2.16 · pip install

no network on importno background threads

Install × environment matrix

Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux

musl

py 3.10–3.95 runs

installs and imports cleanly · install 0.0s · import 0.000s · 375.2MB

glibc

py 3.10–3.95 runs

installs and imports cleanly · install 14.2s · import 0.000s · 343MB

366MB installed

● package 366MB

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

inspect

✓ from parquet_tools.commands import inspect

✗ from parquet_tools import inspect

commands

✓ from parquet_tools import commands

parquet

✓ from parquet_tools import parquet

Quick inspection of a Parquet file's schema.

from parquet_tools import inspect import pyarrow.parquet as pq # Create a small Parquet file for inspection import pandas as pd df = pd.DataFrame({'x': [1, 2], 'y': ['a', 'b']}) pq.write_table(pyarrow.Table.from_pandas(df), 'test.parquet') # Inspect schema inspect('test.parquet')

parquet-tools --version

Debug

Known issues

gotchaThe package name on PyPI is 'parquet-tools' (with hyphen), but the Python module uses underscore: 'parquet_tools'. Import with 'from parquet_tools import ...' not 'from parquet-tools import ...'.

fix

Use underscore in import statements.

affects: all

gotchaThe 'inspect' function prints schema to stdout rather than returning a Python object. You cannot programmatically access the schema from its return value.

fix

Capture stdout (e.g., with contextlib.redirect_stdout) or use pyarrow.parquet.read_schema directly.

affects: all

gotchaThe 'merge' function may change row ordering. It does not guarantee preservation of original row groups or sort order.

fix

Sort data beforehand if order matters, or use alternative methods like pyarrow.parquet.write_table.

affects: all

gotchaThe CLI tool is installed as 'parquet-tools' (with hyphen). Running 'parquet-tools --help' works, but 'parquet_tools' as a command does not.

fix

Use hyphen in command name: 'parquet-tools'.

affects: all

Upgrade

Version history

0.2.16latest on PyPI · released Mar 19, 2024

Audit

Dependencies

No dependency data recorded yet.

Agent activity

9 hits · last 30 days

node

Resources

githubhttps://github.com/ktrueda/parquet-tools ↗

packagehttps://pypi.org/project/parquet-tools/ ↗