Registry / data / datacorecommon

datacorecommon

library0.6.0pypypiunverified

Wrapper functions for PySpark, currently at version 0.6.0. Provides helper utilities to simplify Spark DataFrame operations. Release cadence is irregular.

data

pip install datacorecommon

package ↗

INSTALL

IMPORT

SIG · DATACORECOMMON

datacorecommon

datapythonv0.6.0

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

str_to_date

✓ from datacorecommon import str_to_date

✗ from datacorecommon import str_to_date

Create a Spark session and use str_to_date to convert string column to date.

from datacorecommon import get_spark_session, str_to_date spark = get_spark_session() df = spark.createDataFrame([('2023-01-01',)], ['date_str']) df = str_to_date(df, 'date_str', 'yyyy-MM-dd') df.show()

Debug

Known issues

gotchaThe library is still early stage (0.6.0). APIs may change without notice.

fix

Pin version in requirements and review changelog before upgrading.

affects: all

gotchaRequires Python >=3.6 and a compatible PySpark installation. May not work with newer Spark versions.

fix

Ensure PySpark is installed and matched to your Spark cluster version.

affects: all

Upgrade

Version history

0.6.0latest on PyPI · released Sep 26, 2025

Audit

Dependencies

No dependency data recorded yet.

Agent activity

8 hits · last 30 days

node

OpenAI (training)

Resources

packagehttps://pypi.org/project/datacorecommon/ ↗