Registry / data / hdijupyterutils

hdijupyterutils

library0.23.0pypypi✓ verified 22d ago

HdiJupyterUtils is a Python library providing utilities for Jupyter projects, particularly those from the HDInsight team, often used in conjunction with Sparkmagic for interactive Spark cluster interaction. It is currently at version 0.23.0 and sees active development with regular patch and minor releases as part of the Sparkmagic project.

data devops

pip install hdijupyterutils

github ↗package ↗

INSTALL

IMPORT

SIG · HDIJUPYTERUTILS

hdijupyterutils

datapythonv0.23.0

Install

21.9s avg

Import

—

Disk

389MB

Pass rate

10/ 10

Env Coverage10 / 10

glibc

3.9–3.13

musl

3.9–3.13

Install & Compatibility

Where this runs

tested against v0.23.0 · pip install

no network on importno background threads

Install × environment matrix

Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux

musl

py 3.10–3.95 runs

installs and imports cleanly · install 0.0s · import 0.000s · 385.8MB

glibc

py 3.10–3.95 runs

installs and imports cleanly · install 21.9s · import 0.000s · 362MB

389MB installed

● package 389MB

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

display_html

✓ import hdijupyterutils

✗ from hdijupyterutils import display_html

This quickstart demonstrates how to use the `display_html` function from `hdijupyterutils.ipythondisplay` to render raw HTML content, including the HTML representation of a Pandas DataFrame, directly in a Jupyter environment. This function is often used internally by Sparkmagic to present results.

from hdijupyterutils.ipythondisplay import display_html import pandas as pd # Displaying a simple HTML string html_message = "<h2>Hello from HdiJupyterUtils!</h2><p>This utility aids in Jupyter/HDInsight interactions.</p>" display_html(html_message, raw=True) # Example of displaying a Pandas DataFrame as HTML using the utility data = {"Name": ["Alice", "Bob"], "Age": [25, 30]} df = pd.DataFrame(data) display_html(df.to_html(), raw=True)

Debug

Known issues

breakingVersions prior to 0.20.0 dropped support for Python 3.6. Users on Python 3.6 must upgrade their Python version to use 0.20.0 or newer.

fix

Upgrade Python to 3.7 or newer.

affects: <0.20.0

breakingVersion 0.20.5 introduced a pin for `pandas<2.0.0`, indicating potential incompatibilities or breaking changes when using `hdijupyterutils` with Pandas 2.0 or newer.

fix

Ensure `pandas` version is less than 2.0.0 or upgrade to `hdijupyterutils` 0.23.0+ and verify compatibility.

affects: 0.20.5 - 0.22.x

breakingVersion 0.20.0 introduced significant changes for supporting async kernel execution in `ipykernel>=6`. Users upgrading to this version might encounter errors if their setup relies on specific kernel behaviors.

fix

Review release notes for `ipykernel` and `hdijupyterutils` regarding async execution; report issues to the `sparkmagic` repository.

affects: 0.20.0+

gotchaVersions between 0.19.2 and 0.23.0 might have experienced compatibility issues with IPython 8 and 9. Version 0.23.0 specifically includes a fix for IPython 8 and 9 support.

fix

Upgrade to `hdijupyterutils` version 0.23.0 or higher for full compatibility with IPython 8 and 9.

affects: 0.19.2 - 0.22.x

gotchaWhen developing with this or other Python libraries in Jupyter, changes made to imported modules may not be reflected without restarting the kernel or enabling IPython's `autoreload` extension.

fix

Use `%load_ext autoreload` and `%autoreload 2` at the top of your notebook to automatically reload modules upon changes.

affects: All

Upgrade

Version history

0.23.0latest on PyPI · released Jul 7, 2025

Audit

Dependencies

pandasrequiredOften used for data manipulation and display; older versions had explicit pinning requirements.

ipythonrequiredCore for Jupyter interactivity; specific versions required fixes for compatibility.

ipykernelrequiredCore for Jupyter interactivity; specific versions required fixes for compatibility.

tornadorequiredCommon dependency in Jupyter/web contexts, mentioned in dependency updates.

requestsrequiredUsed for HTTP communication with remote services like Livy in Sparkmagic.

numpyrequiredUnderpins pandas and other numerical operations; noted in installation issues.

Agent activity

21 hits · last 30 days

node

Resources

githubhttps://github.com/jupyter-incubator/sparkmagic ↗

packagehttps://pypi.org/project/hdijupyterutils/ ↗