Install & Compatibility
Where this runs
tested against v0.2.5 · pip install
no network on importno background threads
Install × environment matrix
Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux
muslpy 3.10–3.95 runs
installs and imports cleanly · install 0.0s · import 0.000s · 222.4MB
glibcpy 3.10–3.95 runs
installs and imports cleanly · install 5.3s · import 0.000s · 199MB
208MB installed
● package 208MB
Code
Verified usage
Verified import paths — ran on the pinned version, not inferred.
AdlGen2FileSystem
✓ from pyarrowfs_adlgen2 import AccountHandler
✗ from pyarrow.fs import AdlGen2FileSystem
Initialize ADLS Gen2 filesystem and list files using PyArrow.
import os
from pyarrow.fs import AdlGen2FileSystem
storage_account = "mystorageaccount"
container = "mycontainer"
# Use DefaultAzureCredential (requires azure-identity)
fs = AdlGen2FileSystem(
account_name=storage_account,
account_key=os.environ.get('ADLS_KEY', ''), # optional key
tenant_id=os.environ.get('AZURE_TENANT_ID', ''),
client_id=os.environ.get('AZURE_CLIENT_ID', ''),
client_secret=os.environ.get('AZURE_CLIENT_SECRET', '')
)
# List files
print(fs.get_file_info([f"{container}/some/path"]))
Upgrade
Version history
0.2.5latest on PyPI · released Jun 27, 2024
Audit
Dependencies
pyarrowrequiredRequired for Arrow filesystem abstraction
azure-storage-file-datalakerequiredAzure SDK for ADLS Gen2
azure-identityoptionalAuthentication (DefaultAzureCredential)