Registry / data / collate-dbt-artifacts-parser

collate-dbt-artifacts-parser

JSON →
library0.1.4pypypiunverified

Collate dbt Artifacts Parser is a Python library that provides a structured way to parse dbt artifacts like `manifest.json` and `run_results.json` into Pydantic models. It leverages `dbt-artifacts-parser` and simplifies access to dbt project metadata. The current version is 0.1.4, and its release cadence is tied to internal dbt-labs development, though it's publicly available.

pip install collate-dbt-artifacts-parser
INSTALL
IMPORT
SIG · COLLATE-DBT-ARTIFA
C
collate-dbt-artifacts-parser
datapythonv0.1.4
Install
3.4s avg
Import
Disk
32MB
Pass rate
10/ 10
Env Coverage10 / 10
glibc
3.93.13
musl
3.93.13
Install & Compatibility
Where this runs
tested against v0.1.4 · pip install
no network on importno background threads
Install × environment matrix
Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux
musl
py 3.103.910 runs
installs and imports cleanly · install 0.0s · import 0.000s · 33.9MB
glibc
py 3.103.910 runs
installs and imports cleanly · install 3.4s · import 0.000s · 34MB
32MB installed
● package 32MB
Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

DbtArtifactParser
from collate_dbt_artifacts_parser import DbtArtifactParser
from collate_dbt_artifacts_parser import DbtArtifactParser

This quickstart demonstrates how to parse a dbt `manifest.json` file using `DbtArtifactParser`. It creates a mock manifest file, initializes the parser with the correct artifact type and schema version, and then parses the file into a Pydantic model. Remember to replace the mock content and path with your actual dbt artifact file.

import json import os from collate_dbt_artifacts_parser.parsers import DbtArtifactParser # Mock a simple manifest.json structure (truncated for brevity) mock_manifest_content = { "metadata": { "dbt_schema_version": "https://schemas.getdbt.com/dbt/manifest/v8.json", "dbt_version": "1.8.0", "generated_at": "2024-01-01T00:00:00Z", "invocation_id": "mock_invocation", "env": {}, "adapter_type": "postgres" }, "nodes": {}, "sources": {}, "macros": {} } # Create a dummy file dummy_file_path = "mock_manifest.json" with open(dummy_file_path, "w") as f: json.dump(mock_manifest_content, f) try: # Initialize parser for 'manifest' artifact of schema version 'v8' parser = DbtArtifactParser(artifact_type="manifest", version="v8") manifest_model = parser.parse_artifact_file(dummy_file_path) print(f"Successfully parsed manifest of type: {type(manifest_model)}") print(f"DBT Version from manifest metadata: {manifest_model.metadata.dbt_version}") except Exception as e: print(f"An error occurred during parsing: {e}") finally: # Clean up the dummy file if os.path.exists(dummy_file_path): os.remove(dummy_file_path)
Debug
Known issues
gotchadbt artifact schema versions (`manifest.json`, `run_results.json`) change frequently with dbt-core releases. Ensure the `version` parameter passed to `DbtArtifactParser` (e.g., 'v8') matches the `dbt_schema_version` within your artifact file (e.g., 'https://schemas.getdbt.com/dbt/manifest/v8.json'). Mismatches will lead to parsing errors.
fix
Always check the `dbt_schema_version` field within your dbt artifact JSON and use the corresponding `vX` in the `DbtArtifactParser` constructor. Consult the `dbt-artifacts-parser` documentation for a mapping of schema URLs to `vX` identifiers.
affects: All versions
gotchaThis library relies heavily on `dbt-artifacts-parser` for the core schema definitions and parsing logic. While `collate-dbt-artifacts-parser` specifies `dbt-artifacts-parser==1.0.2`, future changes in `dbt-artifacts-parser` or `dbt-core`'s artifact schemas could introduce incompatibilities.
fix
Be mindful of explicit version pinning for both `collate-dbt-artifacts-parser` and its dependency `dbt-artifacts-parser`. If encountering unexpected parsing issues, verify the compatibility of your installed `dbt-core` version with the `dbt-artifacts-parser` library.
affects: All versions
gotchaThe library's GitHub repository (`dbt-labs-internal`) indicates its origin as an internal dbt-labs project. While publicly available, this might imply its primary development focus is internal use cases, potentially leading to less emphasis on backward compatibility for external users or a slower response to external feature requests/bug reports.
fix
Exercise caution and thorough testing when upgrading versions, especially in critical pipelines. Rely primarily on the documented API and assume the primary goal is to serve dbt-labs' internal needs first.
affects: All versions
Upgrade
Version history
0.1.4latest on PyPI · released Nov 24, 2025
Audit
Dependencies
dbt-artifacts-parserrequiredCore parsing logic for dbt artifact schemas.
pydanticrequiredUsed for data validation and parsing dbt artifact JSON into Python models.
Agent activity
20 hits · last 30 days
node
18
Amazon
1
OpenAI (training)
1
Resources
collate-dbt-artifacts-parser — pip install collate-dbt-artifacts-parser · libregistry