Install & Compatibility
Where this runs
No compatibility data collected yet for this library.
Code
Verified usage
Verified import paths — ran on the pinned version, not inferred.
ParallelDims
✓ from torchtitan.parallelisms import ParallelDims
✗ from torchtitan.parallel import ParallelDims
Module renamed from 'parallel' to 'parallelisms' in v0.2.0
TrainSpec
✓ from torchtitan.config_manager import TrainSpec
✗ from torchtitan import TrainSpec
TrainSpec is not top-level; must import from config_manager
JobConfig
✓ from torchtitan.config_manager import JobConfig
ModelConverter
✓ from torchtitan.models import ModelConverter
Basic setup: configure, define parallelism, and convert model.
import os
from torchtitan import JobConfig, ParallelDims, TrainSpec
from torchtitan.models import ModelConverter
# Initialize config
config = JobConfig()
config.model = 'llama3' # or 'diffusion' etc.
config.hidden_size = 4096
config.num_layers = 32
# Setup parallelism
dims = ParallelDims(dp=1, tp=1, pp=1)
# Create train spec
spec = TrainSpec(model_config=config, parallel_dims=dims)
# Convert model for training
model = ModelConverter(spec).convert()
print(f'Model architecture: {type(model).__name__}')
Upgrade
Version history
0.2.2latest on PyPI · released Feb 20, 2026
Audit
Dependencies
torchrequiredRequired for tensor computation and model definition
torchvisionoptionalRequired for vision-related models (e.g., diffusion)
torchaooptionalRequired for some quantization/optimization features