A small Vision Transformer distilled from a teacher model, trained on ImageNet-1k for image classification.