facebook-deit-base-patch16-224 · azureml v13 ↗
- source model id
- azureml/facebook-deit-base-patch16-224@13
- hosting
- foundry-managed-compute
- platforms
- Microsoft Foundry
- license
- apache-2.0
- architecture
- input_modalities
- output_modalities
- capabilities
DeiT (Data-efficient image Transformers) is an image transformer that do not require very large amounts of data for training. This is achieved through a novel distillation procedure using teacher-stu…
azureFoundry/azureml/facebook-deit-base-patch16-224@13
DeiT (Data-efficient image Transformers) is an image transformer that do not require very large amounts of data for training. This is achieved through a novel distillation procedure using teacher-student strategy, which results in high throughput and accuracy. DeiT is pre-trained and fine-tuned on ImageNet-1k (1 million images, 1,000 classes) at resolution 224x224. The model was first released in this repository, but the weights were converted to PyTorch from the timm repository by Ross Wightman.
An image is treated as a sequence of patches and it is processed by a standard Transformer encoder as used in NLP. These patches are linearly embedded, and a [CLS] token is added at the beginning of the sequence for classification tasks. The model also requires absolute position embeddings before feeding the sequence Transformer encoder. So t
1–1 / 1
1–1 / 1
31 / 100
1–4 / 4
Microsoft Foundry · Model page ↗
1–2 / 2
These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.