How do i get bare bones of ViT transformers
I want to have the ViT model’s version where it isnt trained.So basically that just the code for it.How can i do this? Im new so i have no clue help me out please
2022-02-24T16:10:02Z
I bet you want the default setting of ViT model in huggingface. You may try:from transformers import ViTModel, ViTConfigprint(ViTModel(ViTConfig()))
2022-02-24T16:21:39Z
Yeah I figured that out, but how to I proceed from there for training ?
2022-02-24T16:27:25Z
Maybe you can take a look on this tutorial?github.comTransformers-Tutorials/VisionTransformer at master ·...master/VisionTransformerThis repository contains demos I made with the Transformers library by HuggingFace. - Transformers-Tutorials/VisionTransformer at master · NielsRogge/Transformers-Tutorials
2022-02-24T16:43:27Z
This seems to be using a pre-trained version by what I could see