Pretrained

[felixVogel02]

Hi, are the models f.e. ViT-B/32 only trained on LAION400M or are they also pretrained on other datasets? And if they are pretrained on other datasets, on which datasets are they pretrained?

Thanks for your great work!

Felix

[mitchellnw]

Hello,

This is specified with the pretrained argument, e.g., to get a model trained only on laion400m run:

open_clip.create_model_and_transforms('ViT-B-32-quickgelu', pretrained='laion400m_e32')

and to get the CLIP ViT-B/32 model which was trained on the OpenAI CLIP dataset run:

open_clip.create_model_and_transforms('ViT-B-32-quickgelu', pretrained='openai')

Check out the colab for more info. To see all options available you can run open_clip.list_pretrained().

[rwightman]

@hawkfly07 moving this to discussions as it's not a bug or feature, and might be useful for others in the future

[MengSunS]

whats the difference between ('ViT-B-32', 'openai') and ('ViT-B-32-quickgelu', 'openai')?

[mitchellnw]

see #441