Skip to content

Optim-wip: Add the CLIP ResNet 50x4 model - #927

Open
ProGamerGov wants to merge 4 commits into
meta-pytorch:optim-wipfrom
ProGamerGov:optim-wip-clip-vis
Open

Optim-wip: Add the CLIP ResNet 50x4 model#927
ProGamerGov wants to merge 4 commits into
meta-pytorch:optim-wipfrom
ProGamerGov:optim-wip-clip-vis

Conversation

@ProGamerGov

@ProGamerGov ProGamerGov commented Apr 26, 2022

Copy link
Copy Markdown
Contributor
  • Added the CLIP ResNet 50x4 model used in the 'Multimodal Neurons in Artificial Neural Networks' research paper: https://distill.pub/2021/multimodal-neurons/
  • To make it easier to conduct research, the CLIP ResNet 50x4 model is divided into two parts; the image model and the text model.

I have a couple tutorials ready that use this model. I also have another PR ready that implements the tokenizer for the text model, using torchtext's CLIPTokenizer.

@ProGamerGov
ProGamerGov force-pushed the optim-wip-clip-vis branch from 3dca15b to e9598ea Compare May 13, 2022 21:21
@ProGamerGov

Copy link
Copy Markdown
Contributor Author

The CLIP PRs are: #927, #943, #945, #961, #965, #966, #968

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants