Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regarding the error issue with "arch='ViT-H-14 ', version='laion2b_s32d_b79k" #43

Open
ffhelly opened this issue May 8, 2024 · 2 comments

Comments

@ffhelly
Copy link

ffhelly commented May 8, 2024

This is my code error.
I have downloaded laion/CLIP-ViT-H-14-laion2B-s32B-b79K/
And it was placed under t2v_enhanced.
But it seems that the path does not quite match this rule with the data.

Errors:

  • An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on.
  • Expected a <class 'NoneType'>
    Given value type: <class 'jsonargparse.namespace.Namespace'>
    Given value: Namespace(class_path='t2v_enhanced.model.diffusers_conditional.models.controlnet.image_embedder.FrozenOpenCLIPImageEmbedder', init_args=Namespace(arch='ViT-H-14', version='laion2b_s32b_b79k', device='cuda', max_length=77, freeze=True, antialias=True, ucg_rate=0.0, unsqueeze_dim=False, repeat_to_max_len=False, num_image_crops=0, output_tokens=False))
@ffhelly
Copy link
Author

ffhelly commented May 8, 2024

image_embedder.py line 75 code

def __init__(
    self,
    arch="ViT-H-14",
    version="laion2b_s32b_b79k",
    device="cuda",
    max_length=77,
    freeze=True,
    antialias=True,
    ucg_rate=0.0,
    unsqueeze_dim=False,
    repeat_to_max_len=False,
    num_image_crops=0,
    output_tokens=False,
):
    super().__init__()
    model, _, _ = open_clip.create_model_and_transforms(
        arch,
        device=torch.device("cpu"),
        pretrained=version,
    )
    del model.transformer
    self.model = model

@YisuiTT
Copy link

YisuiTT commented Jul 26, 2024

bro, I have the same problem, did you solve this problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants