Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Its not working for me #14

Open
letscreate321 opened this issue Nov 7, 2024 · 5 comments
Open

Its not working for me #14

letscreate321 opened this issue Nov 7, 2024 · 5 comments

Comments

@letscreate321
Copy link

Phi3Transformer does not support an attention implementation through torch.nn.functional.scaled_dot_product_attention yet. Please request the support for this architecture: huggingface/transformers#28005. If you believe this error is a bug, please open an issue in Transformers GitHub repository and load your model with the argument attn_implementation="eager" meanwhile. Example: model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="eager")

@1038lab
Copy link
Owner

1038lab commented Nov 7, 2024

update the custom node

@deceani
Copy link

deceani commented Nov 9, 2024

I get the same error, just installed today, tried manager install, and manual git install, I have latest version of comfyui, all is updated and still doesnt work

@deceani
Copy link

deceani commented Nov 9, 2024

I got rid of that error if i used the update_comfyui_and_python_dependencies.bat from the update folder on comfyui. Now i got an torch.OutOfMemoryError: Allocation on device because I dont have enoguh vram on this pc but I will try on another one.

@1038lab
Copy link
Owner

1038lab commented Nov 9, 2024

I get the same error, just installed today, tried manager install, and manual git install, I have latest version of comfyui, all is updated and still doesnt work

what's error message you got,

@1038lab
Copy link
Owner

1038lab commented Nov 9, 2024

I got rid of that error if i used the update_comfyui_and_python_dependencies.bat from the update folder on comfyui. Now i got an torch.OutOfMemoryError: Allocation on device because I dont have enoguh vram on this pc but I will try on another one.

This model is somewhat VRAM-intensive, so it is recommended to limit the input image size to 512 or 768 pixels to reduce VRAM usage. Setting the output resolution to 1024x1024 should work fine, and the results will run as expected. Additionally, there is a significant difference in VRAM consumption when loading one image versus two, which may require further optimization.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants