Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failed to create pipeline: Phi3Transformer does not support an attention implementation through torch.nn.functional.scaled_dot_product_attention yet. #27

Open
izonewonyoung opened this issue Nov 15, 2024 · 5 comments
Open

Failed to create pipeline: Phi3Transformer does not support an attention implementation through torch.nn.functional.scaled_dot_product_attention yet. #27

izonewonyoung opened this issue Nov 15, 2024 · 5 comments

Comments

@izonewonyoung
Copy link

ComfyUI Error Report

Error Details

Stack Trace

  File "E:\ComfyUI-aki-v1.2\execution.py", line 323, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)

  File "E:\ComfyUI-aki-v1.2\execution.py", line 198, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)

  File "E:\ComfyUI-aki-v1.2\execution.py", line 169, in _map_node_over_list
    process_inputs(input_dict, i)

  File "E:\ComfyUI-aki-v1.2\execution.py", line 158, in process_inputs
    results.append(getattr(obj, func)(**inputs))

  File "E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-OmniGen-main\ailab_OmniGen.py", line 388, in generation
    raise e

  File "E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-OmniGen-main\ailab_OmniGen.py", line 341, in generation
    pipe = self._get_pipeline(model_precision, keep_in_vram)

  File "E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-OmniGen-main\ailab_OmniGen.py", line 303, in _get_pipeline
    raise RuntimeError(f"Failed to create pipeline: {str(e)}")

System Information

  • ComfyUI Version: v0.2.7-22-g122c9ca1
  • Arguments: E:\ComfyUI-aki-v1.2\main.py --auto-launch --preview-method auto --disable-cuda-malloc
  • OS: nt
  • Python Version: 3.10.11 (tags/v3.10.11:7d4cc5a, Apr 5 2023, 00:38:17) [MSC v.1929 64 bit (AMD64)]
  • Embedded Python: false
  • PyTorch Version: 2.1.2+cu118

Devices

  • Name: cuda:0 NVIDIA GeForce RTX 3080 Ti : cudaMallocAsync
    • Type: cuda
    • VRAM Total: 12884377600
    • VRAM Free: 11234630396
    • Torch VRAM Total: 402653184
    • Torch VRAM Free: 12770044

Logs

2024-11-15T17:05:40.651252 - Hallo use cache models,make sure your 'pretrained_models' complete2024-11-15T17:05:40.651252 - 
2024-11-15T17:05:42.264170 - E:\ComfyUI-aki-v1.2\python\lib\site-packages\albumentations\__init__.py:13: UserWarning: A new version of Albumentations is available: 1.4.21 (you have 1.4.14). Upgrade using: pip install -U albumentations. To disable automatic update checks, set the environment variable NO_ALBUMENTATIONS_UPDATE to 1.
  check_for_updates()

2024-11-15T17:05:42.348247 - E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Hallo\pretrained_models2024-11-15T17:05:42.348247 - 
2024-11-15T17:05:42.360249 - Total VRAM 12288 MB, total RAM 65349 MB
2024-11-15T17:05:42.360249 - pytorch version: 2.1.2+cu118
2024-11-15T17:05:42.360249 - xformers version: 0.0.23.post1+cu118
2024-11-15T17:05:42.360249 - Set vram state to: NORMAL_VRAM
2024-11-15T17:05:42.360249 - Device: cuda:0 NVIDIA GeForce RTX 3080 Ti : cudaMallocAsync
2024-11-15T17:05:42.368579 - ### Loading: ComfyUI-Impact-Pack (V7.5.2)2024-11-15T17:05:42.368579 - 
2024-11-15T17:05:42.371577 - [Impact Pack] Wildcards loading done.2024-11-15T17:05:42.371577 - 
2024-11-15T17:05:42.383517 - ### Loading: ComfyUI-Inspire-Pack (V1.2.1)2024-11-15T17:05:42.383517 - 
2024-11-15T17:05:42.520969 - @@device:cuda2024-11-15T17:05:42.520969 - 
2024-11-15T17:05:42.527969 - @@device:cuda2024-11-15T17:05:42.527969 - 
2024-11-15T17:05:42.552815 - �[94mtheUpsiders Logic Nodes: �[92mLoaded�[0m2024-11-15T17:05:42.552815 - 
2024-11-15T17:05:42.557174 - ### Loading: ComfyUI-Manager (V2.51)2024-11-15T17:05:42.557174 - 
2024-11-15T17:05:42.873774 - ### ComfyUI Revision: 2830 [122c9ca1] | Released on '2024-11-14'2024-11-15T17:05:42.873774 - 
2024-11-15T17:05:43.195079 - !!!MimicBrush path was added to E:\ComfyUI-aki-v1.2\python\lib\site-packages/MimicBrush.pth
 if meet No module named 'MimicBrush' error,please restart comfyui2024-11-15T17:05:43.195079 - 
2024-11-15T17:05:43.222123 - using MLP layer as FFN
2024-11-15T17:05:43.938810 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json2024-11-15T17:05:43.938810 - 
2024-11-15T17:05:44.013447 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json2024-11-15T17:05:44.013447 - 
2024-11-15T17:05:44.182638 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json2024-11-15T17:05:44.183640 - 
2024-11-15T17:05:44.446600 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json2024-11-15T17:05:44.446600 - 
2024-11-15T17:05:44.478222 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json2024-11-15T17:05:44.478222 - 
2024-11-15T17:05:45.113007 - 2024-11-15 17:05:45,113 - modelscope - INFO - PyTorch version 2.1.2+cu118 Found.
2024-11-15T17:05:45.117006 - 2024-11-15 17:05:45,117 - modelscope - INFO - Loading ast index from E:\ComfyUI-aki-v1.2\.cache\modelscope\hub\ast_indexer
2024-11-15T17:05:45.227798 - 2024-11-15 17:05:45,227 - modelscope - INFO - Loading done! Current index file version is 1.15.0, with md5 f6409da05fcde65492bccab7f77b525b and a total number of 980 components indexed
2024-11-15T17:05:46.402235 - === Pretrained SD weights downloaded ===2024-11-15T17:05:46.402235 - 
2024-11-15T17:05:47.133962 - === MimicBrush weights downloaded ===2024-11-15T17:05:47.133962 - 
2024-11-15T17:05:47.462389 - json_repair## OK2024-11-15T17:05:47.462896 - 
2024-11-15T17:05:48.414537 - --------------
2024-11-15T17:05:48.414537 - �[91m ### Mixlab Nodes: �[93mLoaded
2024-11-15T17:05:48.414537 - ChatGPT.available True
2024-11-15T17:05:48.415040 - edit_mask.available True
2024-11-15T17:05:48.416043 - simple_lama_inpainting## OK2024-11-15T17:05:48.416043 - 
2024-11-15T17:05:48.421043 - ## lama torchscript model not found: E:\ComfyUI-aki-v1.2\models\lama\big-lama.pt,pls download from https://github.com/enesmsahin/simple-lama-inpainting/releases/download/v0.1.0/big-lama.pt2024-11-15T17:05:48.421043 - 
2024-11-15T17:05:48.421043 - LaMaInpainting.available True
2024-11-15T17:05:48.741253 - ## clip_interrogator_model not found: E:\ComfyUI-aki-v1.2\models\clip_interrogator\Salesforce\blip-image-captioning-base, pls download from https://huggingface.co/Salesforce/blip-image-captioning-base2024-11-15T17:05:48.741253 - 
2024-11-15T17:05:48.741253 - ClipInterrogator.available True
2024-11-15T17:05:48.917101 - ## text_generator_model not found: E:\ComfyUI-aki-v1.2\models\prompt_generator\text2image-prompt-generator, pls download from https://huggingface.co/succinctly/text2image-prompt-generator/tree/main2024-11-15T17:05:48.917101 - 
2024-11-15T17:05:48.918101 - ## zh_en_model not found: E:\ComfyUI-aki-v1.2\models\prompt_generator\opus-mt-zh-en, pls download from https://huggingface.co/Helsinki-NLP/opus-mt-zh-en/tree/main2024-11-15T17:05:48.918101 - 
2024-11-15T17:05:48.918101 - PromptGenerate.available True
2024-11-15T17:05:48.918101 - ChinesePrompt.available True
2024-11-15T17:05:48.918101 - RembgNode_.available True
2024-11-15T17:05:49.265001 - TripoSR.available
2024-11-15T17:05:49.266001 - MiniCPMNode.available
2024-11-15T17:05:49.266001 - �[93m -------------- �[0m
2024-11-15T17:05:49.316113 - �[34mOpenPose Editor: �[92mLoaded�[0m2024-11-15T17:05:49.316113 - 
2024-11-15T17:05:49.332988 - �[0;33m[ReActor]�[0m - �[38;5;173mSTATUS�[0m - �[0;32mRunning v0.5.1-a7 in ComfyUI�[0m2024-11-15T17:05:49.332988 - 
2024-11-15T17:05:49.419512 - Torch version: 2.1.2+cu1182024-11-15T17:05:49.419512 - 
2024-11-15T17:05:51.419650 - ### Loading: Workspace Manager (V1.0.0)2024-11-15T17:05:51.419650 - 
2024-11-15T17:05:51.456851 - 
�[1mFrom Bmad Custom Nodes�[0m2024-11-15T17:05:51.456851 - 
2024-11-15T17:05:51.456851 -  �[92mLoaded 122 nodes:2024-11-15T17:05:51.456851 - 
2024-11-15T17:05:51.456851 -   + api nodes (14)2024-11-15T17:05:51.456851 - 
2024-11-15T17:05:51.457852 -   + simple utility nodes (58)2024-11-15T17:05:51.457852 - 
2024-11-15T17:05:51.457852 -   + CV nodes (50)2024-11-15T17:05:51.457852 - 
2024-11-15T17:05:51.457852 -  �[93mNot loaded:2024-11-15T17:05:51.457852 - 
2024-11-15T17:05:51.457852 -   * color clip ade20k node2024-11-15T17:05:51.457852 - 
2024-11-15T17:05:51.457852 -   * extension dependent nodes2024-11-15T17:05:51.458852 - 
2024-11-15T17:05:51.458852 -  �[91mProblems:2024-11-15T17:05:51.458852 - 
2024-11-15T17:05:51.458852 -   ! No module named 'tensorflow'2024-11-15T17:05:51.458852 - 
2024-11-15T17:05:51.458852 -   ! No module named 'custom_nodes.ComfyUI_ADV_CLIP_emb'2024-11-15T17:05:51.458852 - 
2024-11-15T17:05:51.458852 - �[0m2024-11-15T17:05:51.458852 - 
2024-11-15T17:05:51.510851 - ------------------------------------------2024-11-15T17:05:51.510851 - 
2024-11-15T17:05:51.510851 - �[34mComfyroll Studio v1.76 : �[92m 175 Nodes Loaded�[0m2024-11-15T17:05:51.510851 - 
2024-11-15T17:05:51.510851 - ------------------------------------------2024-11-15T17:05:51.510851 - 
2024-11-15T17:05:51.510851 - ** For changes, please see patch notes at https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes/blob/main/Patch_Notes.md2024-11-15T17:05:51.510851 - 
2024-11-15T17:05:51.510851 - ** For help, please see the wiki at https://github.com/Suzie1/ComfyUI_Comfyroll_CustomNodes/wiki2024-11-15T17:05:51.510851 - 
2024-11-15T17:05:51.511852 - ------------------------------------------2024-11-15T17:05:51.511852 - 
2024-11-15T17:05:51.702175 - �[1;35m### [START] ComfyUI AlekPet Nodes ###�[0m2024-11-15T17:05:51.702175 - 
2024-11-15T17:05:51.702175 - �[92mNode -> ArgosTranslateNode [Loading]�[0m2024-11-15T17:05:51.702175 - 
2024-11-15T17:05:55.867232 - �[92mNode -> ExtrasNode [Loading]�[0m2024-11-15T17:05:55.867232 - 
2024-11-15T17:05:55.869233 - �[92mNode -> PainterNode [Loading]�[0m2024-11-15T17:05:55.869233 - 
2024-11-15T17:05:55.872232 - �[92mNode -> PoseNode [Loading]�[0m2024-11-15T17:05:55.872232 - 
2024-11-15T17:05:55.873232 - �[92mNode -> TranslateNode [Loading]�[0m2024-11-15T17:05:55.873232 - 
2024-11-15T17:06:00.050310 - �[1;35m### [END] ComfyUI AlekPet Nodes ###�[0m2024-11-15T17:06:00.050310 - 
2024-11-15T17:06:00.129504 - �[34mFizzleDorf Custom Nodes: �[92mLoaded�[0m2024-11-15T17:06:00.129504 - 
2024-11-15T17:06:00.341317 - missing pkgs2024-11-15T17:06:00.341317 -  2024-11-15T17:06:00.341317 - ['pillow']2024-11-15T17:06:00.341317 - 
2024-11-15T17:06:04.574380 - # 😺dzNodes: LayerStyle -> �[1;33mCannot import name 'guidedFilter' from 'cv2.ximgproc'
A few nodes cannot works properly, while most nodes are not affected. Please REINSTALL package 'opencv-contrib-python'.
For detail refer to �[4mhttps://github.com/chflame163/ComfyUI_LayerStyle/issues/5�[0m�[m2024-11-15T17:06:04.574380 - 
2024-11-15T17:06:04.574380 - # 😺dzNodes: LayerStyle -> �[1;33mWarning: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_LayerStyle\resource_dir.ini not found, default directory to be used. �[m2024-11-15T17:06:04.574380 - 
2024-11-15T17:06:04.575379 - # 😺dzNodes: LayerStyle -> �[1;33mFind 1 LUTs in E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_LayerStyle\lut�[m2024-11-15T17:06:04.575379 - 
2024-11-15T17:06:04.575379 - # 😺dzNodes: LayerStyle -> �[1;33mFind 1 Fonts in E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_LayerStyle\font�[m2024-11-15T17:06:04.575379 - 
2024-11-15T17:06:04.777110 - �[92m[tinyterraNodes] �[32mLoaded�[0m2024-11-15T17:06:04.777110 - 
2024-11-15T17:06:05.390116 - Patching UNetModel.forward2024-11-15T17:06:05.390116 - 
2024-11-15T17:06:05.390116 - UNetModel.forward has been successfully patched.2024-11-15T17:06:05.390116 - 
2024-11-15T17:06:05.410027 - �[1;32m[Power Noise Suite]: 🦚🦚🦚 �[93m�[3mwark!�[0m 🦚🦚🦚2024-11-15T17:06:05.410665 - 
2024-11-15T17:06:05.410665 - �[1;32m[Power Noise Suite]:�[0m Tamed �[93m11�[0m wild nodes.2024-11-15T17:06:05.410665 - 
2024-11-15T17:06:05.427246 - Nvidia APEX normalization not installed, using PyTorch LayerNorm2024-11-15T17:06:05.427246 - 
2024-11-15T17:06:05.547650 - 
2024-11-15T17:06:05.547650 - �[92m[rgthree] Loaded 39 exciting nodes.�[0m2024-11-15T17:06:05.547650 - 
2024-11-15T17:06:05.547650 - �[33m[rgthree] NOTE: Will NOT use rgthree's optimized recursive execution as ComfyUI has changed.�[0m2024-11-15T17:06:05.547650 - 
2024-11-15T17:06:05.547650 - 
2024-11-15T17:06:05.563756 - Please 'pip install apex'2024-11-15T17:06:05.563756 - 
2024-11-15T17:06:08.208499 - �[34mWAS Node Suite: �[0mOpenCV Python FFMPEG support is enabled�[0m2024-11-15T17:06:08.208499 - 
2024-11-15T17:06:08.208499 - �[34mWAS Node Suite �[93mWarning: �[0m`ffmpeg_bin_path` is not set in `E:\ComfyUI-aki-v1.2\custom_nodes\was-node-suite-comfyui\was_suite_config.json` config file. Will attempt to use system ffmpeg binaries if available.�[0m2024-11-15T17:06:08.208499 - 
2024-11-15T17:06:10.674927 - �[34mWAS Node Suite: �[0mFinished.�[0m �[32mLoaded�[0m �[0m214�[0m �[32mnodes successfully.�[0m2024-11-15T17:06:10.674927 - 
2024-11-15T17:06:10.674927 - 
	�[3m�[93m"Art is the language of the heart and the window to the soul."�[0m�[3m - Unknown�[0m
2024-11-15T17:06:10.674927 - 
2024-11-15T17:06:10.682926 - 
Import times for custom nodes:
2024-11-15T17:06:10.682926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\AIGODLIKE-ComfyUI-Translation
2024-11-15T17:06:10.682926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\websocket_image_save.py
2024-11-15T17:06:10.682926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\rembg-comfyui-node
2024-11-15T17:06:10.682926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\style_aligned_comfy
2024-11-15T17:06:10.682926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_IPAdapter_plus
2024-11-15T17:06:10.682926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\sdxl_prompt_styler
2024-11-15T17:06:10.682926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-VideoHelperSuite
2024-11-15T17:06:10.682926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Logic
2024-11-15T17:06:10.682926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\efficiency-nodes-comfyui
2024-11-15T17:06:10.682926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\cg-use-everywhere
2024-11-15T17:06:10.682926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\Comfyui_TTP_Toolset
2024-11-15T17:06:10.683926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-BRIA_AI-RMBG
2024-11-15T17:06:10.683926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\FreeU_Advanced-main
2024-11-15T17:06:10.683926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUi-Ollama-YN
2024-11-15T17:06:10.683926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_TiledKSampler
2024-11-15T17:06:10.683926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ControlNet-LLLite-ComfyUI
2024-11-15T17:06:10.683926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-OpenPose-Editor
2024-11-15T17:06:10.683926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfyui_ab_samplercustom
2024-11-15T17:06:10.683926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_densediffusion
2024-11-15T17:06:10.683926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\stability-ComfyUI-nodes
2024-11-15T17:06:10.683926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyLiterals
2024-11-15T17:06:10.683926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-SVD-ZHO
2024-11-15T17:06:10.683926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\masquerade-nodes-comfyui
2024-11-15T17:06:10.683926 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-AutomaticCFG
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfyui_controlnet_aux
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-WD14-Tagger
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_experiments
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-OmniGen-main
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\PowerNoiseSuite
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-inpaint-nodes
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_omost
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_InstantID
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\Steerable-Motion-main
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_FizzNodes
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Impact-Pack
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfy-image-saver
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Custom-Scripts
2024-11-15T17:06:10.684925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_essentials
2024-11-15T17:06:10.685925 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\Comfyui_CXH_joy_caption-main
2024-11-15T17:06:10.689364 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\images-grid-comfy-plugin
2024-11-15T17:06:10.689364 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-various
2024-11-15T17:06:10.689364 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-portrait-master
2024-11-15T17:06:10.689364 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Marigold
2024-11-15T17:06:10.689364 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-InstantID
2024-11-15T17:06:10.689364 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-KJNodes
2024-11-15T17:06:10.689364 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Frame-Interpolation
2024-11-15T17:06:10.689364 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_UltimateSDUpscale
2024-11-15T17:06:10.689364 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Advanced-ControlNet
2024-11-15T17:06:10.689364 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-KwaiKolorsWrapper
2024-11-15T17:06:10.689364 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-IC-Light
2024-11-15T17:06:10.689364 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\CharacterFaceSwap
2024-11-15T17:06:10.690362 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_FaceAnalysis
2024-11-15T17:06:10.690362 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\rgthree-comfy
2024-11-15T17:06:10.690362 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\Derfuu_ComfyUI_ModdedNodes
2024-11-15T17:06:10.690362 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_ExtraModels
2024-11-15T17:06:10.690362 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-workspace-manager
2024-11-15T17:06:10.690362 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfyui_segment_anything
2024-11-15T17:06:10.690362 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_StoryDiffusion
2024-11-15T17:06:10.690362 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-AnimateDiff-Evolved
2024-11-15T17:06:10.690362 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-ollama
2024-11-15T17:06:10.690362 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-liveportrait
2024-11-15T17:06:10.690362 -    0.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfyui_bmad_nodes
2024-11-15T17:06:10.690362 -    0.1 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\facerestore_cf
2024-11-15T17:06:10.690362 -    0.1 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_Comfyroll_CustomNodes
2024-11-15T17:06:10.690362 -    0.1 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_tinyterraNodes
2024-11-15T17:06:10.691362 -    0.1 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Inspire-Pack
2024-11-15T17:06:10.691362 -    0.1 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\clipseg.py
2024-11-15T17:06:10.691362 -    0.1 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-reactor-node
2024-11-15T17:06:10.691362 -    0.1 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\SDXL_EcomID_ComfyUI-main
2024-11-15T17:06:10.691362 -    0.1 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Advanced-ControlNet-main
2024-11-15T17:06:10.691362 -    0.1 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\PuLID_ComfyUI
2024-11-15T17:06:10.691362 -    0.1 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_LayerStyle
2024-11-15T17:06:10.691362 -    0.2 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Easy-Use
2024-11-15T17:06:10.691362 -    0.3 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Gemini
2024-11-15T17:06:10.691362 -    0.5 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\CosyVoice-ComfyUI
2024-11-15T17:06:10.691362 -    0.6 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Manager
2024-11-15T17:06:10.691362 -    0.8 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\a-person-mask-generator
2024-11-15T17:06:10.691362 -    0.8 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-BrushNet-Wrapper
2024-11-15T17:06:10.691362 -    0.9 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-DiffBIR
2024-11-15T17:06:10.691362 -    1.4 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-art-venture
2024-11-15T17:06:10.691362 -    1.7 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Hallo
2024-11-15T17:06:10.692362 -    1.9 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-SUPIR
2024-11-15T17:06:10.692362 -    2.1 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-mixlab-nodes
2024-11-15T17:06:10.692362 -    4.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-MimicBrush
2024-11-15T17:06:10.692362 -    4.4 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_HelloMeme-main
2024-11-15T17:06:10.692362 -    5.0 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\was-node-suite-comfyui
2024-11-15T17:06:10.692362 -    5.7 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Crystools
2024-11-15T17:06:10.692362 -    8.5 seconds: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI_Custom_Nodes_AlekPet
2024-11-15T17:06:10.692362 - 
2024-11-15T17:06:10.717675 - Starting server

2024-11-15T17:06:10.717675 - To see the GUI go to: http://127.0.0.1:8188
2024-11-15T17:06:11.684278 - E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-mixlab-nodes\webApp\lib/photoswipe-lightbox.esm.min.js2024-11-15T17:06:11.684278 - 
2024-11-15T17:06:11.710280 - E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-mixlab-nodes\webApp\lib/photoswipe.min.css2024-11-15T17:06:11.710280 - 
2024-11-15T17:06:11.732329 - FETCH DATA from: E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-Manager\extension-node-map.json2024-11-15T17:06:11.732329 - 2024-11-15T17:06:11.737327 -  [DONE]2024-11-15T17:06:11.737327 - 
2024-11-15T17:06:11.757330 - E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-mixlab-nodes\webApp\lib/pickr.min.js2024-11-15T17:06:11.757330 - 
2024-11-15T17:06:14.420330 - E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-mixlab-nodes\webApp\lib/model-viewer.min.js2024-11-15T17:06:14.420330 - 
2024-11-15T17:06:14.431331 - E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-mixlab-nodes\webApp\lib/classic.min.css2024-11-15T17:06:14.431331 - 
2024-11-15T17:06:14.433329 - E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-mixlab-nodes\webApp\lib/juxtapose.min.js2024-11-15T17:06:14.433329 - 
2024-11-15T17:06:14.437332 - E:\ComfyUI-aki-v1.2\custom_nodes\comfyui-mixlab-nodes\webApp\lib/juxtapose.css2024-11-15T17:06:14.437332 - 
2024-11-15T17:06:19.215252 - got prompt
2024-11-15T17:06:19.220167 - OmniGen code already exists2024-11-15T17:06:19.221167 - 
2024-11-15T17:06:19.221167 - OmniGen models verified successfully2024-11-15T17:06:19.221167 - 
2024-11-15T17:06:19.240166 - Auto selecting FP16 (Available VRAM: 12.0GB)2024-11-15T17:06:19.240166 - 
2024-11-15T17:06:19.240166 - Current model instance: None2024-11-15T17:06:19.241167 - 
2024-11-15T17:06:19.241167 - Current model precision: None2024-11-15T17:06:19.241167 - 
2024-11-15T17:06:22.012663 - Pipeline creation error: Phi3Transformer does not support an attention implementation through torch.nn.functional.scaled_dot_product_attention yet. Please request the support for this architecture: https://github.com/huggingface/transformers/issues/28005. If you believe this error is a bug, please open an issue in Transformers GitHub repository and load your model with the argument `attn_implementation="eager"` meanwhile. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="eager")`2024-11-15T17:06:22.012663 - 
2024-11-15T17:06:22.012663 - Fatal error in pipeline creation: Phi3Transformer does not support an attention implementation through torch.nn.functional.scaled_dot_product_attention yet. Please request the support for this architecture: https://github.com/huggingface/transformers/issues/28005. If you believe this error is a bug, please open an issue in Transformers GitHub repository and load your model with the argument `attn_implementation="eager"` meanwhile. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="eager")`2024-11-15T17:06:22.012663 - 
2024-11-15T17:06:22.012663 - Error during generation: Failed to create pipeline: Phi3Transformer does not support an attention implementation through torch.nn.functional.scaled_dot_product_attention yet. Please request the support for this architecture: https://github.com/huggingface/transformers/issues/28005. If you believe this error is a bug, please open an issue in Transformers GitHub repository and load your model with the argument `attn_implementation="eager"` meanwhile. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="eager")`2024-11-15T17:06:22.012663 - 
2024-11-15T17:06:22.020012 - !!! Exception during processing !!! Failed to create pipeline: Phi3Transformer does not support an attention implementation through torch.nn.functional.scaled_dot_product_attention yet. Please request the support for this architecture: https://github.com/huggingface/transformers/issues/28005. If you believe this error is a bug, please open an issue in Transformers GitHub repository and load your model with the argument `attn_implementation="eager"` meanwhile. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="eager")`
2024-11-15T17:06:22.022010 - Traceback (most recent call last):
  File "E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-OmniGen-main\ailab_OmniGen.py", line 254, in _get_pipeline
    pipe = self.OmniGenPipeline.from_pretrained(Paths.OMNIGEN_DIR)
  File "E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-OmniGen-main\OmniGen\pipeline.py", line 82, in from_pretrained
    model = OmniGen.from_pretrained(model_name)
  File "E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-OmniGen-main\OmniGen\model.py", line 197, in from_pretrained
    model = cls(config)
  File "E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-OmniGen-main\OmniGen\model.py", line 186, in __init__
    self.llm = Phi3Transformer(config=transformer_config)
  File "E:\ComfyUI-aki-v1.2\python\lib\site-packages\transformers\models\phi3\modeling_phi3.py", line 948, in __init__
    super().__init__(config)
  File "E:\ComfyUI-aki-v1.2\python\lib\site-packages\transformers\modeling_utils.py", line 1388, in __init__
    config = self._autoset_attn_implementation(
  File "E:\ComfyUI-aki-v1.2\python\lib\site-packages\transformers\modeling_utils.py", line 1565, in _autoset_attn_implementation
    config = cls._check_and_enable_sdpa(
  File "E:\ComfyUI-aki-v1.2\python\lib\site-packages\transformers\modeling_utils.py", line 1731, in _check_and_enable_sdpa
    raise ValueError(
ValueError: Phi3Transformer does not support an attention implementation through torch.nn.functional.scaled_dot_product_attention yet. Please request the support for this architecture: https://github.com/huggingface/transformers/issues/28005. If you believe this error is a bug, please open an issue in Transformers GitHub repository and load your model with the argument `attn_implementation="eager"` meanwhile. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="eager")`

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "E:\ComfyUI-aki-v1.2\execution.py", line 323, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "E:\ComfyUI-aki-v1.2\execution.py", line 198, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "E:\ComfyUI-aki-v1.2\execution.py", line 169, in _map_node_over_list
    process_inputs(input_dict, i)
  File "E:\ComfyUI-aki-v1.2\execution.py", line 158, in process_inputs
    results.append(getattr(obj, func)(**inputs))
  File "E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-OmniGen-main\ailab_OmniGen.py", line 388, in generation
    raise e
  File "E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-OmniGen-main\ailab_OmniGen.py", line 341, in generation
    pipe = self._get_pipeline(model_precision, keep_in_vram)
  File "E:\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-OmniGen-main\ailab_OmniGen.py", line 303, in _get_pipeline
    raise RuntimeError(f"Failed to create pipeline: {str(e)}")
RuntimeError: Failed to create pipeline: Phi3Transformer does not support an attention implementation through torch.nn.functional.scaled_dot_product_attention yet. Please request the support for this architecture: https://github.com/huggingface/transformers/issues/28005. If you believe this error is a bug, please open an issue in Transformers GitHub repository and load your model with the argument `attn_implementation="eager"` meanwhile. Example: `model = AutoModel.from_pretrained("openai/whisper-tiny", attn_implementation="eager")`

2024-11-15T17:06:22.022010 - Prompt executed in 2.80 seconds

Attached Workflow

Please make sure that workflow does not contain any sensitive information such as API keys or passwords.

{"last_node_id":11,"last_link_id":13,"nodes":[{"id":3,"type":"PreviewImage","pos":{"0":450,"1":60},"size":{"0":553.608642578125,"1":826.3672485351562},"flags":{},"order":1,"mode":0,"inputs":[{"name":"images","type":"IMAGE","link":11,"label":"images"}],"outputs":[],"properties":{"Node name for S&R":"PreviewImage"},"widgets_values":[]},{"id":9,"type":"PreviewImage","pos":{"0":1430,"1":60},"size":{"0":516.1412353515625,"1":824.7374267578125},"flags":{},"order":3,"mode":0,"inputs":[{"name":"images","type":"IMAGE","link":12,"label":"images"}],"outputs":[],"properties":{"Node name for S&R":"PreviewImage"},"widgets_values":[]},{"id":10,"type":"ailab_OmniGen","pos":{"0":33,"1":60},"size":{"0":400,"1":428},"flags":{},"order":0,"mode":0,"inputs":[{"name":"image_1","type":"IMAGE","link":null,"shape":7,"label":"image_1"},{"name":"image_2","type":"IMAGE","link":null,"shape":7,"label":"image_2"},{"name":"image_3","type":"IMAGE","link":null,"shape":7,"label":"image_3"}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[11,13],"slot_index":0,"label":"IMAGE"}],"properties":{"Node name for S&R":"ailab_OmniGen"},"widgets_values":["20yo woman looking at viewer","","Auto","Balanced",3.5,1.8,50,true,false,512,512,841832723452985,"randomize",1024]},{"id":11,"type":"ailab_OmniGen","pos":{"0":1013,"1":60},"size":{"0":400,"1":428},"flags":{},"order":2,"mode":0,"inputs":[{"name":"image_1","type":"IMAGE","link":13,"shape":7,"label":"image_1"},{"name":"image_2","type":"IMAGE","link":null,"shape":7,"label":"image_2"},{"name":"image_3","type":"IMAGE","link":null,"shape":7,"label":"image_3"}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[12],"slot_index":0,"label":"IMAGE"}],"properties":{"Node name for S&R":"ailab_OmniGen"},"widgets_values":["The girl in image_1 sitting on rock on top of the mountain (image_1)","","Auto","Balanced",3.5,1.8,50,true,false,512,512,679342688692131,"randomize",1024]}],"links":[[11,10,0,3,0,"IMAGE"],[12,11,0,9,0,"IMAGE"],[13,10,0,11,0,"IMAGE"]],"groups":[],"config":{},"extra":{"ds":{"scale":0.9646149645000006,"offset":[759.149115275308,207.74696963764498]}},"version":0.4}

Additional Context

(Please add any additional context or steps to reproduce the error here)
@artishtic
Copy link

I got this same issue just running the simple prompt, "20yo woman looking at viewer". I tried to run another creator's Omnigen node before this one, and I believe it was this same error.

@aaronkingdom
Copy link

same+1

@Ossenbrugge
Copy link

Same error here

@tokitoki22
Copy link

As for me I up-grade transformer-tortch. like this (I use stablity matrix, so need to change directory for comfy ui python)
(AI teached me so)

D:\programs\StabilityMatrix\Packages\ComfyUI\venv\Scripts>pip install --upgrade transformers torch

it will cause error for me, like this.

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
ltx-video 0.1.0 requires transformers~=4.44.2, but you have transformers 4.46.3 which is incompatible.
Successfully installed tokenizers-0.20.3 transformers-4.46.3

but after that, custom node for omni gen work without error. if you try to keep transformers 4.44.2 it remove pip error, but this custom node never work. I need to choose one of these 2.

@aalleexx5
Copy link

I got it to work thanks to tokitoki22. I changed the file "required.txt" to

torch>=2.0.0
numpy>=1.26.0
pillow>=10.0.0
huggingface_hub
requests>=2.31.0
transformers==4.46.3
accelerate>=0.26.0
einops>=0.6.0
safetensors>=0.3.0

and then ran it again. I did see the pip error but I don't know how that affects other things.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@aaronkingdom @tokitoki22 @Ossenbrugge @aalleexx5 @artishtic @izonewonyoung