Skip to content

Latest commit

 

History

History
49 lines (34 loc) · 2.4 KB

README.md

File metadata and controls

49 lines (34 loc) · 2.4 KB
Raw

ComfyUI-LTXVideo

ComfyUI-LTXVideo is a collection of custom nodes for ComfyUI designed to integrate the LTXVideo diffusion model. These nodes enable workflows for text-to-video, image-to-video, and video-to-video generation. The main LTXVideo repository can be found here.

22.12.2024

Fixed a bug which caused the model to produce artifacts on short negative prompts when using a native CLIP Loader node.

19.12.2024 ⭐ Update ⭐

  1. Improved model - removes "strobing texture" artifacts and generates better motion. Download from here.
  2. STG support
  3. Integrated image degradation system for improved motion generation.
  4. Additional initial latent optional input to chain latents for high res generation.
  5. Image captioning in image to video flow.

Installation

Installation via ComfyUI-Manager is preferred. Simply search for ComfyUI-LTXVideo in the list of nodes and follow installation instructions.

Manual installation

  1. Install ComfyUI
  2. Clone this repository to custom-nodes folder in your ComfyUI installation directory.
  3. Install the required packages:
cd custom_nodes/ComfyUI-LTXVideo && pip install -r requirements.txt

For portable ComfyUI installations, run

.\python_embeded\python.exe -m pip install -r .\ComfyUI\custom_nodes\ComfyUI-LTXVideo\requirements.txt

Models

  1. Download ltx-video-2b-v0.9.1.safetensors from Hugging Face and place it under models/checkpoints.
  2. Install one of the t5 text encoders, for example google_t5-v1_1-xxl_encoderonly. You can install it using ComfyUI Model Manager.

Example workflows

Note that to run the example workflows, you need to have some additional custom nodes, like ComfyUI-VideoHelperSuite and others, installed. You can do it by pressing "Install Missing Custom Nodes" button in ComfyUI Manager.

Image-to-video

Download workflow workflow

Text-to-video

Download workflow workflow