Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Sana] Add Sana, including SanaPipeline, SanaPAGPipeline, LinearAttentionProcessor, Flow-based DPM-sovler and so on. #9982

Open
wants to merge 85 commits into
base: main
Choose a base branch
from

Commits on Oct 18, 2024

  1. Configuration menu
    Copy the full SHA
    6e616a9 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Configuration menu
    Copy the full SHA
    d2e187a View commit details
    Browse the repository at this point in the history
  2. DC-AE init

    chenjy2003 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    90e8939 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    825c975 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    3a44fa4 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Configuration menu
    Copy the full SHA
    55b2615 View commit details
    Browse the repository at this point in the history
  2. merge

    chenjy2003 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    6fb7fdb View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    c323e76 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    da7caa5 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    fb6d92a View commit details
    Browse the repository at this point in the history
  6. iinherit from ModelMixin

    chenjy2003 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    5e63a1a View commit details
    Browse the repository at this point in the history
  7. inherit from ConfigMixin

    chenjy2003 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    72cce2b View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. dc-ae reduce to one file

    chenjy2003 committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    8f9b4e4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b7f68f9 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. Configuration menu
    Copy the full SHA
    6d96b95 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2024

  1. Merge remote-tracking branch 'refs/remotes/origin/main' into DC-AE

    # Conflicts:
    #	src/diffusers/models/normalization.py
    lawrence-cj committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    3c3cc51 View commit details
    Browse the repository at this point in the history
  2. 1. add DCAE into diffusers;

    2. make style and make quality;
    lawrence-cj committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    3b18ef4 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a62bd75 View commit details
    Browse the repository at this point in the history
  4. bug fixed;

    lawrence-cj committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    09c6c00 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    b9741af View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    4df1722 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    8a7b24d View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    d1b4834 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    2416c77 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    ce24e41 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. code update;

    lawrence-cj committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    e7193b4 View commit details
    Browse the repository at this point in the history
  2. code update;

    lawrence-cj committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    e78bdb5 View commit details
    Browse the repository at this point in the history
  3. code update;

    lawrence-cj committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    a1ef876 View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2024

  1. Configuration menu
    Copy the full SHA
    1448681 View commit details
    Browse the repository at this point in the history
  2. merge

    chenjy2003 committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    bf40fe8 View commit details
    Browse the repository at this point in the history
  3. clean code

    chenjy2003 committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    dd7718a View commit details
    Browse the repository at this point in the history
  4. support DecoderOutput

    chenjy2003 committed Nov 9, 2024
    Configuration menu
    Copy the full SHA
    19986a5 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    3481e23 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2024

  1. Configuration menu
    Copy the full SHA
    c93de40 View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. 🎉[important update]

    1. Integrate flow-dpm-sovler into diffusers;
    2. finally run successfully on both `FlowMatchEulerDiscreteScheduler` and `FlowDPMSolverMultistepScheduler`;
    lawrence-cj committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    7d8a0e8 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. Configuration menu
    Copy the full SHA
    0e818df View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. Configuration menu
    Copy the full SHA
    c6eb233 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    59de0a3 View commit details
    Browse the repository at this point in the history
  3. update ResBlock

    chenjy2003 committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    ea604a4 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    80dce02 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2024

  1. 🎉🔧[important update & fix huge bugs!!]

    1. add SanaPAGPipeline & several related Sana linear attention operators;
    2. `SanaTransformer2DModel` not supports multi-resolution input;
    2. fix the multi-scale HW bugs in SanaPipeline and SanaPAGPipeline;
    3. fix the flow-dpm-solver set_timestep() init `model_output` and `lower_order_nums` bugs;
    lawrence-cj committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    e2f9614 View commit details
    Browse the repository at this point in the history
  2. remove prints;

    lawrence-cj committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    38af130 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2024

  1. Update src/diffusers/models/autoencoders/dc_ae.py

    Co-authored-by: YiYi Xu <[email protected]>
    lawrence-cj and yiyixuxu authored Nov 16, 2024
    Configuration menu
    Copy the full SHA
    1752afd View commit details
    Browse the repository at this point in the history
  2. remove opsequential

    chenjy2003 committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    883bcf4 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    25ae389 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    96e844b View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    59b6e25 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    7ce9ff2 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    30d6308 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    cab56b1 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2024

  1. remove reset_parameters for RMSNorm2d

    Co-authored-by: YiYi Xu <[email protected]>
    chenjy2003 and yiyixuxu authored Nov 20, 2024
    Configuration menu
    Copy the full SHA
    b42bb54 View commit details
    Browse the repository at this point in the history
  2. remove device and dtype in RMSNorm2d __init__

    Co-authored-by: YiYi Xu <[email protected]>
    chenjy2003 and yiyixuxu authored Nov 20, 2024
    Configuration menu
    Copy the full SHA
    2e04a99 View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2024

  1. Update src/diffusers/models/autoencoders/dc_ae.py

    Co-authored-by: YiYi Xu <[email protected]>
    lawrence-cj and yiyixuxu authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    b4f75f2 View commit details
    Browse the repository at this point in the history
  2. Update src/diffusers/models/autoencoders/dc_ae.py

    Co-authored-by: YiYi Xu <[email protected]>
    lawrence-cj and yiyixuxu authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    c82f828 View commit details
    Browse the repository at this point in the history
  3. Update src/diffusers/models/autoencoders/dc_ae.py

    Co-authored-by: YiYi Xu <[email protected]>
    lawrence-cj and yiyixuxu authored Nov 21, 2024
    Configuration menu
    Copy the full SHA
    22ea5fd View commit details
    Browse the repository at this point in the history
  4. Merge branch 'refs/heads/main' into DC-AE-Sana

    # Conflicts:
    #	src/diffusers/models/__init__.py
    #	src/diffusers/models/attention_processor.py
    lawrence-cj committed Nov 21, 2024
    Configuration menu
    Copy the full SHA
    5ef535e View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    d00f1cd View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2024

  1. Configuration menu
    Copy the full SHA
    4f5cbb4 View commit details
    Browse the repository at this point in the history
  2. remove build_stage_main

    chenjy2003 committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    2f6bbad View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    363a8b3 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    3663d55 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    9e0bc7e View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    495e847 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    24cd066 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    ec55777 View commit details
    Browse the repository at this point in the history
  9. Update src/diffusers/pipelines/sana/pipeline_sana.py

    Co-authored-by: Steven Liu <[email protected]>
    lawrence-cj and stevhliu authored Nov 26, 2024
    Configuration menu
    Copy the full SHA
    ca8c6ca View commit details
    Browse the repository at this point in the history
  10. Update src/diffusers/pipelines/sana/pipeline_sana.py

    Co-authored-by: Steven Liu <[email protected]>
    lawrence-cj and stevhliu authored Nov 26, 2024
    Configuration menu
    Copy the full SHA
    f14ea61 View commit details
    Browse the repository at this point in the history
  11. Fix prepare latent image ids and vae sample generators for flux (hugg…

    …ingface#9981)
    
    * fix
    
    * update expected slice
    a-r-r-o-w authored and lawrence-cj committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    8c9fb02 View commit details
    Browse the repository at this point in the history
  12. [Tests] skip nan lora tests on PyTorch 2.5.1 CPU. (huggingface#9975)

    * skip nan lora tests on PyTorch 2.5.1 CPU.
    
    * cog
    
    * use xfail
    
    * correct xfail
    
    * add condition
    
    * tests
    sayakpaul authored and lawrence-cj committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    0a03934 View commit details
    Browse the repository at this point in the history
  13. make pipelines tests device-agnostic (part1) (huggingface#9399)

    * enable on xpu
    
    * add 1 more
    
    * add one more
    
    * enable more
    
    * add 1 more
    
    * add more
    
    * enable 1
    
    * enable more cases
    
    * enable
    
    * enable
    
    * update comment
    
    * one more
    
    * enable 1
    
    * add more cases
    
    * enable xpu
    
    * add one more caswe
    
    * add more cases
    
    * add 1
    
    * add more
    
    * add more cases
    
    * add case
    
    * enable
    
    * add more
    
    * add more
    
    * add more
    
    * enbale more
    
    * add more
    
    * update code
    
    * update test marker
    
    * add skip back
    
    * update comment
    
    * remove single files
    
    * remove
    
    * style
    
    * add
    
    * revert
    
    * reformat
    
    * update decorator
    
    * update
    
    * update
    
    * update
    
    * Update tests/pipelines/deepfloyd_if/test_if.py
    
    Co-authored-by: Dhruv Nair <[email protected]>
    
    * Update src/diffusers/utils/testing_utils.py
    
    Co-authored-by: Dhruv Nair <[email protected]>
    
    * Update tests/pipelines/animatediff/test_animatediff_controlnet.py
    
    Co-authored-by: Dhruv Nair <[email protected]>
    
    * Update tests/pipelines/animatediff/test_animatediff.py
    
    Co-authored-by: Dhruv Nair <[email protected]>
    
    * Update tests/pipelines/animatediff/test_animatediff_controlnet.py
    
    Co-authored-by: Dhruv Nair <[email protected]>
    
    * update float16
    
    * no unitest.skipt
    
    * update
    
    * apply style check
    
    * reapply format
    
    ---------
    
    Co-authored-by: Sayak Paul <[email protected]>
    Co-authored-by: Dhruv Nair <[email protected]>
    3 people authored and lawrence-cj committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    788734b View commit details
    Browse the repository at this point in the history
  14. ControlNet from_single_file when already converted (huggingface#9978)

    Co-authored-by: Dhruv Nair <[email protected]>
    2 people authored and lawrence-cj committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    3379031 View commit details
    Browse the repository at this point in the history
  15. Flux Fill, Canny, Depth, Redux (huggingface#9985)

    * update
    
    ---------
    
    Co-authored-by: yiyixuxu <[email protected]>
    Co-authored-by: Sayak Paul <[email protected]>
    3 people authored and lawrence-cj committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    fe2affe View commit details
    Browse the repository at this point in the history
  16. [SD3 dreambooth lora] smol fix to checkpoint saving (huggingface#9993)

    * smol change to fix checkpoint saving & resuming (as done in train_dreambooth_sd3.py)
    
    * style
    
    * modify comment to explain reasoning behind hidden size check
    linoytsaban authored and lawrence-cj committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    b8c5403 View commit details
    Browse the repository at this point in the history
  17. [Docs] add: missing pipelines from the spec. (huggingface#10005)

    add: missing pipelines from the spec.
    sayakpaul authored and lawrence-cj committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    4bbd4a5 View commit details
    Browse the repository at this point in the history
  18. Add prompt about wandb in examples/dreambooth/readme. (huggingface#10014

    )
    
    Add files via upload
    SkyCol authored and lawrence-cj committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    f3df07b View commit details
    Browse the repository at this point in the history
  19. Merge remote-tracking branch 'refs/remotes/origin/main' into DC-AE-Sana

    # Conflicts:
    #	src/diffusers/__init__.py
    lawrence-cj committed Nov 26, 2024
    Configuration menu
    Copy the full SHA
    29e93b7 View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    4495783 View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2024

  1. Configuration menu
    Copy the full SHA
    4d3c026 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e007057 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d3d9c84 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1f08631 View commit details
    Browse the repository at this point in the history
  5. Merge branch 'refs/heads/DC-AE' into DC-AE-Sana

    # Conflicts:
    #	src/diffusers/models/autoencoders/dc_ae.py
    lawrence-cj committed Nov 28, 2024
    Configuration menu
    Copy the full SHA
    c67753e View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    23f780f View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    ea4cfc5 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    996606e View commit details
    Browse the repository at this point in the history