Add support for new Black Forest's model (Flux)

[mrrfr]

Feature request

Hello Guys,

The new model of Black Forest Labs is very nice (https://huggingface.co/black-forest-labs/FLUX.1-schnell) It have already been adopted to diffusers (https://github.com/huggingface/diffusers/tree/926daa30f977a75c01b835405c1878730388cb94/src/diffusers/pipelines/flux)

I've tried something on my own, but nothing successful.

Motivation

Flux is actually the best model for txt2img, I've tried whole the weekend to adapt it for inf2 with neuronx but nothing successful.

Your contribution

So far, none of the work done can be shared as I have only encountered failures.

Thank u & Have a nice day :))

[JingyaHuang]

Thanks @mrrfr for raising the issue. There will be soon some updates on diffusion transformer support with Neuron SDK. Happy to support flux in Optimum Neuron by this time, and all contribution is very welcomed!

[HuggingFaceDocBuilderDev]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!

[HuggingFaceDocBuilderDev]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Thank you!

[yahavb]

We would like to see that too.

[Suprhimp]

Does this feature will be add soon?

[JingyaHuang]

Flux will be the next (after pixart #731 ) diffusion model that we will support. @Suprhimp