Full model always needed?

[samedii]

Is the full model needed before adding the quantization? It would be nice if it wasn't but maybe it's hard to avoid.

At the moment the full model is downloaded when the pipeline is loading even thought I have already prepared the quantized model locally.

[lmxyy]

It is not necessary. We will avoid loading it in the next release.

[Cannerd-Staff-Admin]

Can we delete the original BFL flux models after the pipeline has loaded? Or are they required for some part of the quantization setup/execution?

[samedii]

I could close this but might be good to leave up for others who are wondering until the next release? :)

[lmxyy]

Can we delete the original BFL flux models after the pipeline has loaded? Or are they required for some part of the quantization setup/execution?

Probably not for now. Everytime you load the model, it will redownload the model again.

[Cannerd-Staff-Admin]

Confirmed, yes it does :S Great thanks for your work! It's quite impressive!