Update SD1.5 TI embedding output format #103
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR addresses #100 (based on the Discord discussion here: https://discord.com/channels/1020123559063990373/1130288610520875049/1227012392416841789 )
Prior to this change, invoke-training produces TI embeddings for SD1.5 in a format based on diffusers with the main key being the placeholder token:
This format is currently failing to import into InvokeAI via the Model Manager. I suspect that this is caused by a change in behaviour during the recent MM refactor, but I haven't gone to the effort to try and confirm this.
The old diffusers format is not very popular, so instead I have switched invoke-training to use a different format, which uses
"emb_params"
as the main state_dict key.Note that only SD1.5 is affected. The format used for SDXL TI embeddings is unchanged.