Skip to content
This repository has been archived by the owner on Dec 10, 2023. It is now read-only.

Addition of Text Editor for depth map (for crisp text generation) #46

Open
iliasiovis opened this issue Feb 26, 2023 · 0 comments
Open
Labels
enhancement New feature or request

Comments

@iliasiovis
Copy link

iliasiovis commented Feb 26, 2023

Is your feature request related to a problem? Please describe.
Text generation with stable diffusion is an issue with random letters an shapes appearing instead of clear words.
Using ControlNet, if we add a "fake" depth map with our white text on black background, and an inpainting mask for the space we want the text to appear in (should be the same spot on the fake depth map), we can have crisp, clean text based on our prompt.

Describe the solution you'd like
I saw that Fabric.js already has Text tools in its library, so maybe adding a small text editor (font size, font family dropdown) with the ability to drag and resize the text on the canvas to send it as a depth map to inpainting and controlnet, could allow us to have consistent text without the need of photoshop or other photo editors.

Additional context
here is the technique of using depth maps for clear text: https://www.youtube.com/watch?v=1jBnGx72mpg
also leaving this jsfiddle here as an example https://jsfiddle.net/gislef/Lvfpq57h/
But maybe all of this should be a separate project on github / tab on a1111

@iliasiovis iliasiovis added the enhancement New feature or request label Feb 26, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant