This repository has been archived by the owner on Dec 10, 2023. It is now read-only.
Addition of Text Editor for depth map (for crisp text generation) #46
Labels
enhancement
New feature or request
Is your feature request related to a problem? Please describe.
Text generation with stable diffusion is an issue with random letters an shapes appearing instead of clear words.
Using ControlNet, if we add a "fake" depth map with our white text on black background, and an inpainting mask for the space we want the text to appear in (should be the same spot on the fake depth map), we can have crisp, clean text based on our prompt.
Describe the solution you'd like
I saw that Fabric.js already has Text tools in its library, so maybe adding a small text editor (font size, font family dropdown) with the ability to drag and resize the text on the canvas to send it as a depth map to inpainting and controlnet, could allow us to have consistent text without the need of photoshop or other photo editors.
Additional context
here is the technique of using depth maps for clear text: https://www.youtube.com/watch?v=1jBnGx72mpg
also leaving this jsfiddle here as an example https://jsfiddle.net/gislef/Lvfpq57h/
But maybe all of this should be a separate project on github / tab on a1111
The text was updated successfully, but these errors were encountered: