You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Depends on #2
Piper currently has to be loaded per invocation. It would be preferable to load it into ram and submit requests to it via http or other messaging protocol, to make invocation easier, and to save on load times.
The text was updated successfully, but these errors were encountered:
JohnnySn0w
changed the title
Load piper into VRAM for persistence (remove model load time)
Load piper into RAM/VRAM for persistence (remove model load time)
Mar 3, 2024
Depends on #2
Piper currently has to be loaded per invocation. It would be preferable to load it into ram and submit requests to it via http or other messaging protocol, to make invocation easier, and to save on load times.
The text was updated successfully, but these errors were encountered: