Update v1.7.0
Bug fixes
- Fix UI breaking on latest gradio (fixed by @hounddogie)
- Fix dynamic VRAM reallocation (reported and fixed by @phr00t, issue #17)
- Attempt to fix incompatibility with other extensions which modify output too (e.g. Alltalk TTS, reported by @guispfilho, issue #18)
Misc
- JSON logits: switch to an implementation based on Outlines (used by tool mode via
tool_mode_force_json_output_enabled). Still WIP and probably not working correctly. Experimental and not recommended yet.
Special thanks to @phr00t and @hounddogie for their contributions.
DOWNLOAD AND INSTALLATION INSTRUCTIONS HERE
Contributors
phr00t, guispfilho, and hounddogie