You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
Installed Tabby in my local and while Code completion seems to work, the chat feature keep showing the following error for each prompt:
The server is running with a chat model and it's connected. I run the server using following command and server seems running tabby serve --device metal --model StarCoder-1B --chat-model Qwen2-1.5B-Instruct. But the chat part is keep failing and I don't see any errors in the output panel either.
Information about your version
tabby 0.23.0
Information about your GPU
Graphics/Displays:
Apple M1 Pro:
Chipset Model: Apple M1 Pro
Type: GPU
Bus: Built-In
Total Number of Cores: 16
Vendor: Apple (0x106b)
Metal Support: Metal 3
Displays:
Color LCD:
Display Type: Built-in Liquid Retina XDR Display
Resolution: 3456 x 2234 Retina
Main Display: Yes
Mirror: Off
Online: Yes
Automatically Adjust Brightness: Yes
Connection Type: Internal
The text was updated successfully, but these errors were encountered:
Hi - could you use the Webview Developer Tools to inspect the error inside chat panel?
Hi @wsxiaoys - there's no error, after sending a prompt, it will send a graphql query which is a success ( 200 OK ) and 5 calls to ws://127.0.0.1:8080/subscriptions with type:"connection_init" which all of them are 101 Switching Protocols and lastly I see that error in chat box, but no network error shown
Also nothing in console logs and inspect the element is just show the same error
Describe the bug
Installed Tabby in my local and while Code completion seems to work, the chat feature keep showing the following error for each prompt:
The server is running with a chat model and it's connected. I run the server using following command and server seems running
tabby serve --device metal --model StarCoder-1B --chat-model Qwen2-1.5B-Instruct
. But the chat part is keep failing and I don't see any errors in the output panel either.Information about your version
tabby 0.23.0
Information about your GPU
Graphics/Displays:
The text was updated successfully, but these errors were encountered: