You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, responses get increasingly slower as the chat context grows. We should implement a gradual rolloff of older queries that get summarized by GPT and then added to the end of the conversation.
This may require some testing to understand the optimal conversation context size based on quality of results and speed to response.
The text was updated successfully, but these errors were encountered:
Currently, responses get increasingly slower as the chat context grows. We should implement a gradual rolloff of older queries that get summarized by GPT and then added to the end of the conversation.
This may require some testing to understand the optimal conversation context size based on quality of results and speed to response.
The text was updated successfully, but these errors were encountered: