Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: implement best effort reply #25

Merged
merged 3 commits into from
Nov 15, 2023
Merged

Conversation

Oleksii-Klimov
Copy link
Collaborator

No description provided.

(cherry picked from commit bb46c396ac405fd4157a6a30a315d6c42caed44e)
adubovik
adubovik previously approved these changes Nov 15, 2023
@Oleksii-Klimov
Copy link
Collaborator Author

Oleksii-Klimov commented Nov 15, 2023

/deploy-review

Deployment status: something went wrong

@Oleksii-Klimov Oleksii-Klimov merged commit 5eed77a into development Nov 15, 2023
4 checks passed
@Oleksii-Klimov Oleksii-Klimov deleted the best-effort-reply branch November 15, 2023 16:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support best effort response in case model wasted all the tokens
2 participants