Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

do we run into Groq rate limits #188

Open
kjappelbaum opened this issue Dec 20, 2024 · 2 comments
Open

do we run into Groq rate limits #188

kjappelbaum opened this issue Dec 20, 2024 · 2 comments
Assignees
@MrtinoRG

Comments

@kjappelbaum
Copy link
Contributor

I think I ran into some when using the choosing_paradigm notebook now. Do you think we should add a note or when a sleep, @MrtinoRG?
@kjappelbaum
Copy link
Contributor Author

it seems that with the default llama we have there now sleeps of 2s would be good and perhaps we should implement them and then add a note that one can change that for different rate liimits

@MrtinoRG
Copy link
Contributor

Yes, I think they considerably decreased the rate limits for the free plan, so yeah it probably needs some sleeps

@MrtinoRG MrtinoRG self-assigned this Dec 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@MrtinoRG MrtinoRG

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@kjappelbaum @MrtinoRG