Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bpe clones #1707

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open

Bpe clones #1707

wants to merge 6 commits into from

Conversation

sftse
Copy link
Contributor

@sftse sftse commented Dec 28, 2024

This PR tightens up the allocations by a bit. It's unlikely there are any juicy gains here, but the changes also happen to lead to terser, more clear code, so this might be an uncontroversial win.

@sftse sftse changed the title Bpe clones WIP: Bpe clones Dec 28, 2024
@sftse sftse marked this pull request as draft December 28, 2024 18:24
@sftse sftse marked this pull request as ready for review December 29, 2024 13:54
@sftse sftse changed the title WIP: Bpe clones Bpe clones Dec 29, 2024
@sftse
Copy link
Contributor Author

sftse commented Dec 30, 2024

It looks like this touches the codepath that lead to the slowdown in #1564, I'll look into whether this is something easy to fix.

@sftse sftse mentioned this pull request Dec 30, 2024
@sftse
Copy link
Contributor Author

sftse commented Jan 3, 2025

Rebased on main to get the new clippy fixes, should fix CI run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant