Skip to content

2024.0.0.0
Compare
Choose a tag to compare
@apaniukov apaniukov released this 21 Mar 14:38
· 2 commits to releases/2024/0 since this release
2024.0.0.0
aa0587d
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • Improve Regex Support - filter lookarounds, unsupported by re2
  • Improve model coverage - T5 tokenizers, QWEN2
  • Add tokenizer metadata to rt_info - EOS token id
  • Support TensorFlow Text MUSE model conversion and inference

New Contributors

Contributors

Wovchena
Assets 2
Loading