Code

Efficient Replace normalizer#1413

Code

Merged

Narsil merged 7 commits intohuggingface:mainhuggingface/tokenizers:mainfrom rlrs:efficient-replacerlrs/tokenizers:efficient-replaceCopy head branch name to clipboardFeb 6, 2024

+84-20

Commits

Commits on Dec 12, 2023

• new Replace work

  rlrs

  committed
  320a5f4

  Copy full SHA for 320a5f4

• clean up

  rlrs

  committed
  41834c3

  Copy full SHA for 41834c3

• clean up

  rlrs

  committed
  0f797ba

  Copy full SHA for 0f797ba

• Merge branch 'efficient-replace' of github.com:rlrs/tokenizers into efficient-replace

  rlrs

  committed
  fae12dd

  Copy full SHA for fae12dd

• typo

  rlrs

  committed
  958b3a5

  Copy full SHA for 958b3a5

Commits on Dec 19, 2023

• cargo fmt

  rlrs

  committed
  48255f5

  Copy full SHA for 48255f5

Commits on Feb 6, 2024

• Clippy.

  Narsil

  committed
  d10aacb

  Copy full SHA for d10aacb