Optimize byte pair merge for really big tokens (40x faster for a 2500 token word) #219
| Job | Run time |
|---|---|
| 24s | |
| 22m 5s | |
| 3m 27s | |
| 23m 23s | |
| 3m 37s | |
| 23m 9s | |
| 3m 28s | |
| 23m 50s | |
| 3m 31s | |
| 22m 11s | |
| 3m 36s | |
| 3m 40s | |
| 3m 54s | |
| 4m 2s | |
| 4m 3s | |
| 4m 2s | |
| 3m 27s | |
| 2m 51s | |
| 3m 16s | |
| 3m 27s | |
| 4m 14s | |
| 2h 49m 37s |