feat: add codeToTokens API, rename codeToThemedTokens to codeToTokensBase
#37
| Job | Run time |
|---|---|
| 1m 6s | |
| 1m 29s | |
| 31s | |
| 2m 11s | |
| 2m 8s | |
| 1m 40s | |
| 1m 29s | |
| 10m 34s |