Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

importing a custom dictionary #88

Open
eroux opened this issue Jan 9, 2022 · 1 comment
Open

importing a custom dictionary #88

eroux opened this issue Jan 9, 2022 · 1 comment
Assignees

Comments

@eroux
Copy link
Contributor

eroux commented Jan 9, 2022

There's some documentation about "custom dialect pack", which I guess is what I want (I want to use a custom, smaller dictionary). But it's very bare and doesn't give any example... how can I have pybo tokenize according to a list of words in a txt file?

@kaldan007
Copy link
Contributor

https://github.com/Esukhia/botok/blob/master/README.md
solution has been updated in read me

@10zinten 10zinten reopened this Jan 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants