New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

分词后的结果如何还原 #1010

Open

520jefferson opened this issue Jan 26, 2024 · 0 comments

520jefferson commented Jan 26, 2024 •

edited

Loading

当前语料被jieba分词分过了，但是我想还原一下，又不能简单的替换空格，因为有中英文混杂的情况，英文需要空格。
此外，时间，数字或者网址被切开等等情况又该如何处理也是个问题，

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment