-
sentence_size为200,发现检索返回的结果长度都很短,ChineseTextSplitter切分方式是否需要进一步优化? # text splitter
SENTENCE_SIZE: 200 |
Beta Was this translation helpful? Give feedback.
Answered by
SWHL
May 8, 2024
Replies: 1 comment 1 reply
-
|
Beta Was this translation helpful? Give feedback.
1 reply
Answer selected by
SWHL
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
SENTENCE_SIZE
参数是当当前语句长度大于200时,才会触发文本切分。从你给的结果来看,文档正常读取后长度就是这么短。