New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

基于lora的方式finetune模型后，推理时间很长 #80

Open

wangjiangyue0226 opened this issue Aug 22, 2023 · 0 comments

wangjiangyue0226 commented Aug 22, 2023

基于lora的方式finetune模型后，推理时间很长，平均时间要40s，而相同的case直接用chatglm-6b推理平均时间要16s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment