You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
1. I have searched related issues but cannot get the expected help.
2. The bug has not been fixed in the latest version.
3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.
terminate called after throwing an instance of 'std::runtime_error'what(): [TM][ERROR] pointer_mapping_ does not have information of ptr at 0x150ffa3000. Assertion fail: /opt/lmdeploy/src/turbomind/utils/allocator.h:284
Checklist
Describe the bug
使用
v0.6.0
和v0.6.4
版本在 RTX4090 机器上推理internlm2_5-20b-chat
openmmlab/lmdeploy:v0.6.0-cu12
openmmlab/lmdeploy:v0.6.4-cu12
Reproduction
2卡4090启动命令
--max-batch-size 64
--tp 2
4卡4090启动命令
--max-batch-size 128
--tp 4
Environment
Error traceback
The text was updated successfully, but these errors were encountered: