Skip to content

[CB] Split token streaming and generation to different threads for all CB based pipelines #6000

[CB] Split token streaming and generation to different threads for all CB based pipelines

[CB] Split token streaming and generation to different threads for all CB based pipelines #6000

Annotations

1 error

Download OpenVINO package

succeeded Jan 23, 2025 in 4s