GPU support for Qdrant

[aksh-wot]

I want to use GPU for vector matching. Can we use GPU for vector matching and indexing for faster results.

[generall]

Hi @aksh-wot, according to our benchmarks, there are no significant speedup considering the price of GPU.
The only place where it can do the difference is linear search (at least I didn't see any implementations which would provide meaningful GPU support for HNSW).

We will continue to investigate possibilities from our side, but the results are expected not earlier than second half of 2024

[vmarchenkoff]

Hi! Any updates on this? We noticed enabling GPU support in Dockerfile, does it mean gpu utilization for vector search?

Thank you!

[timvisee]

Almost, for vector indexing - more details later!

[vmarchenkoff]

Thank you for such a quick response, we will follow the announcements!

[timvisee]

@vmarchenkoff More information here! 😄

https://qdrant.tech/blog/qdrant-1.13.x/