Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmark the filter as a 'server' #1

Open
lemire opened this issue Apr 10, 2019 · 2 comments
Open

Benchmark the filter as a 'server' #1

lemire opened this issue Apr 10, 2019 · 2 comments

Comments

@lemire
Copy link
Member

lemire commented Apr 10, 2019

Instead of issuing a single query against the filter, we should issue several.

@lemire lemire changed the title Benchmark the filter act as a 'server' Benchmark the filter as a 'server' Jan 18, 2020
@oschonrock
Copy link
Contributor

I have now integrated my binfuse wrapper of binary_fuse(8|16)_filters into my pawned password project

I put together some top-level metrics of "storage" vs "false +ve rate" vs "query performance"

image

The performance figures for binfuse are off the scale really, and if there is enough RAM to cache the mmap, then actually that 100,000queries/s is far too small. It's actually that the apache bench is topping out at 100% CPU, and I can't measure it, without using more complex instrumentation. The load is all in generating and handling the http requests, not in running the binfuse->contain() queries.

I have run bulk queries in my binfuse benchmark without the overhead of a client/server/protocol and those were ~50ns, ie ~20million queries/s

@lemire
Copy link
Member Author

lemire commented Dec 19, 2024

!!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants