-
Notifications
You must be signed in to change notification settings - Fork 2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
compact into a CSR #52
Conversation
41df91f
to
d6c6c37
Compare
A little bit more on my thinking here: Our ingestion/compaction right now is slower than rebuilding the CSR from an adjacency vector. That's wild and means the contention on the atomic variable is really hurting our ability to do copies in parallel. This PR is a bet that it pays off to just CSR-ify the graph now and get the optimization benefits for workloads like triangle counting. If we had more time, I would also change the ingestion logic to take an entire batch at once, and regularize it into a CSR to just directly append on the log. Unfortunately I don't think we have time to retool that. |
621c447
to
4f7dd0e
Compare
2fb3af4
to
562ba70
Compare
This PR:
|
LS_CSR compaction is already slow. We might as well re-build the CSR into an actual, bona-fide CSR.