Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

arch-210-silo-write-combiner #52

Merged
merged 1 commit into from
Nov 19, 2024

Conversation

jimmyaxod
Copy link
Contributor

This introduces a component we can use to combine writes from different sources, with different priorities.

Consider a migration. On the destination, if we are using S3 assisted, we essentially end up with 3 sources for writes.

  1. Local writes (Should have highest priority)
  2. Dirty blocks coming from source p2p
  3. Blocks we are grabbing from S3

This component will allow us to reconcile these 3 sources of writes.

This is a more general form of waitingCache, and there is crossover, but that will be addressed in a later PR.

@jimmyaxod jimmyaxod changed the title Initial impl of WriteCombinator arch-210-silo-write-combiner Nov 18, 2024
@jimmyaxod jimmyaxod force-pushed the jamesmoore/arch-210-silo-write-combiner branch from d004406 to 1dce9fe Compare November 19, 2024 17:19
@jimmyaxod jimmyaxod merged commit a54a0e2 into main Nov 19, 2024
4 checks passed
@jimmyaxod jimmyaxod deleted the jamesmoore/arch-210-silo-write-combiner branch November 19, 2024 17:21
@github-actions github-actions bot locked and limited conversation to collaborators Nov 19, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant