teaser_compressed.mp4
Brush is a 3D reconstruction engine using Gaussian splatting. It works on a wide range of systems: macOS/windows/linux, AMD/Nvidia/Intel cards, Android, and in a browser. To achieve this, it uses WebGPU compatible tech and the Burn machine learning framework, which has a portable wgpu backend.
Try the (experimental) web demo 
combined_compressed.mp4
Training & Viewing on the web
brush_android_compressed.mp4
Training on a pixel 7
Machine learning for real time rendering has tons of potential, but most ML tools don't align well with it: Rendering requires realtime interactivity, usually involves dynamic shapes, and it's cumbersome to ship apps with large PyTorch/Jax/CUDA deps. The usual fix is to write a separate training and inference application. Brush on the other hand, written in rust using wgpu and burn, can produce simple dependency free binaries, run on nearly all devices, and doesn't require any cumbersome setup.
Brush works with posed image data. It can load COLMAP data or datasets in the Nerfstudio format with a transforms.json. Training is fully supported natively, on mobile, and in a browser*.
It also supports masking images:
- Images with transparency. This will force the final splat to match the transparency of the input.
- A folder of images called 'masks'. This ignores parts of the image that are masked out.
While training you can interact with the scene and see the training dynamics live, and compare the current rendering to training or eval views as the training progresses.
(*To train in your browser, you have to load your dataset a zip).
Brush also works well as a splat viewer, including on the web. It can load normal .ply files. It can also stream in data from a URL (for a web app, simply append ?url=). There's both orbit and flythrough controls.
Brush also can load .zip of splat files to display them as an animation, or a special ply that includes delta frames. This was used for cat-4D and Cap4D!
Brush can be used as a CLI. Run brush --help to get an overview. Every CLI command can work with --with-viewer which also opens the UI, for easy debugging.
rerun_dash_compressed.mp4
While training, additional data can be visualized with the excellent rerun. To install rerun on your machine, please follow their instructions. Open the ./brush_blueprint.rbl in the viewer for best results.
First install rust 1.82+. You can run tests with cargo test --all. Brush uses the wonderful rerun for additional visualizations while training, run cargo install rerun-cli if you want to use it.
Simply cargo run or cargo run --release from the workspace root. Brush can also be used as a CLI, run cargo run --release -- --help to use the CLI directly from source. See the notes about the CLI in the features section.
This project uses trunk to build for the web. Install trunk, and then run trunk serve or trunk serve --release to run a development server.
WebGPU is still a new standard, and as such, only the latest versions of Chrome work currently. The public web demo is registered for the subgroups origin trial. To run it yourself, please enable the "Unsafe WebGPU support" flag in Chrome.
See the more detailed README instructions at crates/brush-android.
| Metric | bicycle | garden | stump | room | counter | kitchen | bonsai | Average |
|---|---|---|---|---|---|---|---|---|
| PSNR ↑ | ||||||||
| inria 30K | 25.25 | 27.41 | 26.55 | 30.63 | 28.70 | 30.32 | 31.98 | 28.69 |
| gsplat 30K | 25.22 | 27.32 | 26.53 | 31.36 | 29.02 | 31.16⭐ | 32.06⭐ | 28.95 |
| brush 30K | 25.55⭐ | 27.42⭐ | 26.88⭐ | 31.45⭐ | 29.17⭐ | 30.55 | 32.02 | 29.01⭐ |
| SSIM ↑ | ||||||||
| inria 30k | 0.763 | 0.863 | 0.771 | 0.918⭐ | 0.906 | 0.925 | 0.941 | 0.870 |
| gsplat | 0.764 | 0.865 | 0.768 | 0.918⭐ | 0.907 | 0.926⭐ | 0.941 | 0.870 |
| brush | 0.781⭐ | 0.869⭐ | 0.791⭐ | 0.916 | 0.909⭐ | 0.920 | 0.942⭐ | 0.875⭐ |
| Splat Count (millions) ↓ | ||||||||
| inira | 6.06 | 5.71 | 4.82 | 1.55 | 1.19 | 1.78 | 1.24 | 3.19 |
| gsplat | 6.26 | 5.84 | 4.81 | 1.59 | 1.21 | 1.79 | 1.25 | 3.25 |
| brush | 3.30⭐ | 2.90⭐ | 2.55⭐ | 0.75⭐ | 0.60⭐ | 0.79⭐ | 0.68⭐ | 1.65⭐ |
| Minutes (4070 ti) | ||||||||
| brush | 35 | 35 | 28 | 18 | 19 | 18 | 18 | 24.43 |
Numbers taken from here. Note that Brush by default regularizes opacity slightly.
Rendering is generally faster than gsplat, while end-to-end training speeds are similar. You can run benchmarks of some of the kernels using cargo bench. For additional profiling, you can use tracy and run with cargo run --release --feature=tracy.
gSplat, for their reference version of the kernels
Peter Hedman, George Kopanas & Bernhard Kerbl, for the many discussions & pointers.
The Burn team, for help & improvements to Burn along the way
Raph Levien, for the original version of the GPU radix sort.
This is not an official Google product. This repository is a forked public version of the google-research repository
