-
Notifications
You must be signed in to change notification settings - Fork 33
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
80a4c2b
commit 0ef5c85
Showing
6 changed files
with
82 additions
and
34 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,25 @@ | ||
# PlantSeg Pipeline Overview | ||
PlantSeg in a pipeline for 3D cell segmentation. At its core, PlantSeg implements a simple three-step pipeline: | ||
A pre-processing step, a CNN prediction step, and a segmentation step. | ||
|
||
## Pre-Processing | ||
The pre-processing step is used to prepare the input data for the CNN. There are two main operations that can be performed in the pre-processing step. The first is rescaling the input data to match the resolution of the data used for training the neural network. The second is filtering the input data to remove noise. | ||
|
||
## CNN Prediction | ||
The CNN prediction step uses a UNet architecture to predict boundaries. The UNet architecture is a popular architecture for image segmentation tasks. The UNet architecture is a fully convolutional network that is trained to predict boundaries. The UNet architecture is trained on a large dataset of images with known boundaries. The UNet architecture is trained to predict boundaries by minimizing the difference between the predicted boundaries and the true boundaries. | ||
|
||
## Segmentation | ||
The segmentation step implements powerful graph partitioning techniques to obtain a segmentation from the | ||
input stacks. If the predicted boundaries are not satisfactory, a raw image could be used (especially if the cell boundaries are very sharp, and the noise is low) but this usually does not yield satisfactory results. | ||
|
||
The **Algorithm** menu can be used to choose the segmentation algorithm. Available choices are: | ||
1. GASP (average): is a generalization of the classical hierarchical clustering. It usually delivers very | ||
reliable and accurate segmentation. It is the default in PlantSeg. | ||
2. MutexWS: Mutex Watershed is a derivative of the standard Watershed, where we do not need seeds for the | ||
segmentation. This algorithm performs very well in certain types of complex morphology (like ) | ||
3. MultiCut: in contrast to the other algorithms is not based on a greedy agglomeration but tries to find the | ||
optimal global segmentation. This is, in practice, very hard, and it can be infeasible for huge stacks. | ||
4. DtWatershed: is our implementation of the distance transform Watershed. From the input, we extract a distance map | ||
from the boundaries. Based this distance map, seeds are placed at local minima. Then those seeds are used for | ||
computing the Watershed segmentation. To speed up the computation of GASP, MutexWS, and MultiCut, an over-segmentation is obtained using Dt Watershed. | ||
5. Lifted Multicut: This method is based on the Multicut algorithm, but it uses a lifted edges to include addional priors from nuclei. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,3 +1,33 @@ | ||
# PlantSeg Interactive - Napari | ||
The PlantSeg interactive mode is the most interactive way to use PlantSeg. It allows to run all the steps of the pipeline and visualize the results interactively using the [napari](https://napari.org/stable/) viewer. This is the recommended way to use PlantSeg on new data. | ||
|
||
## Overview | ||
In the Napari viewer, the PlantSeg pipeline is divided into 5 main tabs: | ||
1. **Input/Output**: This tab allows to load the input data and to save the results. Moreover contains a simple proofreading tool. | ||
2. **DataProcessing**: This tab allows to preprocess any layer of the input data. Contains all the standard preprocessing steps of PlantSeg, plus some additional steps such as cropping and merging layers. | ||
A detailed description of all the widgets in this tab can be found [here](https://hci-unihd.github.io/plant-seg/chapters/plantseg_interactive_napari/data_processing.md). | ||
3. **PlantSeg Main Workflow**: This tab contains the main PlantSeg pipeline. It allows to run the complete pipeline or to run any of the steps singularly. | ||
A detailed description of all the widgets in this tab can be found [here](https://hci-unihd.github.io/plant-seg/chapters/plantseg_interactive_napari/unet_gasp_workflow.md). | ||
4. **Extra Segmentation**: This tab contains additional segmentation algorithms that can be used in addition to the main pipeline. | ||
A detailed description of all the widgets in this tab can be found [here](https://hci-unihd.github.io/plant-seg/chapters/plantseg_interactive_napari/extra_seg.md). | ||
5. **Extra Predictions**: This tab contains a widget to add addiotional trained models to PlantSeg, and some experimental CNN predictions steps. | ||
A detailed description of all the widgets in this tab can be found [here](https://hci-unihd.github.io/plant-seg/chapters/plantseg_interactive_napari/extra_pred.md). | ||
|
||
## Quick start using the Napari viewer | ||
First, activate the newly created conda environment with: | ||
```bash | ||
conda activate plant-seg | ||
``` | ||
then, start the plantseg in napari | ||
```bash | ||
$ plantseg --napari | ||
``` | ||
![alt text](https://github.com/hci-unihd/plant-seg/raw/assets/images/plantseg_napari.png) | ||
|
||
## Input/Output | ||
|
||
|
||
## Proofreading | ||
|
||
|
||
|
||
TODO |