You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
# Project #19: Segmentation of sparse bacteria in human tissue
3
7
4
8
5
9
## Project Overview
6
10
7
11
This repository contains the code and notebooks for preparing ground truth data for training, training a 3D Stardist model, and then use it on unseen data for **Sparse bacteria segmentation in tissue samples**.
8
12
The project implements deep learning approaches for automated detection and segmentation of bacterial cells in complex tissue environments using 3D microscopy data.
9
-
Developed as part of the [AI4Life project](https://ai4life.eurobioimaging.eu), it uses data provided by ***.
13
+
Developed as part of the [AI4Life project](https://ai4life.eurobioimaging.eu), it uses data provided by Sebastien Herbert from University of Basel in Switzerland.
10
14
All images used in this tutorial are licensed under **CC-BY**. If any of the instructions are not working, please [open an issue]
11
15
12
16
@@ -22,9 +26,9 @@ The main goal is to develop robust AI models for:
22
26
```
23
27
AI4LIfe_OC_StaphInTissue/
24
28
├── notebooks/
25
-
│ ├── 0_dataset_split_train_test.ipynb # Dataset preparation and splitting
- Handling of touching/overlapping bacteria labeled as a single instance
63
67
- Application of watershed algorithm for improved instance labeling
64
68
65
-
### 3. Data Preprocessing (`0.2_train_dataset_normalize_crop.ipynb`)
66
-
- Image normalization and cropping
67
-
-Preparation of training dataset for StarDist 3D model
68
-
-Reduction of empty background regions to optimize training efficiency
69
+
### 3. Data Preprocessing (`0.3_normalize_and_crop.ipynb`)
70
+
- Image normalization and cropping, needed **only for the training data** due to its large size
71
+
-Cropping considers regions with bacteria to balance the ratio of empty background regions and optimize training efficiency
72
+
-This step is required to avoid the time consuming processing in the dataloaders during training, this step in not needed for the testing data nor inference as it is integrated in the prediction functions
69
73
70
74
### 4. Model Training (`StarDist_3D_DL4MicEverywhere_Modified_AI4LifeOC.ipynb`)
71
-
- StarDist 3D model implementation
75
+
-DL4MicEverywhere StarDist 3D model training, validation, and inference
72
76
- Custom modifications for large image handling
73
-
- Training and validation procedures
74
-
- Model evaluation and quality control
75
-
76
-
## 🔬 Methodology
77
-
78
-
The project utilizes **StarDist 3D**, a state-of-the-art deep learning approach for:
79
-
- Star-convex object detection in 3D microscopy images
80
-
- Accurate segmentation of spherical bacterial cells
81
-
- Instance segmentation for overlapping objects
82
77
83
-
### Key Features:
84
-
-**3D segmentation**: Full volumetric processing of microscopy stacks
Use the trained model section in the main notebook to process new images.
115
86
116
87
## 📚 References
117
88
118
-
- Schmidt, U., et al. "Cell detection with star-convex polygons." MICCAI 2018.
119
-
- Weigert, M., et al. "Star-convex polyhedra for 3d object detection and segmentation in microscopy." WACV 2020.
120
-
- von Chamier, L., et al. "Democratising deep learning for microscopy with ZeroCostDL4Mic." Nature Communications 2021.
89
+
- Schmidt, Uwe, et al. "Cell detection with star-convex polygons." International conference on medical image computing and computer-assisted intervention. Cham: Springer International Publishing, 2018.
90
+
- Weigert, Martin, et al. "Star-convex polyhedra for 3D object detection and segmentation in microscopy." Proceedings of the IEEE/CVF winter conference on applications of computer vision. 2020.
91
+
- Von Chamier, Lucas, et al. "Democratising deep learning for microscopy with ZeroCostDL4Mic." Nature communications 12.1 (2021): 2276.
92
+
- Hidalgo-Cenalmor, Iván, et al. "DL4MicEverywhere: deep learning for microscopy made flexible, shareable and reproducible." Nature methods 21.6 (2024): 925-927.
121
93
122
94
## Acknowledgements
123
95
AI4Life has received funding from the European Union’s Horizon Europe research and innovation programme under grant agreement number 101057970. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or the European Research Council Executive Agency. Neither the European Union nor the granting authority can be held responsible for them.
0 commit comments