Skip to content

Commit 6a3a221

Browse files
committed
Add more figures
1 parent d029423 commit 6a3a221

File tree

2 files changed

+22
-0
lines changed

2 files changed

+22
-0
lines changed

paper/paper.bib

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -55,3 +55,11 @@ @article{Gutman2017
5555
month = oct,
5656
pages = {e75–e78}
5757
}
58+
59+
@misc{TCGAData,
60+
author = {National Cancer Institute and National Human Genome Research Institute},
61+
title = {The Cancer Genome Atlas (TCGA) Program},
62+
year = {2022},
63+
url = {https://www.cancer.gov/tcga},
64+
note = {Accessed: 2022-11-10]}
65+
}

paper/paper.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -62,8 +62,22 @@ For development, the initial segmentation uses superpixels generated with the SL
6262

6363
We had a placental pathologist provide feedback to validate the efficiency of the user interface and utility of the process.
6464

65+
# Basic Workflow
66+
67+
When starting a new labeling project, the user selects how superpixels are generated, which certainty metric is used for determining the optimal labeling order, and what features are used for model training. The labeling mode allows defining project labels and performing initial labeling. This mode can also be used to add new label categories or combine two categories if they should not have been distinct.
68+
69+
![The Bulk Labeling interface showing one of the project images divided into superpixels with some categories defined. A user can "paint" areas with known labels as an initial seed for the guided labeling process](../docs/screenshots/initial_labels.png)
70+
71+
Once some segments have been labeled and an initial training process has been performed, additional segments are shown with their predictions. The user can use keyboard shortcuts or the mouse to confirm or correct labels. These are presented in an order that maximizes the utility of improving the model based on the originally selected certainty metric.
72+
6573
![The Guided Labeling interface showing a row of superpixels to be labeled and part of a whole slide image](../docs/screenshots/active_learning_view.png)
6674

75+
To check on overall behavior or correct mistakes, there is a review mode that allows seeing all labeled segments with various filtering and sorting options. This can be used to check agreement between pathologists or determine how well the model agrees with the manually labeled data.
76+
77+
![The Review interface showing labeled superpixels in each category](../docs/screenshots/reviewmode.png)
78+
79+
The whole slide image data in these figures are from data generated by the TCGA Research Network [@TCGA].
80+
6781
# Acknowledgements
6882

6983
This work has been funded in part by National Library of Medicine grant 5R01LM013523 entitled "Guiding humans to create better labeled datasets for machine learning in biomedical research".

0 commit comments

Comments
 (0)