Login

Forgot password? Request a new one here!

Page navigation

Challenges »
BRATS2012

MICCAI 2012 Challenge on Multimodal Brain Tumor Segmentation

More information can be found at DTU Informatics of the Technical University of Denmark.

Acknowledgements

Brain tumor image data used in this article were obtained from the MICCAI 2012 Challenge on Multimodal Brain Tumor Segmentation ( www.imm.dtu.dk/projects/BRATS2012 )organized by B. Menze, A. Jakab, S. Bauer, M. Reyes, M. Prastawa, and K. van Leemput. The challenge database contain fully anonymized images from the following institutions: ETH Zurich, University of Bern, University of Debrecen, and University of Utah. The data is distributed under a Creative Commons 3.0 license: Attribution-NonCommercial (CC BY-NC)

Citation

The outcome of the BRATS2012 and BRATS2013 challenges has been summarized in the following publication. Authors using the BRATS dataset are kindly requested to cite this work:

  • Menze et al., The Multimodal Brain TumorImage Segmentation Benchmark (BRATS), IEEE Trans. Med. Imaging, 2015.Get the citation as BibTex
  • Kistler et. al, The virtual skeleton database: an open access repository for biomedical research and collaboration. JMIR, 2013. (BibTex)

Registration

You have to use your institutional email address for the registration.
Please note that while you can use non-institutional emails (e.g. Gmail, Hotmail, Yahoo, etc.) your request might be refused depending on the license model of the dataset (e.g. non-commercial use), hence, we recommend using an educational or non-profit account.
Register

Download

Please register to receive an email with your login link and activate your account.


BRATS 2 Challenge data

15 patient datasets and 15 synthetic datasets are available for download:

You need to log in to download the challenge data!

BRATS 2 Training data

30 patient datasets and 50 synthetic datasets including ground truths are available for download:

You need to log in to download the training data!

BRATS 2 Individual Observer Ground-truth data

You need to log in to download the observer ground truth data!

Evaluation

Ground Truth images

All images are stored as signed 16-bit integers, but only positive values are used.

The manual segmentations (Truth) of the patient images have the folloing four different labels:

  • 1 for necrosis
  • 2 for edema
  • 3 for non-enhancing tumor
  • 4 for enhancing tumor
  • 0 for everything else

The groundtruth (Truth) of the syntehtic images has the following two different labesl

  • 1 edema
  • 2 tumor core
  • 0 for everything else

IMPORTANT: There are 3 requirements for the successfull upload and validation of your segmentation

  1. Use the MHA filetype to store your segmentations (not mhd) [use short or ushort if you experience any upload problems]
  2. Keep the same labels as the provided truth.mha: 1 for edema, 2 for active tumor, and 0 for everything else
  3. Name your segmentations according to this template: VSD.your_description.###.mha

    replace the ### with the ID of the corresponding Flair MR images. This allows the system to relate your segmentation to the correct training truth. Download an example list for the training data or challenge data .

Example 1

  • Filename of the High Grade Flair 0001 MR: VSD.Brain.XX.O.MR_Flair.687.mha
  • The VSD-Id would be 687
  • Filename of your segmentation: VSD.Seg_HG_001.687.mha

Example 2

  • Filename of the Low Grade 011 Flair MR: VSD.Brain.XX.O.MR_Flair.835.mha
  • The VSD-Id would be 835
  • Filename of your segmentation: VSD.Seg_LG_011.835.mha

Evaluation details

The evaulation is done for 3 different tumor sub-compartements:

  • Region 1: complete tumor (labels 1+2+3+4 for patient data, labesl 1+2 for synthetic data
  • Region 2: Tumor core (labels 1+3+4 for patient data, label 2 for synthetic data
  • Region 3: Enhancing tumor (label 4 for patient data, n.a. for synthetic data

Evaluation Results: Updated Four-Class Labels - Challenge

Patient

Position User Dice Positive Predictive Value Sensitivity Kappa Complete tumor Rank Tumor core Rank Enhancing tumor Rank
  complete core enhancing complete core enhancing complete core enhancing  
1 xiaoz2 0.83 (1) 0.63 (3) 0.49 (1) 0.90 (1) 0.73 (2) 0.52 (1) 0.79 (12) 0.66 (5) 0.53 (5) 1.00 (1) 3.75 3.00 2.00
2 subbn1 0.75 (11) 0.70 (1) 0.43 (6) 0.69 (16) 0.75 (1) 0.41 (13) 0.90 (1) 0.69 (4) 0.57 (2) 1.00 (10) 9.50 1.75 7.25
3 yangw1 0.82 (2) 0.63 (4) 0.44 (2) 0.79 (9) 0.67 (9) 0.42 (9) 0.87 (2) 0.62 (8) 0.52 (6) 1.00 (5) 4.50 6.50 7.75
4 zhaol1 0.82 (3) 0.66 (2) 0.36 (17) 0.86 (2) 0.72 (4) 0.29 (20) 0.80 (10) 0.73 (3) 0.60 (1) 1.00 (3) 4.50 3.00 12.00
5 buyss1 0.77 (8) 0.48 (13) 0.43 (3) 0.80 (7) 0.67 (8) 0.45 (6) 0.81 (9) 0.46 (16) 0.48 (9) 1.00 (4) 7.00 12.25 5.00
6 menzb3 0.78 (6) 0.58 (5) 0.40 (12) 0.86 (3) 0.71 (6) 0.41 (14) 0.75 (16) 0.58 (10) 0.47 (11) 1.00 (8) 8.25 6.75 14.25
7 testt1 0.75 (9) 0.54 (7) 0.37 (15) 0.84 (5) 0.70 (7) 0.47 (2) 0.71 (18) 0.50 (13) 0.33 (19) 1.00 (9) 10.25 7.75 12.00
8 shenh1 0.78 (4) 0.49 (11) 0.42 (8) 0.78 (12) 0.53 (17) 0.45 (5) 0.84 (4) 0.55 (11) 0.48 (8) 1.00 (12) 8.00 13.00 9.50
9 hamaa1 0.72 (12) 0.57 (6) 0.43 (5) 0.66 (17) 0.51 (18) 0.46 (3) 0.86 (3) 0.81 (1) 0.51 (7) 0.99 (17) 12.25 10.00 8.25
10 zikid1 0.75 (10) 0.47 (16) 0.41 (10) 0.79 (8) 0.72 (3) 0.46 (4) 0.79 (13) 0.44 (17) 0.44 (16) 1.00 (7) 9.50 11.00 11.25
11 peres2 0.69 (14) 0.48 (14) 0.43 (4) 0.74 (14) 0.60 (11) 0.42 (10) 0.76 (15) 0.51 (12) 0.53 (4) 0.99 (14) 14.25 12.00 5.50
12 baues1 0.66 (15) 0.49 (12) 0.42 (9) 0.63 (18) 0.63 (10) 0.41 (12) 0.80 (11) 0.49 (14) 0.45 (14) 0.99 (16) 15.00 11.25 9.50
13 meier1 0.65 (16) 0.51 (9) 0.39 (13) 0.62 (19) 0.56 (15) 0.37 (17) 0.81 (8) 0.59 (9) 0.47 (10) 0.99 (18) 15.25 10.75 11.50
14 pinta1 0.62 (19) 0.47 (15) 0.40 (11) 0.78 (10) 0.72 (5) 0.43 (7) 0.58 (22) 0.43 (18) 0.44 (15) 0.99 (13) 16.00 11.25 11.50
15 menzb2 0.69 (13) 0.33 (19) 0.39 (14) 0.78 (11) 0.57 (14) 0.42 (8) 0.67 (19) 0.29 (20) 0.46 (12) 1.00 (11) 13.50 17.50 9.75
16 haect1 0.78 (5) 0.49 (10) 0.00 (23) 0.86 (4) 0.42 (21) 0.00 (23) 0.73 (17) 0.74 (2) 0.00 (23) 1.00 (2) 7.00 13.00 22.75
17 sauwn2 0.62 (18) 0.51 (8) 0.37 (16) 0.70 (15) 0.56 (16) 0.39 (16) 0.66 (20) 0.65 (7) 0.45 (13) 0.99 (19) 18.00 12.25 17.25
18 thirs1 0.53 (21) 0.37 (17) 0.34 (18) 0.45 (21) 0.48 (19) 0.37 (18) 0.81 (7) 0.42 (19) 0.39 (17) 0.99 (20) 17.25 17.75 15.00
19 riklt2 0.54 (20) 0.37 (18) 0.43 (7) 0.52 (20) 0.58 (13) 0.41 (11) 0.60 (21) 0.29 (22) 0.53 (3) 0.73 (23) 21.00 19.00 10.00
20 geree1 0.62 (17) 0.32 (20) 0.31 (19) 0.80 (6) 0.60 (12) 0.36 (19) 0.56 (23) 0.28 (23) 0.32 (20) 0.99 (15) 15.25 17.25 18.50
21 njehi1 0.77 (7) 0.21 (22) 0.00 (23) 0.77 (13) 0.22 (22) 0.00 (23) 0.84 (5) 0.29 (21) 0.00 (23) 1.00 (6) 7.75 21.25 23.00
22 shinh1 0.30 (24) 0.17 (23) 0.04 (22) 0.23 (24) 0.12 (24) 0.04 (22) 0.83 (6) 0.66 (6) 0.06 (22) 0.95 (22) 19.00 18.75 18.75
23 demia1 0.36 (23) 0.23 (21) 0.13 (21) 0.27 (23) 0.19 (23) 0.09 (21) 0.77 (14) 0.48 (15) 0.37 (18) 0.97 (21) 20.25 20.00 17.75
24 alexv1 0.43 (22) 0.14 (24) 0.19 (20) 0.45 (22) 0.43 (20) 0.40 (15) 0.43 (24) 0.10 (24) 0.15 (21) 0.73 (24) 23.00 23.00 19.25

Simulated

Position User Dice Positive Predictive Value Sensitivity Kappa Complete tumor Rank Tumor core Rank Enhancing tumor Rank
  complete core enhancing complete core enhancing complete core enhancing  
1 yangw1 0.92 (1) 0.88 (1) 0.00 (1) 0.97 (1) 0.90 (1) 0.00 (1) 0.89 (5) 0.88 (2) 0.00 (1) 1.00 (1) 2.00 1.25 1.00
2 zikid1 0.91 (2) 0.86 (2) 0.00 (1) 0.90 (3) 0.86 (2) 0.00 (1) 0.94 (2) 0.90 (1) 0.00 (1) 1.00 (2) 2.25 1.75 1.00
3 baues1 0.87 (4) 0.81 (3) 0.00 (1) 0.89 (4) 0.82 (4) 0.00 (1) 0.89 (4) 0.81 (3) 0.00 (1) 1.00 (4) 4.00 3.25 1.00
4 njehi1 0.88 (3) 0.76 (4) 0.00 (1) 0.83 (5) 0.83 (3) 0.00 (1) 0.93 (3) 0.72 (4) 0.00 (1) 1.00 (3) 3.50 3.75 1.00
5 geree1 0.83 (5) 0.62 (5) 0.00 (1) 0.94 (2) 0.80 (5) 0.00 (1) 0.77 (6) 0.55 (5) 0.00 (1) 0.99 (5) 4.50 5.00 1.00
6 menzb2 0.76 (6) 0.40 (6) 0.00 (1) 0.67 (6) 0.62 (6) 0.00 (1) 0.95 (1) 0.42 (6) 0.00 (1) 0.99 (6) 4.75 6.00 1.00
7 shinh1 0.34 (7) 0.16 (7) 0.00 (1) 0.35 (7) 0.12 (7) 0.00 (1) 0.37 (7) 0.29 (7) 0.00 (1) 0.98 (7) 7.00 7.00 1.00
8 njehi2 0.00 (8) 0.00 (8) 0.00 (1) 0.00 (8) 0.00 (8) 0.00 (1) 0.00 (8) 0.00 (8) 0.00 (1) 0.07 (8) 8.00 8.00 1.00

Evaluation Results: Updated Four-Class Labels - Training

Patient

Position User Dice Positive Predictive Value Sensitivity Kappa Complete tumor Rank Tumor core Rank Enhancing tumor Rank
  complete core enhancing complete core enhancing complete core enhancing  
1 rezas1 0.92 (1) 0.91 (2) 0.68 (1) 0.97 (1) 0.95 (1) 0.70 (1) 0.89 (7) 0.88 (4) 0.66 (3) 1.00 (1) 2.50 2.25 7.50
2 zikid1 0.92 (2) 0.93 (1) 0.63 (2) 0.86 (13) 0.92 (2) 0.63 (7) 0.98 (1) 0.94 (1) 0.64 (4) 1.00 (3) 4.75 1.25 9.75
3 shaoj1 0.87 (7) 0.87 (4) 0.61 (3) 0.78 (22) 0.83 (8) 0.57 (14) 0.98 (2) 0.93 (2) 0.66 (2) 1.00 (8) 9.75 4.25 5.00
4 silvc1 0.87 (5) 0.73 (8) 0.58 (4) 0.93 (3) 0.86 (7) 0.62 (9) 0.84 (12) 0.69 (12) 0.61 (6) 1.00 (5) 6.25 9.25 5.25
5 tustn1 0.88 (4) 0.76 (6) 0.55 (9) 0.88 (9) 0.80 (11) 0.65 (5) 0.89 (6) 0.79 (7) 0.53 (10) 1.00 (4) 5.75 7.50 10.00
6 sompc1 0.91 (3) 0.88 (3) 0.45 (25) 0.91 (6) 0.88 (4) 0.37 (29) 0.92 (4) 0.89 (3) 0.68 (1) 1.00 (2) 3.75 3.50 16.75
7 gangq1 0.84 (12) 0.71 (9) 0.56 (7) 0.92 (4) 0.78 (13) 0.64 (6) 0.78 (24) 0.69 (11) 0.51 (11) 1.00 (7) 11.75 9.50 6.75
8 zhaol1 0.86 (8) 0.75 (7) 0.55 (10) 0.88 (10) 0.86 (6) 0.65 (3) 0.86 (10) 0.72 (9) 0.50 (15) 1.00 (10) 9.50 7.75 11.75
9 pinta1 0.86 (9) 0.70 (10) 0.54 (11) 0.94 (2) 0.88 (3) 0.65 (4) 0.81 (20) 0.66 (19) 0.54 (8) 1.00 (6) 9.25 10.75 11.50
10 havam2 0.87 (6) 0.79 (5) 0.53 (12) 0.92 (5) 0.82 (10) 0.56 (15) 0.83 (14) 0.80 (6) 0.54 (9) 1.00 (9) 8.50 7.00 16.25
11 kleej1 0.83 (14) 0.67 (13) 0.55 (8) 0.90 (8) 0.77 (14) 0.66 (2) 0.80 (22) 0.69 (14) 0.51 (12) 1.00 (12) 14.00 13.50 10.50
12 davya1 0.79 (20) 0.68 (12) 0.57 (6) 0.81 (20) 0.75 (16) 0.54 (18) 0.79 (23) 0.67 (16) 0.63 (5) 1.00 (15) 19.50 13.00 8.50
13 festj1 0.79 (18) 0.62 (20) 0.57 (5) 0.82 (19) 0.80 (12) 0.60 (10) 0.80 (21) 0.57 (23) 0.57 (7) 1.00 (17) 18.75 17.50 6.50
14 meier1 0.83 (15) 0.66 (14) 0.52 (14) 0.85 (15) 0.74 (17) 0.59 (13) 0.83 (15) 0.66 (17) 0.50 (16) 1.00 (14) 14.75 15.50 15.00
15 anon1 0.85 (10) 0.58 (22) 0.48 (20) 0.88 (11) 0.76 (15) 0.60 (12) 0.85 (11) 0.53 (27) 0.46 (22) 1.00 (11) 10.75 20.50 15.00
16 doyls2 0.83 (13) 0.54 (24) 0.48 (18) 0.84 (17) 0.47 (27) 0.51 (23) 0.86 (9) 0.77 (8) 0.51 (13) 1.00 (16) 13.75 21.00 15.50
17 hamaa1 0.81 (16) 0.69 (11) 0.49 (16) 0.78 (24) 0.63 (22) 0.54 (17) 0.89 (5) 0.85 (5) 0.46 (21) 0.99 (21) 16.50 15.00 18.75
18 subbn1 0.78 (21) 0.66 (16) 0.46 (23) 0.66 (27) 0.87 (5) 0.62 (8) 0.97 (3) 0.56 (24) 0.40 (28) 0.99 (23) 18.50 14.25 18.50
19 baues1 0.79 (19) 0.64 (18) 0.49 (15) 0.79 (21) 0.74 (18) 0.54 (19) 0.82 (16) 0.61 (20) 0.49 (18) 0.99 (20) 19.00 18.00 16.50
20 cordn1 0.79 (17) 0.66 (15) 0.48 (17) 0.90 (7) 0.73 (19) 0.52 (22) 0.73 (27) 0.66 (18) 0.49 (19) 1.00 (19) 17.50 17.25 19.00
21 whoa1 0.77 (22) 0.63 (19) 0.47 (21) 0.84 (16) 0.67 (21) 0.56 (16) 0.75 (26) 0.69 (10) 0.45 (24) 1.00 (18) 20.50 17.75 17.00
22 anon2 0.84 (11) 0.65 (17) 0.44 (26) 0.86 (12) 0.70 (20) 0.51 (24) 0.84 (13) 0.69 (15) 0.42 (27) 1.00 (13) 12.25 18.00 26.25
23 taylt1 0.68 (27) 0.62 (21) 0.52 (13) 0.78 (23) 0.83 (9) 0.60 (11) 0.62 (29) 0.53 (26) 0.50 (14) 0.99 (22) 25.25 18.75 16.25
24 ppppn1 0.73 (23) 0.53 (25) 0.35 (29) 0.85 (14) 0.62 (23) 0.52 (21) 0.69 (28) 0.55 (25) 0.32 (33) 0.99 (24) 22.25 24.00 23.25
25 ttttk1 0.73 (24) 0.46 (27) 0.33 (30) 0.69 (26) 0.46 (29) 0.37 (30) 0.82 (18) 0.53 (28) 0.34 (31) 0.99 (25) 23.25 27.00 25.50
26 shinh1 0.46 (34) 0.36 (31) 0.35 (28) 0.35 (34) 0.27 (33) 0.35 (31) 0.86 (8) 0.69 (13) 0.39 (29) 0.98 (29) 26.25 26.25 24.25
27 demia1 0.61 (28) 0.44 (29) 0.27 (33) 0.52 (32) 0.38 (31) 0.24 (32) 0.81 (19) 0.57 (22) 0.35 (30) 0.99 (27) 26.50 27.00 27.00
28 shenh1 0.57 (30) 0.47 (26) 0.48 (19) 0.57 (29) 0.53 (25) 0.52 (20) 0.57 (31) 0.47 (30) 0.49 (20) 0.66 (31) 30.25 28.25 22.50
29 guox1 0.55 (31) 0.55 (23) 0.47 (22) 0.61 (28) 0.60 (24) 0.49 (25) 0.51 (33) 0.51 (29) 0.49 (17) 0.66 (32) 31.00 26.75 24.25
30 uhlim1 0.70 (25) 0.28 (33) 0.33 (31) 0.70 (25) 0.46 (28) 0.45 (27) 0.75 (25) 0.28 (33) 0.34 (32) 0.99 (26) 25.25 30.25 28.00
31 liy3 0.57 (29) 0.33 (32) 0.28 (32) 0.49 (33) 0.31 (32) 0.23 (33) 0.82 (17) 0.57 (21) 0.44 (25) 0.98 (28) 26.75 28.50 28.50
32 goetm2 0.52 (32) 0.44 (28) 0.46 (24) 0.55 (31) 0.52 (26) 0.48 (26) 0.52 (32) 0.40 (31) 0.45 (23) 0.66 (33) 32.00 29.50 26.25
33 buenp1 0.49 (33) 0.41 (30) 0.42 (27) 0.57 (30) 0.45 (30) 0.45 (28) 0.44 (34) 0.40 (32) 0.44 (26) 0.66 (34) 32.75 31.50 28.75
34 loorf1 0.69 (26) 0.15 (34) 0.00 (42) 0.83 (18) 0.18 (34) 0.00 (42) 0.61 (30) 0.19 (34) 0.00 (42) 0.86 (30) 26.00 33.00 39.00
35 zhanf1 0.14 (35) 0.13 (35) 0.11 (34) 0.15 (35) 0.16 (35) 0.12 (34) 0.12 (35) 0.12 (35) 0.11 (34) 0.17 (35) 35.00 35.00 34.25
36 al-ss1 0.11 (36) 0.05 (36) 0.03 (35) 0.13 (36) 0.05 (36) 0.07 (35) 0.10 (36) 0.06 (37) 0.03 (35) 0.13 (36) 36.00 36.25 35.25
37 islam2 0.03 (38) 0.03 (38) 0.03 (36) 0.03 (39) 0.03 (37) 0.03 (36) 0.03 (38) 0.03 (39) 0.03 (37) 0.03 (38) 38.25 38.00 36.75
38 erihm1 0.06 (37) 0.03 (37) 0.00 (42) 0.06 (37) 0.03 (40) 0.00 (42) 0.07 (37) 0.08 (36) 0.00 (42) 0.10 (37) 37.00 37.50 40.75
39 belmg1 0.03 (41) 0.03 (39) 0.03 (37) 0.03 (40) 0.03 (38) 0.03 (38) 0.03 (43) 0.03 (41) 0.03 (36) 0.03 (42) 41.50 39.50 38.00
40 walld1 0.03 (40) 0.03 (40) 0.03 (38) 0.03 (41) 0.03 (39) 0.03 (39) 0.03 (41) 0.03 (40) 0.03 (38) 0.03 (41) 40.75 40.00 39.25
41 vassf1 0.03 (39) 0.03 (41) 0.02 (39) 0.03 (38) 0.03 (41) 0.03 (37) 0.03 (42) 0.03 (42) 0.02 (41) 0.03 (40) 39.75 41.75 39.25
42 niklr1 0.03 (43) 0.03 (42) 0.02 (40) 0.02 (43) 0.03 (42) 0.02 (40) 0.03 (40) 0.03 (43) 0.03 (40) 0.03 (43) 42.25 42.25 40.75
43 juanj1 0.02 (44) 0.02 (43) 0.01 (41) 0.02 (44) 0.01 (44) 0.01 (41) 0.03 (39) 0.03 (38) 0.03 (39) 0.03 (44) 42.75 42.50 41.25
44 rezas2 0.03 (42) 0.00 (44) 0.00 (42) 0.03 (42) 0.01 (43) 0.00 (42) 0.03 (44) 0.00 (44) 0.00 (42) 0.03 (39) 41.75 42.50 42.75
45 guptm1 0.00 (45) 0.00 (45) 0.00 (42) 0.00 (45) 0.00 (45) 0.00 (42) 0.00 (45) 0.00 (45) 0.00 (42) 0.03 (45) 45.00 44.75 41.25
46 royrc1 0.00 (45) 0.00 (45) 0.00 (42) 0.00 (45) 0.00 (45) 0.00 (42) 0.00 (45) 0.00 (45) 0.00 (42) 0.00 (46) 45.25 45.25 42.75

Simulated

Position User Dice Positive Predictive Value Sensitivity Kappa Complete tumor Rank Tumor core Rank Enhancing tumor Rank
  complete core enhancing complete core enhancing complete core enhancing  
1 zikid1 0.93 (1) 0.95 (1) 0.00 (1) 0.88 (2) 0.95 (1) 0.00 (1) 0.97 (3) 0.95 (1) 0.00 (1) 1.00 (2) 2.00 1.00 1.00
2 tustn1 0.89 (3) 0.90 (2) 0.00 (1) 0.82 (5) 0.88 (2) 0.00 (1) 0.99 (1) 0.93 (2) 0.00 (1) 1.00 (3) 3.00 2.00 1.00
3 festj1 0.92 (2) 0.87 (3) 0.00 (1) 0.87 (3) 0.88 (3) 0.00 (1) 0.98 (2) 0.90 (3) 0.00 (1) 1.00 (1) 2.00 3.00 1.00
4 baues1 0.88 (4) 0.82 (4) 0.00 (1) 0.82 (4) 0.84 (4) 0.00 (1) 0.96 (4) 0.84 (5) 0.00 (1) 1.00 (4) 4.00 4.25 1.00
5 cordn1 0.86 (5) 0.78 (5) 0.00 (1) 0.89 (1) 0.77 (5) 0.00 (1) 0.87 (6) 0.84 (4) 0.00 (1) 1.00 (5) 4.25 4.75 1.00
6 shinh1 0.27 (6) 0.12 (6) 0.00 (1) 0.20 (6) 0.07 (6) 0.00 (1) 0.50 (7) 0.41 (7) 0.00 (1) 0.98 (6) 6.25 6.25 1.00
7 uhlim1 0.18 (7) 0.07 (7) 0.00 (1) 0.11 (7) 0.04 (7) 0.00 (1) 0.96 (5) 0.45 (6) 0.00 (1) 0.91 (7) 6.50 6.75 1.00
8 guptm1 0.06 (8) 0.05 (8) 0.00 (1) 0.06 (8) 0.04 (8) 0.00 (1) 0.06 (8) 0.06 (8) 0.00 (1) 0.08 (8) 8.00 8.00 1.00

MICCAI 2012 on-site challenge (2 labels only)

Evaluation Results: Challenge (table frozen after MICCAI 2012 on-site challenge)

Position Dice Specificity Sensitivity Avg Dist. Hausdorff Dist. Kappa Edema Rank Tumor Rank Overall Rank
1 0.67 (1) 0.65 (1) 1.00 (2) 1.00 (1) 0.74 (1) 0.63 (2) 7.23 (1) 3.57 (1) 60.62 (6) 42.72 (3) 0.46 (1) 2.00 1.50 1.75
2 0.61 (3) 0.63 (3) 1.00 (3) 1.00 (3) 0.71 (2) 0.63 (3) 12.15 (6) 6.37 (3) 43.89 (2) 42.84 (4) 0.42 (2) 3.00 3.00 3.00
3 0.62 (2) 0.55 (4) 1.00 (1) 1.00 (2) 0.59 (3) 0.54 (6) 7.57 (2) 7.42 (4) 57.77 (5) 47.39 (6) 0.38 (3) 2.67 4.17 3.42
4 0.47 (4) 0.64 (2) 1.00 (4) 1.00 (5) 0.57 (4) 0.79 (1) 8.38 (4) 8.58 (6) 66.10 (8) 45.22 (5) 0.36 (4) 4.67 3.83 4.25
5 0.37 (6) 0.37 (5) 0.99 (6) 0.99 (6) 0.41 (6) 0.63 (4) 8.32 (3) 7.58 (5) 65.04 (7) 52.95 (7) 0.19 (6) 5.67 5.50 5.58
6 0.46 (5) 0.27 (6) 0.99 (5) 1.00 (4) 0.54 (5) 0.28 (7) 15.10 (7) 29.23 (8) 47.84 (3) 76.80 (8) 0.20 (5) 5.00 6.33 5.67
7 0.01 (8) 0.03 (8) 0.20 (8) 0.20 (8) 0.02 (8) 0.06 (8) 8.70 (5) 4.52 (2) 23.02 (1) 24.85 (1) 0.01 (8) 6.33 5.83 6.08
8 0.35 (7) 0.26 (7) 0.90 (7) 0.88 (7) 0.32 (7) 0.55 (5) 25.96 (8) 12.52 (7) 52.88 (4) 40.35 (2) 0.19 (7) 6.67 5.83 6.25

Evaluation Results: Training data

Position Dice Specificity Sensitivity Avg Dist. Hausdorff Dist. Kappa Edema Rank Tumor Rank Overall Rank
1 0.58 (2) 0.73 (2) 1.00 (2) 1.00 (1) 0.78 (1) 0.73 (3) 4.07 (8) 4.44 (10) 33.68 (9) 32.31 (10) 0.42 (2) 4.00 4.67 4.33
2 0.61 (1) 0.76 (1) 1.00 (1) 1.00 (2) 0.74 (2) 0.79 (2) 5.98 (10) 3.74 (9) 44.32 (11) 37.58 (11) 0.45 (1) 4.33 4.33 4.33
3 0.18 (6) 0.24 (6) 0.31 (8) 0.31 (8) 0.27 (5) 0.25 (6) 0.49 (2) 0.70 (3) 4.99 (4) 5.29 (5) 0.13 (6) 5.17 5.67 5.42
4 0.22 (5) 0.27 (5) 0.37 (5) 0.37 (5) 0.23 (6) 0.27 (5) 2.50 (7) 2.39 (6) 24.84 (7) 26.02 (8) 0.13 (5) 5.83 5.67 5.75
5 0.37 (3) 0.69 (3) 0.99 (3) 1.00 (3) 0.55 (3) 0.86 (1) 9.17 (12) 4.90 (11) 55.85 (12) 46.95 (12) 0.28 (3) 6.00 5.50 5.75
6 0.25 (4) 0.53 (4) 0.82 (4) 0.82 (4) 0.39 (4) 0.65 (4) 8.24 (11) 4.91 (12) 37.38 (10) 30.89 (9) 0.18 (4) 6.17 6.17 6.17
7 0.14 (8) 0.17 (8) 0.24 (9) 0.24 (9) 0.16 (8) 0.17 (8) 0.73 (3) 0.71 (4) 5.15 (5) 4.35 (4) 0.09 (7) 6.67 6.67 6.67
8 0.15 (7) 0.19 (7) 0.35 (7) 0.35 (7) 0.16 (7) 0.20 (7) 2.13 (6) 2.39 (7) 9.39 (6) 11.37 (6) 0.07 (8) 6.83 7.00 6.92
9 0.02 (10) 0.03 (10) 0.04 (10) 0.04 (10) 0.02 (10) 0.04 (10) 0.03 (1) 0.05 (2) 1.88 (3) 2.25 (3) 0.01 (9) 7.17 7.33 7.25
10 0.00 (11) 0.01 (11) 0.01 (11) 0.01 (12) 0.00 (11) 0.01 (11) 1.25 (4) 0.00 (1) 1.25 (1) 2.18 (2) 0.01 (10) 8.00 7.83 7.92
11 0.00 (11) 0.00 (12) 0.01 (12) 0.01 (11) 0.00 (11) 0.00 (12) 1.25 (4) 1.25 (5) 1.25 (1) 1.25 (1) 0.00 (11) 8.33 8.67 8.50
12 0.07 (9) 0.05 (9) 0.37 (6) 0.37 (6) 0.11 (9) 0.05 (9) 5.31 (9) 2.76 (8) 32.90 (8) 24.25 (7) -0.04 (12) 8.83 8.50 8.67