Difference between revisions of "MSChallenge"

From IACL
Jump to navigation Jump to search
 
(19 intermediate revisions by the same user not shown)
Line 1: Line 1:
−
<meta name="title" content="MS Challenge" />  
+
<!-- <meta name="title" content="The 2015 Longitudinal Multiple Sclerosis Lesion Segmentation Challenge" /> -->
−
{{h1|The 2015 Longitudinal Multiple Sclerosis Lesion Segmentation Challenge}}
+
{{h2|The 2015 Longitudinal MS Lesion Segmentation Challenge}}
 +
{{MSChallengeNav}}
 
__NOTOC__
 
__NOTOC__
 
{{h3|I. Introduction}}
 
{{h3|I. Introduction}}
 
[[Image:2015_lesions_orig.png|right|thumb|400px|2015 Longitudinal Multiple Sclerosis Lesion Segmentation Challenge]]
 
[[Image:2015_lesions_orig.png|right|thumb|400px|2015 Longitudinal Multiple Sclerosis Lesion Segmentation Challenge]]
−
The Longitudinal MS Lesion Segmentation Challenge will be conducted at the [http://biomedicalimaging.org/2015 2015 International Symposium on Biomedical Imaging] in New York, NY, April 16-19. Competing teams will apply their automatic lesion segmentation algorithms to MR neuroimaging data acquired at multiple time points from MS patients. Algorithms will be evaluated against manual segmentations from multiple raters in terms of their segmentation accuracy and ability to track lesion evolution.
+
The Longitudinal MS Lesion Segmentation Challenge was conducted at the [http://biomedicalimaging.org/2015 2015 International Symposium on Biomedical Imaging] in New York, NY, April 16-19. Competing teams applied their automatic lesion segmentation algorithms to MR neuroimaging data acquired at multiple time points from MS patients. Algorithms were evaluated against manual segmentations from two raters in terms of their segmentation accuracy and ability to track lesion evolution.
  
−
Registration for the Challenge is now closed. 34 Teams initially registered for the Challenge coming from 15 different countries, representing 27 different institutions/universities. '''Congratulations to Team IIT Madras (First Prize), Team PVG_1 (Second Prize), and Team IMI (Third Prize and Efficiency Prize)'''!
+
34 Teams initially registered for the Challenge coming from 15 different countries, representing 27 different institutions/universities. '''Congratulations to Team IIT Madras (First Prize), Team PVG_1 (Second Prize), and Team IMI (Third Prize and Efficiency Prize)'''!
  
 +
Information about the data is available [[MSChallenge/data|here]], and the evaluation software from [[MSChallenge/evaluation|here]].
  
−
{{h3|II. Data}}
 
−
The overall data will be composed of three parts: 1) Training data consisting of longitudinal images from 5 patients; 2) Test data 1 consisting of longitudinal images from 10 patients; and 3) Test data 2 consisting of longitudinal images from 5 patients. Only the training data will include manual delineations when it is released to teams. These delineations will be performed by at least 2 trained raters. Test data 1 will be released in advance of the challenge day and test data 2 will be released on or shortly before the challenge day to discourage patient-specific tuning of the algorithms and computationally inefficient approaches.
 
  
−
Each longitudinal dataset will include T1-weighted, T2-weighted, PD-weighted, and T2-weighted FLAIR MRI with 3-5 time points acquired on a 3T MR scanner. T1-weighted images will have approximately a 1mm cubic voxel resolution, while the other scans will be 1mm in plane with 3mm sections. Accounting for the multiple time points, this constitutes approximately 80 individual data sets. To minimize the dependency of the results on registration performance and brain extraction, all images will be provided already rigidly co-registered to the baseline T1-weighted image with automatically computed skull stripping masks that may optionally be used by the teams.  
+
{{h3|Leaderboard & Paper}}
 +
'''A live leaderboard is maintained on the [https://smart-stats-tools.org/lesion-challenge Smart Stats Website].''' The main Challenge article has appeared in {{iacl-pub ni}}: {{iacl-pub|author=A. Carass, S. Roy, A. Jog, J.L. Cuzzocreo, E. Magrath, A. Gherman, J. Button, J. Nguyen, F. Prados, C.H. Sudre, M.J. Cardoso, N. Cawley, O. Ciccarelli, C.A.M. Wheeler-Kingshott, S. Ourselin, L. Catanese, H. Deshpande, P. Maurel, O. Commowick, C. Barillot, X. Tomas-Fernandez, S.K. Warfield, S. Vaidya, A. Chunduru, R. Muthuganapathy, G. Krishnamurthi, A. Jesson, T. Arbel, O. Maier, H. Handels, L.O. Iheme, D. Unay, S. Jain, D.M. Sima, D. Smeets, M. Ghafoorian, B. Platel, A. Birenbaum, H. Greenspan, P.-L. Bazin, P.A. Calabresi, C.M. Crainiceanu, L.M. Ellingsen, D.S. Reich, J.L. Prince, and D.L. Pham|title=Longitudinal Multiple Sclerosis Lesion Segmentation: Resource and Challenge|jrnl=ni|number=148(C):77-102|when=2017|doi=10.1016/j.neuroimage.2016.12.064|pubmed=28087490}}<br />
 +
and a companion paper has appeared in ''Data in Brief'':
 +
{{iacl-pub|author=A. Carass, S. Roy, A. Jog, J.L. Cuzzocreo, E. Magrath, A. Gherman, J. Button, J. Nguyen, P.-L. Bazin, P.A. Calabresi, C.M. Crainiceanu, L.M. Ellingsen, D.S. Reich, J.L. Prince, and D.L. Pham|title=Longitudinal multiple sclerosis lesion segmentation data resource|journal=Data in Brief|number=12:346-350|when=2017|doi=10.1016/j.dib.2017.04.004|pubmed=28491937}}
  
−
The training and test data will continue to be made publicly available following the challenge, similar to the [http://www.ia.unc.edu/MSseg/ MICCAI 2008 Lesion Challenge] data. Manual delineations on the test data will not be made available to the public but the organizers will provide evaluation results for any submitted segmentations.  '''A public website for disseminating the data is currently in development.'''
 
  
−
 
+
<!--
−
{{h3|III. Evaluation}}
+
{| align="center" style="width:80%; border:2px #87cefa solid; background:#f0ffff; text-align:left;"
−
Here are some [[MSChallenge/guidelines|initial guidelines]].
 
−
 
 
−
The evaluation software can be downloaded as {{iacl|~aaron/isbi2015/challengemetrics_matlab_only.zip|Matlab Dot M files}} (339KB) and as a compiled {{iacl|~aaron/isbi2015/challengemetrics.zip|Matlab executable}} (46MB). The evaluation metric currently include: Dice Overlap, Jaccard Overlap, PPV (positive predictive value), TPR (sensitivity, voxel based), LTPR (lesion TPR based on lesion count), LFPR (lesion FPR based on lesion count),
 
−
Volume Difference, Surface Difference, Segmentation Volume, Volume Change Correlation, New lesion detection TPR, and New lesion detection FPR.
 
−
 
 
−
 
 
−
{{h3|IV. Key dates}}
 
−
{| align="center" style="width:50%; border:2px #efe590 solid; background:#f9f9f0; text-align:left;"
 
 
|-
 
|-
−
| colspan="4" style="border-top:1px solid #efe590;"|
+
| colspan="4" style="border-top:1px solid #87cefa;"|
 
|-
 
|-
−
| colspan="4" align="center" style="background:#efe590; text-align:center;" | '''''Important Dates'''''
+
| colspan="4" align="center" style="background:#87cefa; text-align:center;" | '''''Leaderboard'''''
 
|-
 
|-
−
| colspan="4" style="border-top:1px solid #efe590;"|
+
| colspan="4" style="border-top:1px solid #87cefa;"|
 
|-
 
|-
−
|'''Registration Opens'''
+
| '''Ranking'''&nbsp;&nbsp;
−
|December 15, 2014
+
| style="width:80%" | '''Method Name'''<br />'''Authors'''<br />'''Paper Title'''<br />'''Paper Link(s)'''
 +
|
 +
| '''Website'''<br />'''Score'''
 
|-
 
|-
−
|'''Release of Training Data'''
+
| colspan="4" style="border-top:1px solid #87cefa;"|
−
|February &nbsp;4, 2015
 
 
|-
 
|-
−
|'''Last day to register for the challenge'''
+
| 1
−
|March &nbsp;6, 2015
+
| ''MV-CNN''<br />A. Birenbaum & H. Greenspan<br />'''Multi-View Convolutional Neural Networks'''<br />
 +
|
 +
| 91.267
 
|-
 
|-
−
|'''Release of Test Data 1'''
+
| colspan="4" style="border-top:1px solid #87cefa;"|
−
|March 18, 2015
 
 
|-
 
|-
−
|'''Submission of Manuscript'''
+
| 2
−
|April &nbsp;2, 2015
+
| ''MIAC''<br />S. Andermatt, J. Würfel, & P.C. Cattin<br />''' '''<br />
 +
|
 +
| 91.011
 
|-
 
|-
−
|'''Submission of Test Data 1 Results'''
+
| colspan="4" style="border-top:1px solid #87cefa;"|
−
|April &nbsp;6, 2015
 
 
|-
 
|-
−
|'''Release of Test Data 2'''
+
| 3
−
|April 10, 2015
+
| ''Team PVG One''<br />A. Jesson & T. Arbel<br />'''Hierarchical MRF and Random Forest Segmentation of MS Lesions and Healthy Tissues in Brain MRI'''<br />{{pub|doi=10.1016/j.neuroimage.2016.12.064|pubmed=28087490|period=}}
 +
|
 +
| 90.698
 
|-
 
|-
−
|'''Submission of Test Data 2'''
+
| colspan="4" style="border-top:1px solid #87cefa;"|
−
|April 13, 2015
 
 
|-
 
|-
−
|'''Challenge Day'''
+
| 4
−
|April 16, 2015
+
| ''Team IMI''<br />O. Maier & H. Handels<br />'''MS-Lesion Segmentation in MRI with Random Forests'''<br />{{pub|doi=10.1016/j.neuroimage.2016.12.064|pubmed=28087490|period=}}
 +
|
 +
| 90.283
 
|-
 
|-
−
| colspan="4" style="border-top:1px solid #efe590;"|
+
| colspan="4" style="border-top:1px solid #87cefa;"|
 
|-
 
|-
−
|}
+
| 5
−
 
+
| ''ATMS''<br />O. Ghribi<br /><br />
−
 
+
|
−
{{h3|V. Challenge Day Schedule}}
+
| 90.170
−
{| align="center" style="width:90%; border:2px #909095 solid; background:#f9f0f9; text-align:left;"
 
 
|-
 
|-
−
| colspan="2" style="border-top:1px solid #909095;"|
+
| colspan="4" style="border-top:1px solid #87cefa;"|
 
|-
 
|-
−
| colspan="2" align="center" style="background:#909095; text-align:center;" | '''''Challenge Day Schedule'''''
+
| 6
 +
| ''MV-CNN''<br />A. Birenbaum & H. Greenspan<br />'''Multi-View Convolutional Neural Networks'''<br />{{pub|doi=10.1007/978-3-319-46976-8_7|period=}}
 +
|
 +
| 90.070
 
|-
 
|-
−
| colspan="2" style="border-top:1px solid #909095;"|
+
| colspan="4" style="border-top:1px solid #87cefa;"|
 
|-
 
|-
−
| rowspan="2" width="15%" | 8:30 - 8:45
+
| 7
−
| '''Opening Remarks'''
+
| ''Team VISAGES GCEM''<br />L. Catanese, O. Commowick, & C. Barillot<br />'''Automatic Graph Cut Segmentation of Multiple Sclerosis Lesions'''<br />{{pub|doi=10.1016/j.neuroimage.2016.12.064|pubmed=28087490|period=}}
 +
|
 +
| 89.807
 
|-
 
|-
−
| Dzung L. Pham
+
| colspan="4" style="border-top:1px solid #87cefa;"|
 
|-
 
|-
−
| colspan="2" style="border-top:1px solid #909095;"|
+
| 8
 +
| ''Team IIT Madras''<br />S. Vaidya, A. Chunduru, R. Muthuganapathy, & G. Krishnamurthi<br />'''Longitudinal Multiple Sclerosis Lesion Segmentation using 3D Convolutional Neural Networks'''<br />{{pub|doi=10.1016/j.neuroimage.2016.12.064|pubmed=28087490|period=}}
 +
|
 +
| 89.159
 
|-
 
|-
−
| rowspan="2" width="15%" | 8:45 - 9:00
+
| colspan="4" style="border-top:1px solid #87cefa;"|
−
| [http://www.iacl.ece.jhu.edu/w/images/3/33/Ferran_Prados_Carrasco.pdf '''Multi-Contrast PatchMatch Algorithm for Multiple Sclerosis Lesion Detection''']
 
−
|-
 
−
| ''Team CMIC:'' F. Prados, M.J. Cardoso, N. Cawley, O. Ciccarelli, C.A.M. Wheeler-Kingshott, & S. Ourselin
 
 
|-
 
|-
−
| colspan="2" style="border-top:1px solid #909095;"|
+
| 9
 +
| ''Team MS*metrix*''<br />S. Jain, D.M. Sima, & D. Smeets<br />'''Automatic Longitudinal Multiple Sclerosis Lesion Segmentation'''<br />{{pub|doi=10.1016/j.neuroimage.2016.12.064|pubmed=28087490|period=}}
 +
|
 +
| 88.744
 
|-
 
|-
−
| rowspan="2" width="15%" | 9:00 - 9:15
+
| colspan="4" style="border-top:1px solid #87cefa;"|
−
| [http://www.iacl.ece.jhu.edu/w/images/5/5f/Laurence_Catanese.pdf '''Automatic Graph Cut Segmentation of Multiple Sclerosis Lesions''']
 
 
|-
 
|-
−
| ''Team VISAGES Deux'': L. Catanese, O. Commowick, & C. Barillot
+
| 10
 +
| ''Lesion-TOADS''<br />N. Shiee, P.-L. Bazin, A. Ozturk, D. S. Reich, P. A. Calabresi, & D. L. Pham<br />'''A topology-preserving approach to the segmentation of brain images with multiple sclerosis lesions'''<br />{{pub|doi=10.1016/j.neuroimage.2009.09.005|pubmed=19766196|pmcid=2806481|period=}}
 +
|
 +
| 88.465
 
|-
 
|-
−
| colspan="2" style="border-top:1px solid #909095;"|
+
| colspan="4" style="border-top:1px solid #87cefa;"|
 
|-
 
|-
−
| rowspan="2" width="15%" | 9:15 - 9:30
+
| 11
−
| [http://www.iacl.ece.jhu.edu/w/images/4/40/Hrishikesh_Deshpande.pdf '''Sparse Representations and Dictionary Learning Based Longitudinal Segmentation of Multiple Sclerosis Lesions''']
+
| ''Team CMIC''<br />F. Prados, M.J. Cardoso, N. Cawley, O. Ciccarelli, C.A.M. Wheeler-Kingshott, & S. Ourselin<br />'''Multi-Contrast PatchMatch Algorithm for Multiple Sclerosis Lesion Detection'''<br />{{pub|doi=10.1016/j.neuroimage.2016.12.064|pubmed=28087490|period=}}
 +
|
 +
| 88.009
 
|-
 
|-
−
| ''Team VISAGES Trois:'' H. Deshpande, P. Maurel, & C. Barillot
+
| colspan="4" style="border-top:1px solid #87cefa;"|
 
|-
 
|-
−
| colspan="2" style="border-top:1px solid #909095;"|
+
| 12
 +
| ''MORF''<br />A. Jog, A. Carass, D.L. Pham, & J.L. Prince<br />'''Multi-Output Random Forests for Lesion Segmentation in Multiple Sclerosis'''<br />{{pub|doi=10.1117/12.2082157|pubmed=27695155|pmcid=5041594|period=}}
 +
|
 +
| 87.917
 
|-
 
|-
−
| rowspan="2" width="15%" | 9:30 - 9:45
+
| colspan="4" style="border-top:1px solid #87cefa;"|
−
| [http://www.iacl.ece.jhu.edu/w/images/d/d6/Xavier_Tomas-Fernandez.pdf '''Model of Population and Subject (MOPS) Segmentation''']
 
 
|-
 
|-
−
| ''Team CRL:'' X. Tomas-Fernandez & S.K. Warfield
+
| 13
 +
| ''Team TIG-BF''<br />C.H. Sudre, M.J. Cardoso, & S. Ourselin<br />'''Model Selection Propagation for Application on Longitudinal MS Lesion Segmentation'''<br />{{pub|doi=10.1016/j.neuroimage.2016.12.064|pubmed=28087490|period=}}
 +
|
 +
| 87.376
 
|-
 
|-
−
| colspan="2" style="border-top:1px solid #909095;"|
+
| colspan="4" style="border-top:1px solid #87cefa;"|
 
|-
 
|-
−
| rowspan="2" width="15%" | 9:45 - 10:00
+
| 14
−
| [http://www.iacl.ece.jhu.edu/w/images/1/19/Suthirth_Vaidya.pdf '''Longitudinal Multiple Sclerosis Lesion Segmentation using 3D Convolutional Neural Networks''']
+
| ''Team CRL''<br />X. Tomas-Fernandez & S.K. Warfield<br />'''Model of Population and Subject (MOPS) Segmentation'''<br />{{pub|doi=10.1016/j.neuroimage.2016.12.064|pubmed=28087490|period=}}
 +
|
 +
| 87.017
 
|-
 
|-
−
| ''Team IIT Madras:'' S. Vaidya, A. Chunduru, R. Muthuganapathy, & G. Krishnamurthi
+
| colspan="4" style="border-top:1px solid #87cefa;"|
 
|-
 
|-
−
| colspan="2" style="border-top:1px solid #909095;"|
+
| 15
 +
| ''Team DIAG''<br />M. Ghafoorian & B. Platel<br />'''Convolution Neural Networks for MS Lesion Segmentation'''<br />{{pub|doi=10.1016/j.neuroimage.2016.12.064|pubmed=28087490|period=}}
 +
|
 +
| 86.916
 
|-
 
|-
−
| rowspan="2" width="15%" | 10:00 - 10:15
+
| colspan="4" style="border-top:1px solid #87cefa;"|
−
| [http://www.iacl.ece.jhu.edu/w/images/7/72/Andrew_Jesson.pdf '''Hierarchical MRF and Random Forest Segmentation of MS Lesions and Healthy Tissues in Brain MRI''']
 
 
|-
 
|-
−
| ''Team PVG_1:'' A. Jesson & T. Arbel
+
| 16
 +
| ''Team TIG''<br />C.H. Sudre, M.J. Cardoso, & S. Ourselin<br />'''Model Selection Propagation for Application on Longitudinal MS Lesion Segmentation'''<br />{{pub|doi=10.1016/j.neuroimage.2016.12.064|pubmed=28087490|period=}}
 +
|
 +
| 86.436
 
|-
 
|-
−
| colspan="2" style="border-top:1px solid #909095;"|
+
| colspan="4" style="border-top:1px solid #87cefa;"|
 
|-
 
|-
−
| 10:15 - 10:30
+
| 17
−
| align="center" | '''''Coffee Break'''''
+
| ''Team VISAGES DL''<br />H. Deshpande, P. Maurel, & C. Barillot<br />'''Sparse Representations and Dictionary Learning Based Longitudinal Segmentation of Multiple Sclerosis Lesions'''<br />{{pub|doi=10.1016/j.neuroimage.2016.12.064|pubmed=28087490|period=}}
 +
|
 +
| 86.068
 
|-
 
|-
−
| colspan="2" style="border-top:1px solid #909095;"|
+
| colspan="4" style="border-top:1px solid #87cefa;"|
 
|-
 
|-
−
| rowspan="2" width="15%" | 10:30 - 10:45
+
| 18
−
| [http://www.iacl.ece.jhu.edu/w/images/d/d7/Oskar_Maier.pdf '''MS-Lesion Segmentation in MRI with Random Forests''']
+
| ''Team BAUMIP''<br />L.O. Iheme & D. Unay<br />'''Automatic White Matter Hyperintensity Segmentation using FLAIR MRI'''<br />{{pub|doi=10.1016/j.neuroimage.2016.12.064|pubmed=28087490|period=}}
 +
|
 +
| 84.140
 
|-
 
|-
−
| ''Team IMI:'' O. Maier & H. Handels
+
| colspan="4" style="border-top:1px solid #87cefa;"|
−
|-
 
−
| colspan="2" style="border-top:1px solid #909095;"|
 
−
|-
 
−
| rowspan="2" width="15%" | 10:45 - 11:00
 
−
| [http://www.iacl.ece.jhu.edu/w/images/c/ca/Leonardo_Iheme.pdf '''Automatic White Matter Hyperintensity Segmentation using FLAIR MRI''']
 
−
|-
 
−
| ''Team BAUMIP:'' L.O. Iheme & D. Unay
 
−
|-
 
−
| colspan="2" style="border-top:1px solid #909095;"|
 
−
|-
 
−
| rowspan="2" width="15%" | 11:00 - 11:15
 
−
| [http://www.iacl.ece.jhu.edu/w/images/b/ba/Saurabh_Jain.pdf '''Automatic Longitudinal Multiple Sclerosis Lesion Segmentation''']
 
−
|-
 
−
| ''Team MS*metrix*:'' S. Jain, D.M. Sima, & D. Smeets
 
−
|-
 
−
| colspan="2" style="border-top:1px solid #909095;"|
 
−
|-
 
−
| rowspan="2" width="15%" | 11:15 - 11:30
 
−
| [http://www.iacl.ece.jhu.edu/w/images/5/52/Mohsen_Ghafoorian.pdf '''Convolution Neural Networks for MS Lesion Segmentation''']
 
−
|-
 
−
| ''Team DIAG:'' M. Ghafoorian & B. Platel
 
−
|-
 
−
| colspan="2" style="border-top:1px solid #909095;"|
 
−
|-
 
−
| rowspan="2" width="15%" | 11:30 - 11:45
 
−
| [http://www.iacl.ece.jhu.edu/w/images/7/79/Carole_Sudre.pdf '''Model Selection Propagation for Application on Longitudinal MS Lesion Segmentation''']
 
−
|-
 
−
| ''Team TIG-UCL:'' C.H. Sudre, M.J. Cardoso, & S. Ourselin
 
−
|-
 
−
| colspan="2" style="border-top:1px solid #909095;"|
 
−
|-
 
−
| rowspan="2" width="15%" | 11:45 - 12:15
 
−
| '''Explanation of the Evaluation, Prize Ceremony, and Discussion'''
 
−
|-
 
−
| Dzung L. Pham
 
−
|-
 
−
| colspan="2" style="border-top:1px solid #909095;"|
 
 
|-
 
|-
 
|}
 
|}
−
 
+
-->
−
 
 
−
{{h3|VI. Visa Information}}
 
−
The ISBI organizers provide information about applying for a [http://biomedicalimaging.org/2015/attendees/travel-visa-information-2/ Travel Visa] to the [http://biomedicalimaging.org/2015/attendees/travel-visa-information-2/ US]. They also provide an [http://biomedicalimaging.org/2015/wp-content/uploads/2015/01/Visa-Letter-signed.pdf Invitation Letter].
 
  
  
 
{{h3|VII. Organizers}}
 
{{h3|VII. Organizers}}
−
'''Primary Organizer:'''  <br>
+
'''Primary Organizer:'''  <br />
 
[mailto:dzung.pham@nih.gov Dzung Pham], Center for Neuroscience and Regenerative Medicine, Henry M. Jackson Foundation for the Advancement of Military Medicine, Bethesda, MD
 
[mailto:dzung.pham@nih.gov Dzung Pham], Center for Neuroscience and Regenerative Medicine, Henry M. Jackson Foundation for the Advancement of Military Medicine, Bethesda, MD
  
−
'''Organizing committee members:'''<br>
+
'''Organizing committee members:'''<br />
 
[http://www.cbs.mpg.de/staff/bazin-11500 Pierre-Louis Bazin], Department of Neurophysics, Max Planck Institute, Leipzig, Germany<br>
 
[http://www.cbs.mpg.de/staff/bazin-11500 Pierre-Louis Bazin], Department of Neurophysics, Max Planck Institute, Leipzig, Germany<br>
 
{{iacl|~aaron/|Aaron Carass}}, Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD<br>
 
{{iacl|~aaron/|Aaron Carass}}, Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD<br>
Line 194: Line 181:
  
 
{{h3|VIII. Funding support}}
 
{{h3|VIII. Funding support}}
−
This challenge is supported in part by a grant from the [http://www.ninds.nih.gov/ National Institute of Neurological Disorders and Stroke] (NINDS R01 NS070906).  Funding for prizes is supported by the [http://www.nationalmssociety.org/ National Multiple Sclerosis Society].
+
This challenge was supported in part by a grant from the [http://www.ninds.nih.gov/ National Institute of Neurological Disorders and Stroke] (NINDS R01 NS070906).  Funding for prizes was provided by the [http://www.nationalmssociety.org/ National Multiple Sclerosis Society].

Latest revision as of 00:59, 3 July 2022

The 2015 Longitudinal MS Lesion Segmentation Challenge

2015 Longitudinal MS Lesion Segmentation Challenge
MS Challenge Overview MS Challenge Data MS Challenge Evaluation

I. Introduction

2015 Longitudinal Multiple Sclerosis Lesion Segmentation Challenge

The Longitudinal MS Lesion Segmentation Challenge was conducted at the 2015 International Symposium on Biomedical Imaging in New York, NY, April 16-19. Competing teams applied their automatic lesion segmentation algorithms to MR neuroimaging data acquired at multiple time points from MS patients. Algorithms were evaluated against manual segmentations from two raters in terms of their segmentation accuracy and ability to track lesion evolution.

34 Teams initially registered for the Challenge coming from 15 different countries, representing 27 different institutions/universities. Congratulations to Team IIT Madras (First Prize), Team PVG_1 (Second Prize), and Team IMI (Third Prize and Efficiency Prize)!

Information about the data is available here, and the evaluation software from here.


Leaderboard & Paper

A live leaderboard is maintained on the Smart Stats Website. The main Challenge article has appeared in NeuroImage:

  • A. Carass, S. Roy, A. Jog, J.L. Cuzzocreo, E. Magrath, A. Gherman, J. Button, J. Nguyen, F. Prados, C.H. Sudre, M.J. Cardoso, N. Cawley, O. Ciccarelli, C.A.M. Wheeler-Kingshott, S. Ourselin, L. Catanese, H. Deshpande, P. Maurel, O. Commowick, C. Barillot, X. Tomas-Fernandez, S.K. Warfield, S. Vaidya, A. Chunduru, R. Muthuganapathy, G. Krishnamurthi, A. Jesson, T. Arbel, O. Maier, H. Handels, L.O. Iheme, D. Unay, S. Jain, D.M. Sima, D. Smeets, M. Ghafoorian, B. Platel, A. Birenbaum, H. Greenspan, P.-L. Bazin, P.A. Calabresi, C.M. Crainiceanu, L.M. Ellingsen, D.S. Reich, J.L. Prince, and D.L. Pham, "Longitudinal Multiple Sclerosis Lesion Segmentation: Resource and Challenge", NeuroImage, 148(C):77-102, 2017. (doi) (PubMed)

and a companion paper has appeared in Data in Brief:

  • A. Carass, S. Roy, A. Jog, J.L. Cuzzocreo, E. Magrath, A. Gherman, J. Button, J. Nguyen, P.-L. Bazin, P.A. Calabresi, C.M. Crainiceanu, L.M. Ellingsen, D.S. Reich, J.L. Prince, and D.L. Pham, "Longitudinal multiple sclerosis lesion segmentation data resource", Data in Brief, 12:346-350, 2017. (doi) (PubMed)



VII. Organizers

Primary Organizer:
Dzung Pham, Center for Neuroscience and Regenerative Medicine, Henry M. Jackson Foundation for the Advancement of Military Medicine, Bethesda, MD

Organizing committee members:
Pierre-Louis Bazin, Department of Neurophysics, Max Planck Institute, Leipzig, Germany
Aaron Carass, Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD
Peter Calabresi, Department of Neurology, Johns Hopkins University, Baltimore, MD
Ciprian Crainiceanu, Department of Biostatistics, Johns Hopkins University, Baltimore, MD
Lotta Ellingsen, Department of Electrical and Computer Engineering, University of Iceland, Reykjavik, Iceland
Qing He, Center for Neuroscience and Regenerative Medicine, Henry Jackson Foundation, Bethesda, MD
Jerry Prince, Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD
Daniel Reich, Translational Neuroradiology Unit, National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD
Snehashis Roy, Center for Neuroscience and Regenerative Medicine, Henry Jackson Foundation, Bethesda, MD


VIII. Funding support

This challenge was supported in part by a grant from the National Institute of Neurological Disorders and Stroke (NINDS R01 NS070906). Funding for prizes was provided by the National Multiple Sclerosis Society.

Retrieved from "https://iacl.ece.jhu.edu/index.php?title=MSChallenge&oldid=17846"