ML-CDS 2020: Multimodal Learning for Clinical Decision Support


In conjunction with MICCAI 2020, Lima, Peru

With advances in electronic patient record systems, a large number of pre-diagnosed patient data sets are now becoming available. These data sets are often multimodal consisting of images (x-ray, CT, MRI), videos and other time series, and textual data (free text reports and structured clinical data). In addition, with the routine availability of whole slide scanning technology, whole slide imaging is given rise to the field of digital pathology. Additionally for patient diagnosis and prognosis, multi-omics (e.g. genomics, proteomics) data is also obtained. This therefore provides the opportunity for multi-modal and multi-scale characterization of a patient disease profile.

Chest X-ray Challenge
Detection and recognition of tubes and lines in AP Chest X-rays

Analyzing these multimodal sources for disease-specific information across patients can reveal important similarities between patients and hence their underlying diseases and potential treatments. Researchers are now beginning to develop multimodal learning techniques on disease-specific information in modalities to find supporting evidence for a disease or to automatically learn associations of symptoms and their appearance in imaging. The role of clinical knowledge is also being actively explored. Benchmarking frameworks such as ImageCLEF (Image retrieval track in the Cross-Language Evaluation Forum) and Visceral have expanded over the past five years to include large medical image collections for testing. However, accurate ground truth labeling of large scale datasets is proving to be a challenging problem.

The goal of this workshop is to bring together imaging researchers and clinicians working in machine learning on multimodal data sets for clinical decision support and treatment planning to present and discuss latest developments in the field. Specifically, researchers interested in multimodal learning, biomedical imaging, medical image retrieval, data mining, text retrieval, and machine learning/AI communities will be co-located with clinicians who use computer-aided diagnosis and clinical decision support tools to not only discuss new techniques of multimodal learning but also their translation to clinical decision support in practice. We are looking for original, high-quality submissions that address innovative research and development in the learning of multimodal medical data for use in clinical decision support and treatment planning.