MedShapeNet Tutorial

MICCAI - October 2024

Welcome to our MICCAI (2024) tutorial website for MedShapeNet. Here, you can find essential information about the program, speakers, organizers, and useful links:

We invite you to join our tutorial. If you have any questions, please contact us.

MedShapeNet Overview

Before the deep learning era, statistical shape models (SSMs) were widely used in medical imaging. MedShapeNet builds upon this foundation, aiming to bridge computer vision methods to medical problems and clinical applications, inspired by benchmarks like ShapeNet and Princeton ModelNet.

MedShapeNet boasts a collection of over 100,000 medical shapes, covering bones, organs, vessels, muscles, and surgical instruments. These shapes can be searched, viewed in 3D, and downloaded individually using our shape search engine. It’s important to note that MedShapeNet is intended for research and educational purposes only. MedShapNet usefullness was demonstrated by its incorporation in research papers.

Tutorial

The tutorial spans 4.5 hours and focuses on 3D shape analysis in medical imaging. It includes a hands-on session utilizing MedShapeNetCore. Topics covered include motivation, shape acquisition, processing pipelines, and selected use cases. Our organizing team includes esteemed members such as Dr. Zongwei Zhou, Dr. Jiancheng Yang, and Dr. Beatriz Paniagua. For more detailed information, please refer to the program section.

MedShapeNet contains diverse medical datasets, including anatomies (upper right), pathologies (upper left), and medical instruments (lower). We refer to the MedShapeNet paper for more information on each individual dataset and its citation.
MedShapeNet contains diverse medical datasets,
including anatomies (upper right), pathologies (upper left), and medical instruments (lower).
We refer to the MedShapeNet paper for more information on each individual dataset and its citation.

Speakers

TBA

Prof. Dr. Xiaojun Chen

Professor Xiaojun Chen, a Full Professor at Shanghai Jiao Tong University (SJTU), China, is a leading authority in biomedical engineering and computer-assisted surgery. With over 200 peer-reviewed articles and 20 patents to his name, his research spans crucial areas such as biomedical image analysis, AI in biomedical physics, and medical robotics. Notably, he has received prestigious awards including the National Science & Technology Progress Award of China (2019) and the “France Talent Innovation (FTI) Program” Award. His international recognition is evident through visiting professorships at Harvard Medical School, CNRS in France, and others.

Dr. Zongwei Zhou

Dr. Zongwei Zhou, a postdoctoral researcher at Johns Hopkins University, is recognized for his groundbreaking work in reducing annotation efforts for computer-aided detection and diagnosis. His accolades, including the AMIA Doctoral Dissertation Award and the MICCAI Young Scientist Award, underscore his contributions to the field. Dr. Zhou’s recognition by Stanford University further highlights his impact and expertise.

Dr. Jiancheng Yang

Dr. Jiancheng Yang, a researcher at EPFL, collaborates with Prof. Pascal Fua on AI for health, medical image analysis, and 3D vision. With over 50 publications in esteemed journals and conferences, including MICCAI and NeurIPS, Dr. Yang’s research is highly regarded. His success in AI competitions and leadership in organizing MICCAI challenges demonstrate his versatility and expertise.

MSc. Gijs Luijten

M.Sc. Gijs Luijten a PhD candidate on the FWF enFaced 2.0 project, specializes in AR applications for maxillofacial surgery. With experience in 3D scanning, printing, and augmented reality at Radboudumc Nijmegen. He gained experience in Unity and Unreal Engine development, evident in contributions to a surgical scene datasets, HL2 applications, and help with organization of an ISBI challenge. Additionally, he is venturing into machine learning integration for medical shapes and data in extended reality applications.

MSc. Jana Fragemann

M.Sc. Jana Frageman is a mathematician by training, having completed her masters at the University Duisburg Essen. In her PhD research at IKIM she is working on analyzing the latent space representations of supervised and unsupervised generative models for radiological data. She organized prestige events in Essen such as ETIM, and co-organized the MICCAI workshop Medical Applications with Disentanglements (MAD)

Program

Please note that the programme schedule may be subject to change in order to accommodate key-note speakers. Additionally, the time slot for the MICCAI ShapeMi workshop is not yet confirmed, but every effort will be made to enable those interested in the ShapeMi workshop to attend both shape-related events. Both shape-oriented events will take place on day one of the MICCAI 2024 conference.

The tutorial focuses on 3D shape analysis in medical imaging and comprises two main sessions:

(2 Hour) Introduction Session with different keynote speakers

  • Content:
    • Motivation and background of the MedShapeNet
    • 3D medical image analysis: voxels and beyond
      • An overview of classical and modern learning-based shape analysis
    • Retrieval of data on MedShapeNet through its website and API
    • Highlighting a dataset (AbdomenAtlas) and its potential use within the MedShapenet API
  • Format: Presentation/discussion style

(30 min) Break

  • Content:
    • Possibility for networking

(2 Hour) Introduction Session with different keynote speakers

  • Content:
    • MedShapeNet API in combination with MONAI
    • MedShapeNet API in combination with Tensorflow
    • Concept of shape in machine learning and medical image analysis tasks
  • Format: Speaker-led demonstration

Learning Objectives

  • Gain an overview of classical and modern learning-based shape analysis methods.
  • Learn to utilize MedShapeNet for shape data retrieval from its web interface and develop data-driven machine learning models for medical applications.
  • Explore the Python API of MedShapeNet, including its usage in machine learning frameworks like MONAI and TensorFlow.
  • Develop intuition and ability to integrate shape concepts into machine learning and medical image analysis tasks.

Python Toolbox (API)
for 3D Medical Shape Analysis

MedShapeNetCore is a subset of MedShapeNet, containing more lightweight 3D anatomical shapes in the format of mask, point cloud and mesh. The shape data are stored as numpy arrays in nested dictonaries in npz format Zenodo. This API provides means to downloading, accessing and processing the shape data via Python, which integrates MedShapeNetCore seamless into Python-based machine learning workflows.

Organizers

Avatar

Gijs Luijten

Project assistent, PhD student
Institute for AI in Medicine, University Hospital Essen, Germany

Avatar

Jianning Li

Former Postdoc
Institute for AI in Medicine, University Hospital Essen, Germany

Avatar

Zongwei Zhou

Postdoctoral researcher at Johns Hopkins University

Avatar

Jiancheng Yang

Postdoctoral researcher at Swiss Federal Institute of Technology Lausanne

Avatar

Jana Fragemann

PhD Student
Institute for AI in Medicine, University Hospital Essen, Germany

Avatar

Miriam Balzer

PhD student
Institute for AI in Medicine, University Hospital Essen, Germany

Avatar

Beatrix Paniagua

Asst. Professor and assistant director of Kitware’s Medical Computing Team at Carrboro, North Carolina

Avatar

Jens Kleesiek

Professor of Translational Image-guided Oncology
Institute for AI in Medicine, University Hospital Essen, Germany

Avatar

Jan Egger

Professor & Team Lead AI-guided Therapies AR/VR
Institute for AI in Medicine, University Hospital Essen, Germany

Contact

Master students are encouraged to mail when interested in an internship.