Panoptica -- instance-wise evaluation of 3D semantic and instance segmentation maps
Authors:
Florian Kofler,
Hendrik Möller,
Josef A. Buchner,
Ezequiel de la Rosa,
Ivan Ezhov,
Marcel Rosier,
Isra Mekki,
Suprosanna Shit,
Moritz Negwer,
Rami Al-Maskari,
Ali Ertürk,
Shankeeth Vinayahalingam,
Fabian Isensee,
Sarthak Pati,
Daniel Rueckert,
Jan S. Kirschke,
Stefan K. Ehrlich,
Annika Reinke,
Bjoern Menze,
Benedikt Wiestler,
Marie Piraud
Abstract:
This paper introduces panoptica, a versatile and performance-optimized package designed for computing instance-wise segmentation quality metrics from 2D and 3D segmentation maps. panoptica addresses the limitations of existing metrics and provides a modular framework that complements the original intersection over union-based panoptic quality with other metrics, such as the distance metric Average…
▽ More
This paper introduces panoptica, a versatile and performance-optimized package designed for computing instance-wise segmentation quality metrics from 2D and 3D segmentation maps. panoptica addresses the limitations of existing metrics and provides a modular framework that complements the original intersection over union-based panoptic quality with other metrics, such as the distance metric Average Symmetric Surface Distance. The package is open-source, implemented in Python, and accompanied by comprehensive documentation and tutorials. panoptica employs a three-step metrics computation process to cover diverse use cases. The efficacy of panoptica is demonstrated on various real-world biomedical datasets, where an instance-wise evaluation is instrumental for an accurate representation of the underlying clinical task. Overall, we envision panoptica as a valuable tool facilitating in-depth evaluation of segmentation methods.
△ Less
Submitted 5 December, 2023;
originally announced December 2023.
All Sizes Matter: Improving Volumetric Brain Segmentation on Small Lesions
Authors:
Ayhan Can Erdur,
Daniel Scholz,
Josef A. Buchner,
Stephanie E. Combs,
Daniel Rueckert,
Jan C. Peeken
Abstract:
Brain metastases (BMs) are the most frequently occurring brain tumors. The treatment of patients having multiple BMs with stereo tactic radiosurgery necessitates accurate localization of the metastases. Neural networks can assist in this time-consuming and costly task that is typically performed by human experts. Particularly challenging is the detection of small lesions since they are often under…
▽ More
Brain metastases (BMs) are the most frequently occurring brain tumors. The treatment of patients having multiple BMs with stereo tactic radiosurgery necessitates accurate localization of the metastases. Neural networks can assist in this time-consuming and costly task that is typically performed by human experts. Particularly challenging is the detection of small lesions since they are often underrepresented in exist ing approaches. Yet, lesion detection is equally important for all sizes. In this work, we develop an ensemble of neural networks explicitly fo cused on detecting and segmenting small BMs. To accomplish this task, we trained several neural networks focusing on individual aspects of the BM segmentation problem: We use blob loss that specifically addresses the imbalance of lesion instances in terms of size and texture and is, therefore, not biased towards larger lesions. In addition, a model using a subtraction sequence between the T1 and T1 contrast-enhanced sequence focuses on low-contrast lesions. Furthermore, we train additional models only on small lesions. Our experiments demonstrate the utility of the ad ditional blob loss and the subtraction sequence. However, including the specialized small lesion models in the ensemble deteriorates segmentation results. We also find domain-knowledge-inspired postprocessing steps to drastically increase our performance in most experiments. Our approach enables us to submit a competitive challenge entry to the ASNR-MICCAI BraTS Brain Metastasis Challenge 2023.
△ Less
Submitted 4 October, 2023;
originally announced October 2023.
