MedShapeNet -- A Large-Scale Dataset of 3D Medical Shapes for Computer Vision
Authors:
Jianning Li,
Zongwei Zhou,
Jiancheng Yang,
Antonio Pepe,
Christina Gsaxner,
Gijs Luijten,
Chongyu Qu,
Tiezheng Zhang,
Xiaoxi Chen,
Wenxuan Li,
Marek Wodzinski,
Paul Friedrich,
Kangxian Xie,
Yuan Jin,
Narmada Ambigapathy,
Enrico Nasca,
Naida Solak,
Gian Marco Melito,
Viet Duc Vu,
Afaque R. Memon,
Christopher Schlachta,
Sandrine De Ribaupierre,
Rajnikant Patel,
Roy Eagleson,
Xiaojun Chen
, et al. (132 additional authors not shown)
Abstract:
Prior to the deep learning era, shape was commonly used to describe the objects. Nowadays, state-of-the-art (SOTA) algorithms in medical imaging are predominantly diverging from computer vision, where voxel grids, meshes, point clouds, and implicit surface models are used. This is seen from numerous shape-related publications in premier vision conferences as well as the growing popularity of Shape…
▽ More
Prior to the deep learning era, shape was commonly used to describe the objects. Nowadays, state-of-the-art (SOTA) algorithms in medical imaging are predominantly diverging from computer vision, where voxel grids, meshes, point clouds, and implicit surface models are used. This is seen from numerous shape-related publications in premier vision conferences as well as the growing popularity of ShapeNet (about 51,300 models) and Princeton ModelNet (127,915 models). For the medical domain, we present a large collection of anatomical shapes (e.g., bones, organs, vessels) and 3D models of surgical instrument, called MedShapeNet, created to facilitate the translation of data-driven vision algorithms to medical applications and to adapt SOTA vision algorithms to medical problems. As a unique feature, we directly model the majority of shapes on the imaging data of real patients. As of today, MedShapeNet includes 23 dataset with more than 100,000 shapes that are paired with annotations (ground truth). Our data is freely accessible via a web interface and a Python application programming interface (API) and can be used for discriminative, reconstructive, and variational benchmarks as well as various applications in virtual, augmented, or mixed reality, and 3D printing. Exemplary, we present use cases in the fields of classification of brain tumors, facial and skull reconstructions, multi-class anatomy completion, education, and 3D printing. In future, we will extend the data and improve the interfaces. The project pages are: https://medshapenet.ikim.nrw/ and https://github.com/Jianningli/medshapenet-feedback
△ Less
Submitted 12 December, 2023; v1 submitted 30 August, 2023;
originally announced August 2023.
Narrative Visualization to Communicate Neurological Diseases
Authors:
Sarah Mittenentzwei,
Veronika Weiß,
Stefanie Schreiber,
Laura A. Garrison,
Stefan Bruckner,
Malte Pfister,
Bernhard Preim,
Monique Meuschke
Abstract:
While narrative visualization has been used successfully in various applications to communicate scientific data in the format of a story to a general audience, the same has not been true for medical data. There are only a few exceptions that present tabular medical data to non-experts. However, a key component of medical visualization is the interactive analysis of 3D data, such as 3D models of an…
▽ More
While narrative visualization has been used successfully in various applications to communicate scientific data in the format of a story to a general audience, the same has not been true for medical data. There are only a few exceptions that present tabular medical data to non-experts. However, a key component of medical visualization is the interactive analysis of 3D data, such as 3D models of anatomical structures, which were rarely included in narrative visualizations so far. In this design study, we investigate how neurological disease data can be communicated through narrative visualization techniques to a general audience in an understandable way. We designed a narrative visualization explaining cerebral small vessel disease. Learning about its avoidable risk factors serves to motivate the audience watching the resulting visual data story. Using this example, we discuss the adaption of basic narrative components. This includes the conflict and characters of a story, as well as the story's structure and content to address and communicate specific characteristics of medical data. Furthermore, we explore the extent to which complex medical relationships need to be simplified to be understandable to a general audience without distorting the underlying data and evidence. In particular, the data needs to be preprocessed for non-experts and appropriate forms of interaction must be found. We explore approaches to make the data more personally relatable, such as including a fictional patient. We evaluated our approach in a user study with 40 participants in a web-based implementation of the designed story. We found that the combination of a carefully thought-out storyline with a clear key message, appealing visualizations combined with easy-to-use interactions, and credible references are crucial for creating a narrative visualization about a neurological disease that engages an audience.
△ Less
Submitted 20 December, 2022;
originally announced December 2022.
Random Hinge Forest for Differentiable Learning
Authors:
Nathan Lay,
Adam P. Harrison,
Sharon Schreiber,
Gitesh Dawer,
Adrian Barbu
Abstract:
We propose random hinge forests, a simple, efficient, and novel variant of decision forests. Importantly, random hinge forests can be readily incorporated as a general component within arbitrary computation graphs that are optimized end-to-end with stochastic gradient descent or variants thereof. We derive random hinge forest and ferns, focusing on their sparse and efficient nature, their min-max…
▽ More
We propose random hinge forests, a simple, efficient, and novel variant of decision forests. Importantly, random hinge forests can be readily incorporated as a general component within arbitrary computation graphs that are optimized end-to-end with stochastic gradient descent or variants thereof. We derive random hinge forest and ferns, focusing on their sparse and efficient nature, their min-max margin property, strategies to initialize them for arbitrary network architectures, and the class of optimizers most suitable for optimizing random hinge forest. The performance and versatility of random hinge forests are demonstrated by experiments incorporating a variety of of small and large UCI machine learning data sets and also ones involving the MNIST, Letter, and USPS image datasets. We compare random hinge forests with random forests and the more recent backpropagating deep neural decision forests.
△ Less
Submitted 1 March, 2018; v1 submitted 11 February, 2018;
originally announced February 2018.
