-
Getting aligned on representational alignment
Authors:
Ilia Sucholutsky,
Lukas Muttenthaler,
Adrian Weller,
Andi Peng,
Andreea Bobu,
Been Kim,
Bradley C. Love,
Erin Grant,
Iris Groen,
Jascha Achterberg,
Joshua B. Tenenbaum,
Katherine M. Collins,
Katherine L. Hermann,
Kerem Oktar,
Klaus Greff,
Martin N. Hebart,
Nori Jacoby,
Qiuyi Zhang,
Raja Marjieh,
Robert Geirhos,
Sherol Chen,
Simon Kornblith,
Sunayana Rane,
Talia Konkle,
Thomas P. O'Connell
, et al. (5 additional authors not shown)
Abstract:
Biological and artificial information processing systems form representations that they can use to categorize, reason, plan, navigate, and make decisions. How can we measure the extent to which the representations formed by these diverse systems agree? Do similarities in representations then translate into similar behavior? How can a system's representations be modified to better match those of an…
▽ More
Biological and artificial information processing systems form representations that they can use to categorize, reason, plan, navigate, and make decisions. How can we measure the extent to which the representations formed by these diverse systems agree? Do similarities in representations then translate into similar behavior? How can a system's representations be modified to better match those of another system? These questions pertaining to the study of representational alignment are at the heart of some of the most active research areas in cognitive science, neuroscience, and machine learning. For example, cognitive scientists measure the representational alignment of multiple individuals to identify shared cognitive priors, neuroscientists align fMRI responses from multiple individuals into a shared representational space for group-level analyses, and ML researchers distill knowledge from teacher models into student models by increasing their alignment. Unfortunately, there is limited knowledge transfer between research communities interested in representational alignment, so progress in one field often ends up being rediscovered independently in another. Thus, greater cross-field communication would be advantageous. To improve communication between these fields, we propose a unifying framework that can serve as a common language between researchers studying representational alignment. We survey the literature from all three fields and demonstrate how prior work fits into this framework. Finally, we lay out open problems in representational alignment where progress can benefit all three of these fields. We hope that our work can catalyze cross-disciplinary collaboration and accelerate progress for all communities studying and developing information processing systems. We note that this is a working paper and encourage readers to reach out with their suggestions for future revisions.
△ Less
Submitted 2 November, 2023; v1 submitted 18 October, 2023;
originally announced October 2023.
-
Rapid head-pose detection for automated slice prescription of fetal-brain MRI
Authors:
Malte Hoffmann,
Esra Abaci Turk,
Borjan Gagoski,
Leah Morgan,
Paul Wighton,
M. Dylan Tisdall,
Martin Reuter,
Elfar Adalsteinsson,
P. Ellen Grant,
Lawrence L. Wald,
André J. W. van der Kouwe
Abstract:
In fetal-brain MRI, head-pose changes between prescription and acquisition present a challenge to obtaining the standard sagittal, coronal and axial views essential to clinical assessment. As motion limits acquisitions to thick slices that preclude retrospective resampling, technologists repeat ~55-second stack-of-slices scans (HASTE) with incrementally reoriented field of view numerous times, ded…
▽ More
In fetal-brain MRI, head-pose changes between prescription and acquisition present a challenge to obtaining the standard sagittal, coronal and axial views essential to clinical assessment. As motion limits acquisitions to thick slices that preclude retrospective resampling, technologists repeat ~55-second stack-of-slices scans (HASTE) with incrementally reoriented field of view numerous times, deducing the head pose from previous stacks. To address this inefficient workflow, we propose a robust head-pose detection algorithm using full-uterus scout scans (EPI) which take ~5 seconds to acquire. Our ~2-second procedure automatically locates the fetal brain and eyes, which we derive from maximally stable extremal regions (MSERs). The success rate of the method exceeds 94% in the third trimester, outperforming a trained technologist by up to 20%. The pipeline may be used to automatically orient the anatomical sequence, removing the need to estimate the head pose from 2D views and reducing delays during which motion can occur.
△ Less
Submitted 8 October, 2021;
originally announced October 2021.
-
Equivariant Filters for Efficient Tracking in 3D Imaging
Authors:
Daniel Moyer,
Esra Abaci Turk,
P Ellen Grant,
William M. Wells,
Polina Golland
Abstract:
We demonstrate an object tracking method for 3D images with fixed computational cost and state-of-the-art performance. Previous methods predicted transformation parameters from convolutional layers. We instead propose an architecture that does not include either flattening of convolutional features or fully connected layers, but instead relies on equivariant filters to preserve transformations bet…
▽ More
We demonstrate an object tracking method for 3D images with fixed computational cost and state-of-the-art performance. Previous methods predicted transformation parameters from convolutional layers. We instead propose an architecture that does not include either flattening of convolutional features or fully connected layers, but instead relies on equivariant filters to preserve transformations between inputs and outputs (e.g. rot./trans. of inputs rotate/translate outputs). The transformation is then derived in closed form from the outputs of the filters. This method is useful for applications requiring low latency, such as real-time tracking. We demonstrate our model on synthetically augmented adult brain MRI, as well as fetal brain MRI, which is the intended use-case.
△ Less
Submitted 27 September, 2021; v1 submitted 18 March, 2021;
originally announced March 2021.
-
Longitudinal structural connectomic and rich-club analysis in adolescent mTBI reveals persistent, distributed brain alterations acutely through to one year post-injury
Authors:
Ai Wern Chung,
Rebekah Mannix,
Henry A. Feldman,
P. Ellen Grant,
Kiho Im
Abstract:
The diffused nature of mild traumatic brain injury (mTBI) impacts brain white-matter pathways with potentially long-term consequences, even after initial symptoms have resolved. To understand post-mTBI recovery in adolescents, longitudinal studies are needed to determine the interplay between highly individualised recovery trajectories and ongoing development. To capture the distributed nature of…
▽ More
The diffused nature of mild traumatic brain injury (mTBI) impacts brain white-matter pathways with potentially long-term consequences, even after initial symptoms have resolved. To understand post-mTBI recovery in adolescents, longitudinal studies are needed to determine the interplay between highly individualised recovery trajectories and ongoing development. To capture the distributed nature of mTBI and recovery, we employ connectomes to probe the brain's structural organisation. We present a diffusion MRI study on adolescent mTBI subjects scanned one day, two weeks and one year after injury with controls. Longitudinal global network changes over time suggests an altered and more 'diffuse' network topology post-injury (specifically lower transitivity and global efficiency). Stratifying the connectome by its back-bone, known as the 'rich-club', these network changes were driven by the 'peripheral' local subnetwork by way of increased network density, fractional anisotropy and decreased diffusivities. This increased structural integrity of the local subnetwork may be to compensate for an injured network, or it may be robust to mTBI and is exhibiting a normal developmental trend. The rich-club also revealed lower diffusivities over time with controls, potentially indicative of longer-term structural ramifications. Our results show evolving, diffuse alterations in adolescent mTBI connectomes beginning acutely and continuing to one year.
△ Less
Submitted 17 September, 2019;
originally announced September 2019.
-
Network Structural Dependency in the Human Connectome Across the Life-Span
Authors:
Markus D. Schirmer,
Ai Wern Chung,
P. Ellen Grant,
Natalia S. Rost
Abstract:
Principles of network topology have been widely studied in the human connectome. Of particular interest is the modularity of the human brain, where the connectome is divided into subnetworks and subsequently changes with development, aging or disease are investigated. We present a weighted network measure, the Network Dependency Index (NDI), to identify an individual region's importance to the glo…
▽ More
Principles of network topology have been widely studied in the human connectome. Of particular interest is the modularity of the human brain, where the connectome is divided into subnetworks and subsequently changes with development, aging or disease are investigated. We present a weighted network measure, the Network Dependency Index (NDI), to identify an individual region's importance to the global functioning of the network. Importantly, we utilize NDI to differentiate four subnetworks (Tiers) in the human connectome following Gaussian Mixture Model fitting. We analyze the topological aspects of each subnetwork with respect to age and compare it to rich-club based subnetworks (rich-club, feeder and seeder). Our results first demonstrate the efficacy of NDI to identify more consistent, central nodes of the connectome across age-groups, when compared to the rich-club framework. Stratifying the connectome by NDI led to consistent subnetworks across the life-span revealing distinct patterns associated with age where, e.g., the key relay nuclei and cortical regions are contained in a subnetwork with highest NDI. The divisions of the human connectome derived from our data-driven NDI framework have the potential to reveal topological alterations described by network measures through the life-span.
△ Less
Submitted 2 February, 2019; v1 submitted 23 October, 2018;
originally announced October 2018.
