HOA Subcortical Brain Structure Segmentation Manual
HOA Subcortical Brain Structure Segmentation Manual
J. Rushmore
H. Carrington
J. Chen
N. Prunier
E. Rizzoni
B. Vessey
P. Wilson-Braun
E. Yeterian*
N. Makris*
*equal contributions
Introduction
The purpose of this manual is to present procedures for reliable and accurate neuroanatomical
segmentation of imaging data. These procedures use the 3D Slicer software platform, in which a
specific segmentation module has been developed. This module is based on principles set forth by
the founders of MRI-based volumetric morphometry or volumetrics (Caviness. et al., 1999).
Volumetric morphometry began in 1987 at the Center of Morphometric Analysis (CMA)
Massachusetts General Hospital (MGH) and later was used to validate FreeSurfer automated
volumetric methodology (Fischl et al., 2002, 2004). The original CMA approach to MRI-based
volumetric analysis used a custom-designed software platform called Cardviews. The tools and
procedures developed for CardViews, which incorporated semi-automated and manual editing,
have been adapted to the 3D Slicer
environment as a specific neurosegmentation
module. This module is designed to be used
in conjunction with procedures described in
this manual to perform semi-automated and
manual editing of subcortical brains
structures.
Basics of segmentation
3D Slicer is a visualization and analysis program for neuroimaging. 3D Slicer loads a brain volume
and visualizes 2D sections of the brain in the coronal, axial, and sagittal planes. This program is
also used to identify regions of the brain and label those areas. This guide presumes that 3D Slicer
is installed on the computer (https://www.slicer.org).
When 3D Slicer is first opened, a screen similar to the one displayed above will appear. The screen
contains three main regions. The main toolbar (yellow arrow above) is a row of buttons, dropdown
menus and commands. This is the location where common operations are accessed, such as the
command to load data (white arrow). On the welcome screen (figure above), the Load Data button
can also be found on the left-hand side of the main screen (lower white arrow). On the right-hand
part of the screen, four windows are present. The window with the blue background will show a
3D rendering of the segmented brain regions, and the three windows in black will each display a
cardinal view of the MRI image - one view is in the axial plane, one is in the sagittal plane, and
one is in the coronal plane. Segmenting is performed in the 2D windows to generate a 3D object.
The NeuroSegmentation module contains many of the functions from these three modules. To
select the NeuroSegmentatioin module, click the Search icon next to the dropdown menu (red
circle), type NeuroSegmentation, and select the module that appears in the list.
1. Loading files
To begin, load an MRI dataset. This will be a T1-weighted MRI volume. Images acquired with a
T1 weight accentuate certain tissue properties and are conventionally used for segmentation. After
clicking the Load Data button a window will be opened. At the top of the window, identify and
depress the Choose File to Add button, and in the subsequent window, navigate through the folders
on the computer until the folder with the T1-weighted MRI file is located. This guide presumes
that preprocessing has been performed (intensity correction, and spatial normalization). Be sure to
clarify whether these operations have been performed prior to proceeding. Select the file and
depress the OK button at the lower left of the subsequent window. If four visualization windows
are not observed, click on the button next to the arrow button in the Main toolbar and select Four-
Up.
After a brief loading window, three images should appear, one for each orthogonal viewing plane
of the brain. The red window typically contains
images in the axial plane (A in figure to right), the
yellow window contains images in the sagittal
plane (S in figure to right), and the green window
shows images in the coronal plane (C in figure to
right). Use the horizontal slide bars above each
window to cycle through the images. The three
windows each contain different views of the same
volume, and it is often of utility to view a structure
using all three views at once. To facilitate this,
depress the Crosshair button, which is located on
the Main toolbar on the far right. Position the
mouse over any image and depress and hold the
Shift key. Moving the mouse will reposition the
crosshairs on the image such that the center of the
crosshair is at the mouse point. The center of the
crosshair identifies a single point in the brain
volume visualized in the different orientations in
the three windows.
Go to the Segment Editor module in the module selector dropdown menu in the Main Toolbar.
Notice that the entire left part of the window will now be filled with new buttons and drop-down
menus. Identify a drop-down menu next to the Segmentation button. Select ‘Create New
Segmentation As’ in this drop-down menu. In the window that then opens, name the segmentation
file. It is useful to identify the case and the operator (i.e. the person performing the segmentation)
in the segmentation name. For example, for the subcortical segmentation of Case 015, name the
segmentation Case015_SubcorticalSegmentation_XX, where XX are the initials of the operator.
For the master volume drop-down menu underneath the ‘Segmentation:’ menu, select the T1
image.
2. Segment Names
Under the Segmentation and Master Volume drop-down menus, depress the large Add button. In
the table underneath, a name will appear, called Segment 1. To the left of the name is an eye icon,
which toggles the visibility of the segment. Next to the eye icon is the color and the opacity.
Double-click on the name to rename the segment in the text box. Clicking on the color box will
produce a second window. Here the segment name can be selected and changed, the color can be
altered, and the segment may be selected based on a list of preexisting structures.
This list of structures should be pre-loaded. In the case it is not, click on the left-hand arrowhead,
an operation which will expand the window. Above the list and at the top of the window, notice a
dropdown menu. Click on the menu and select the relevant list for the study. For subcortical
segmentation, the dropdown is named ‘General Segmentation category and type.’ Make sure the
correct list is present before beginning the study.
A Note About Radiological Imaging. Brain orientation is standardized according to a radiological
convention; namely, the brain is viewed from the perspective of standing at the foot of the bed of
a patient or research subject. Viewed this way, the left side of the patient is on the right of the
screen. This is counterintuitive. A good reminder (initially, at least) is to attach ‘Left’ and ‘Right’
written labels on the monitor.
Segmentation
In this part of the manual, the tools of segmentation will be introduced. When described,
segmentation tools will be referenced by bold and italicized text (e.g., Draw tool). They will be
applied to the lateral ventricle as an example of how to segment a structural brain region of interest
(ROI). Each brain structure will be segmented according to intensity values and neuroanatomical
definitions. Neuroanatomical definitions are provided later in this manual. The means by which
these definitions may be operationalized in the segmentation of MRI images are detailed in the
explanations of specific segmentation tools below.
Understanding the neuroanatomical definition of a brain ROI is critical to specify any structural
border. To label voxels that should be included in the ventricle and exclude voxels that are part of
surrounding white or grey matter, an intensity range needs to be specified in advance. One way to
do this is to select the pointer tab (labeled as ‘None’ to the left of the paint button) and point the
cursor at different voxels in the image. The voxels that correspond to the ventricle on a T1 image
should have low values, and the corresponding intensity values are observed in the lower left-hand
part of the window, under Data Probe (white arrow; the number will appear on the far left of B).
By sampling the voxels in the ventricle and those in the surrounding structures, the intensities to
include in the range to mask the ventricle are obtained. Pick a value that is a good estimate of the
border of the lateral ventricle. Set the lower editable intensity range to 0. Set the upper value as
the estimate that was just made. Label one of the ventricles using the Paint or Draw tool with this
masking range. Note that only the voxels in the specified range should be selected, and those above
the range should be unlabeled. Label the gray and white matter, and then zoom out to evaluate the
results. Try a few different intensities as the upper limit of the mask and view the results. Note that
this approach is time consuming, imperfect, and arbitrary. In addition, changing the brightness of
the image will change the perceived border, and the above method of determining the border would
yield inconsistent results.
A more precise
method has been
developed to
eliminate the
issues identified
above. Before
illustrating this
approach, click on
the Erase button,
and click and drag
over labeled
voxels to
eliminate them.
Click the button
labeled Threshold
and observe that
the whole image
flickers. More
accurately, an
image overlay will cyclically become more and less transparent. This overlay is tied to the intensity
values that appear in a bar under Threshold Range (yellow box in figure above).
This bar is adjustable, and the upper and lower bounds of the editable intensity range can be varied
and seen in real time. This approach is more reliable and accurate than that described above
because a threshold can be generated and the results viewed for the whole image at once, rather
than determining the range by looking at representative voxels. Once a threshold value is
generated, click on the Use for Masking button, and the range is automatically imported into the
masking section.
This tool will now be applied to generate the border of the lateral ventricle. With the Threshold
tool on and the image flickering, click on the arrowhead to the left of 'Local histogram’ (red circle
in image above). This will produce a graph and several buttons.
Now that the tools have been introduced, it is time to segment the lateral ventricle.
The Lateral Ventricle
The shape of the lateral ventricle changes from anterior to posterior. In the image below, the three-
dimensional morphology of the lateral ventricle is depicted in the left panel in a sagittal plane. The
main parts of the lateral ventricle are labeled: the anterior horn, the body, the atrium, the posterior
horn, and the inferior horn. The atrium is the region where the body, the posterior horn and the
inferior horn are confluent. Each numbered panel shows a coronal image through the vertical lines
in the left-hand image, and the outlined ventricle is shown in purple. In the anterior coronal section
(1), the anterior, or frontal, horn of the lateral ventricle appears roughly triangular in shape. The
body of the lateral ventricle is principally located in the frontal lobe of the brain and is represented
in purple outline in the second coronal section (2) where it appears more ovoid. The atrium of the
lateral ventricle is principally located in the parietal lobe and is depicted in the third coronal image
(3) where it extends inferiorly. The posterior, or occipital horn is shown as a small space in the
fourth coronal section (4). The inferior, or temporal, horn of the lateral ventricle (ILV) is identified
in (2) but, by convention, is not included in the segmentation of the lateral ventricle. The ILV will
be segmented as a separate ROI in a later step.
Towards the back of the brain, the atrium of the ventricle will shrink
until it has the appearance of the small purple outline shown on the right
side of the image (also shown at the tip of the red arrow on the left side
of image, and in the 3D image). This is the posterior horn of the lateral
ventricle. In many brains, the posterior horn appears to end in the
anterior occipital lobe, only to reappear in more posterior sections. In
anatomical dissections, these two compartments are continuous and
connected by a collapsed space. This collapsed space is not discernable
using current MRI technology. To be sure this posterior compartment is
segmented, continue scrolling through more posterior coronal sections.
As indicated previously, the segmentation of the lateral ventricle will contain unlabeled voxels
within. These voxels belong to intense portions of the choroid plexus, the vascular structures that
secrete the cerebrospinal fluid inside the ventricles. By convention, the choroid plexus is included
within the lateral ventricle segmentation and therefore these voxels should be labeled. To segment
these pieces of the choroid plexus in the ventricle, use the Draw tool or Paint tool, but turn off the
threshold mask (i.e., uncheck the ‘Editable intensity range’).
In the first pass of this segmentation, the border of the lateral ventricle was created with the white
matter using the Threshold tool. This is accurate and appropriate for the CSF-white matter border
of the lateral ventricle, but not for the border of the ventricle with gray matter structures (e.g., the
caudate nucleus, white arrowheads in image below) that line the lateral ventricle. In the left-hand
image below, the border is illustrated by a purple line. Notice that the superior border of the lateral
ventricle with the white matter is accurate, but the medial, lateral and inferior borders of the
ventricle with gray matter are inaccurate (see arrowheads). In these locations, the borders need to
be modified to produce a correct border (yellow line, right image). Thus, the next step in this
segmentation procedure is to revise the border of the lateral ventricle with gray matter structures.
To do so, select a coronal section similar to that shown to the right. Click on the Threshold button,
and select a circle that includes the CSF space of the lateral ventricle and the caudate nucleus
(yellow circle). As previously, select the peaks. However, this time, change the settings and
depress the Average button as the lower bound, and the Maximum button as the upper bound. Then
select the ‘Use for
masking’ button.
Review the segmentation on axial and sagittal views, and then on the 3D view. For the latter
viewpoint, go to the Segment Editor module window and click on “Show 3D” above the label
names. This will reveal a 3D representation of the lateral ventricle. In the 3D window, click and
drag inside the window to rotate and inspect all aspects of the lateral ventricle (see image below).
This is a good way to examine whether there are any inconsistencies or missing voxels. Inclusion
of the choroid plexus in the lateral ventricle should produce a relatively smooth inferior surface of
the lateral ventricle in 3D. If there is an irregular surface, use the Crosshair tool in the menu bar.
Select ‘Basic Crosshair.’ In Four-panel window view, press Shift and move the cursor to specify
a location at the crosshair in 3D. View the corresponding location in coronal, sagittal or axial slices
to verify the segmentation.
Once the lateral ventricle segmentation is complete, be sure to save the segmentation file. The
Save button is on the Main Toolbar, typically third from the left. Click this button and a window
will appear with several files. The scene file (with a .mrml at its end) saves all the visual
preferences, and files associated with the work. Underneath the scene box are the images (e.g.,
T1w images). Since there are no changes to this file, it will not have a check mark next to it and
will thus not be saved. Below the image file is the segmentation file (e.g., Segmentation.seg.nrrd).
This file will have a check mark next to it and will therefore be saved. The names of the files may
be changed by clicking on them and retyping. Specify the directory in which the files will be saved
by clicking ‘Change directory for selected files.’ Navigate to the folder where the files will be
saved, click OK, then Save.
The process of segmentation is flexible and can be changed as needed. For the current
segmentation of subcortical structures, the following workflow is used.
The Third Ventricle
The third ventricle is a singular CSF-filled space on the midline of the brain. It is best appreciated
on a sagittal view of the brain as a dark space (left; tips of orange arrows), which has a
characteristic shape when segmented (tan object, right). It is segmented in the coronal views using
the Threshold tool.
Review the segmentation on the axial, sagittal, and 3D views. Keep in mind that the third ventricle
is a small structure, and the Threshold tool may not be optimal in some locations and in certain
brains. When the segmentation is reviewed, make sure the Opacity box is not checked (use the
Segmentation Module), and minimize the line width. As indicated above, use your anatomical
judgment, and intervene when you decide the segment is too generous or too conservative.
Transverse Cerebral Fissure
The transverse cerebral fissure (TCF) is a cisternal subarachnoid space that extends anteriorly from
the subarachnoid space above the cerebellum into the center of the brain. It is filled with CSF and
while it apposes and forms a border with the lateral and third ventricles, there is no direct
communication between the ventricular CSF and the CSF in the TCF. In middle coronal sections,
the TCF is roughly diamond-shaped, with its inferior borders formed by the thalami. The superior
borders of the TCF are formed by the inferior borders of the fornices. In some brains, the TCF
sends lateral extensions underneath the fornices. More anteriorly, the TCF is split by the
descending columns of the fornix into two small vertical slits that extend rostrally for a short
distance before ending. The TCF is labeled as the CSF segmentation ROI.
Segmentation of the TCF is first performed in coronal sections near the middle of the brain where
the thalami are prominent. The section below shows such a coronal section without (left) and with
labels (right). The lateral ventricle is depicted in purple, the third ventricle in red, and the TCF in
yellow. The Threshold tool is used to determine the border of the TCF (approximate location
indicated by the black rectangle). Note that the border of the TCF abuts the lateral ventricle
(purple).
Several blood vessels (i.e., internal cerebral veins) are contained within the TCF and their voxels
are often more intense than the threshold used to denote the border of the TCF. Thus, several
voxels within the thresholded TCF space will typically remain unlabeled after the TCF is
segmented. The blood vessels are considered to be within the TCF as a matter of definition and
should be labeled. Remove the thresholding mask to label these voxels before moving on to label
the next section.
Label the TCF on more posterior sections using the method
described above. When the third ventricle (red) is directly
apposed to the TCF (left), make sure there are no unlabeled
voxels between the two segments (i.e., the TCF should
directly abut the third ventricle segmentation).
In sections posterior to the posterior commissure, recall that
the third ventricle (red) appears as a small bubble within a
larger space. This space is the transverse cerebral fissure.
Segment as previously, but set the masking selection to
‘Outside all segments’ to insure the third ventricle
segmentation is not overwritten.
End the posterior segmentation of the TCF at the same level the third ventricle ends.
Return to the first section that was labeled. Continue segmenting the TCF in more anterior sections.
Near the beginning of the thalamus, the choroid plexus of the third ventricle (white asterisk below)
will be labeled as the third ventricle as described in the third ventricle segmentation procedure. At
this level, the TCF will form lateral and superior extensions around the fornix (yellow). Make sure
there are no empty voxels between the TCF (yellow) and the third (red) or lateral (purple) ventricle
segments.
In more anterior sections, the TCF will separate into two small slivers, one on either side of the
fornices (see below in yellow). These anterior wings of the TCF will be difficult to segment using
the Threshold tool due to their small size, so use your anatomical judgment to outline their borders.
When you have completed segmenting the TCF, review its borders. Look for inaccurate borders
as well as unlabeled voxels within the TCF. Keep in mind that, just as in the third ventricle, the
borders may not be perfectly amenable to definition with the threshold masking alone. This is
particularly true in the anterior portion of the TCF. Accordingly, use your anatomical judgment to
determine whether a voxel should be included within the TCF or an adjacent structure (e.g.,
thalamus, third ventricle).
The Fourth Ventricle
The fourth ventricle is the brainstem
component of the cerebral ventricular
system. It is connected to the third ventricle
anteriorly, and starts as a narrow canal called
the cerebral aqueduct under the posterior
commissure (PC). This narrow aqueduct
comes to an end at the inferior aspect of the
inferior colliculus (asterisk) at the frenulum
(tip of red arrow). The ventricle then
expands into a triangular or tent-like space
between the pons and the cerebellum, where
the points of the triangle are the frenulum
superiorly, the apex of the roof of the fourth ventricle posteriorly, and the obex inferiorly. In
traditional anatomy, the cerebral aqueduct and the fourth ventricle are separate entities. However,
the CMA convention includes both within the fourth ventricle ROI.
Proceed caudally in coronal sections. The fourth ventricle space will lengthen inferiorly. The walls
of the superior aspect of the fourth ventricle appear thin and are shaped similarly to a pitched roof.
In this location, the threshold masking may not recognize this superior border, and care should be
applied to make certain that the segmentation does not extend beyond this thin superior border.
Adjustment of the brightness of the image may be useful in this regard.
In posterior sections the fourth ventricle will appear as two profiles, superiorly and inferiorly.
These profiles are separated by the intervening gray matter of the cerebellum. The superior
ventricular profile will appear to have lateral extensions, which in some brains may or may not be
directly connected to the main cavity of the ventricle.
Segment the fourth ventricle as described above, using a threshold between the gray matter and
the ventricular space to determine the borders, and a separate threshold for the border between the
white matter and the ventricle.
In more posterior sections, the cerebellar gray matter
between the two ventricular profiles will become larger.
Notice the V-shape of dark voxels between the superior
and inferior ventricular profiles. This comprises the brain
exterior rather than a space connecting the two ventricular
spaces. Small membranes are visible between the exterior
space and the ventricular profiles. Alter the brightness to
identify these borders if needed.
Finally, review the segmentation on the coronal and then the 3D views.
The Nucleus Accumbens
The nucleus accumbens is a gray matter component of the forebrain basal ganglia. It is very similar
in intensity to, and contiguous with, surrounding gray matter structures. The borders between the
nucleus and contiguous gray matter regions are created using operational definitions based on
precise anatomical landmarks and rules.
Continue segmenting in more posterior sections using the procedure detailed above. As the
putamen becomes larger, continue to use its inferior border to guide the selection of the second
point (2 in figure above) of the initial segment line. Remember to take the threshold between the
gray matter of the nucleus accumbens and the adjoining white matter in each section.
As the putamen continues to increase in size posteriorly,
the white matter separating it from the nucleus
accumbens will change in position and disconnect from
the inferior surface. This places the putamen directly in
contact with the nucleus accumbens. When the white
matter moves superiorly, the second point (2) of the
initial segmentation line will be located at the midpoint
of the inferior surface of this white matter. Next, left-
click at the inferior white matter/gray matter interface to
create a vertical line between points 2 and 3. Then, as
before, draw or left-click around the gray-white interface (4) to connect back to the origin (1).
The above picture shows a large distance between 2 and 3 for illustrative purposes. It should be
noted that the distance is initially small and grows with more posterior sections. Once there is any
distance between points 2 and 3, the above rule should be applied.
Continue segmenting in more posterior coronal
sections. The caudate nucleus will diminish in size,
particularly in its inferior aspect. The contrast of the
gray/white matter border on the medial aspect of the
nucleus accumbens will start to diminish (see arrows at
right), and the Threshold tool will be of limited utility.
However, the border is still visible and should be
consistent in position with previously segmented
coronal sections. Turn the threshold mask off to draw the medial and inferior border.
The final stage of the nucleus accumbens segmentation
is to know when to stop. In the image to the right, note
a horizontal white matter pathway called the anterior
commissure extending medially from the putamen. The
medial spur of this commissure is indicated by the tips
of the black arrows. When this medial spur appears, the
nucleus accumbens should no longer be segmented.
Keep in mind that some brains are asymmetrical, and
the spur may appear on one side before the other side. In these instances, segment the nucleus
accumbens on the side in which the spur has not yet appeared; do not segment it on the side in
which the spur is present.
Review the nucleus accumbens segmentation on the sagittal and axial sections. The use of the
Threshold tool may occasionally result in the incomplete labeling of intense voxels within the
borders of the nucleus accumbens. Turn off masking and segment the unlabeled intense voxels
within the nucleus accumbens segment.
The Caudate Nucleus
The caudate nucleus is one of the basal ganglia of the
forebrain. In three dimensions it has the appearance of a
comma, with a large anterior head that tapers to a body, and
then to a thin curving posterior bend. The caudate also has a
tail, which extends anteriorly from the inferior portion of the
posterior bend into the temporal lobe. However, by
convention, the tail portion is not segmented. In coronal
sections, the medial border of the caudate is the lateral
ventricle, and the lateral border is white matter.
Start the segmentation process by selecting the caudate nucleus label and identifying a section
similar to that seen to the right. The border of the caudate
with the lateral ventricle will already have been determined
in the lateral ventricle segmentation. To insure the caudate
segmentation does not overwrite the lateral ventricle, select
‘Outside all segments’ under the masking tab. Next, use the
Threshold tool to take a threshold value at the lateral border
of the caudate with the white matter. Select ‘Minimum’ as
the lower bound, and use ‘Average’ as the upper bound.
Segment the caudate so that its borders appear similar to the
blue outline on the image to the right.
After segmenting this section, move anteriorly. Continue segmenting the caudate with the above
procedure until the caudate appears to end. The precise anterior border will be specified at the end
of the segmentation process for the caudate (see below).
Return to the first segmented section of the caudate nucleus and begin segmenting in the posterior
direction. A small gray matter sliver will appear lateral to the caudate. As indicated previously in
the nucleus accumbens segmentation guide, this is the putamen (P). At this level, the putamen is
separated from the caudate (blue) by the
intervening white matter (the internal
capsule). The appearance of the putamen
triggered the segmentation of the nucleus
accumbens (orange). Notice that strands of
gray matter extend between the caudate and
putamen through the intervening white
matter. By convention, these strands are not
included in the caudate or the putamen
segmentation. Draw a line on the lateral
border of the caudate similar to that
displayed on the image on the right, which
excludes connecting strands of gray matter.
Note: Strands of gray matter between the caudate and putamen will appear throughout the antero-
posterior extent of these nuclei, but should not be included in either segmentation.
As the caudate nucleus is segmented, there may be voxels inside the caudate segmentation that
remain unlabeled when using the threshold mask. These unlabeled voxels are a result of white
matter fibers within the caudate that confer an intensity to the voxels that exceeds the threshold
mask. Nonetheless, these voxels should be included as part of the caudate nucleus segmentation.
To include these voxels, select ‘Everywhere’ in the masking menu and label them with the Paint
or Draw tools as caudate nucleus. This process can be performed during the segmentation
procedure (i.e., at each section), or after the initial caudate segmentation.
It is important to review the caudate nucleus segmentation on the sagittal and axial sections, as
well as on the 3D model. Use this review to also determine whether the segmentation extends into
the white matter strands by viewing it in multiple orientations.
Finally, use the reviewing step to evaluate the anterior border
of the caudate. In this location, there are voxels that are
classified as white matter hypointensities that do not belong to
the caudate nucleus segmentation. By using the sagittal and
axial sections (right image), you can use the curved shape of
the caudate to better identify its anterior border and exclude
these hypointensities (arrowhead). Note that the distinction
between the caudate and the white matter hypointensities is less
clear in brains where the ventricle is more compressed
anteriorly.
The Guide Markup tool in the NeuroSegmentation module should be used to draw lines in multiple
sagittal sections to delimit the anterior and inferior borders of the caudate nucleus.
These lines will produce transects in the coronal plane (image below, left) that will separate the
caudate border from adjoining hypointensities and will thus guide the reliable segmentation of the
anterior caudate. To use Guide Markups, select the checkboxes for Red and Yellow Line Views,
and select the checkbox for the Green Intersection Views. Select circle as the glyph type and set
the scale to 0.50. Press the plus sign to create a Guide Markup. Use multiple clicks in the sagittal
view to draw a line similar to that shown below on the right image. Drawing the inferior border
of the caudate in multiple sagittal sections will produce transects in the coronal plane. In the image
to the left (below), the green and blue represent intersections of the sagittally drawn lines. These
intersections represent the borders of the caudate, and are used to guide the segmentation of the
caudate borders in the anterior and inferior caudate.
The Putamen
On coronal sections, the putamen is lateral or inferior to the caudate nucleus and separated from it
by the white matter of the internal capsule. Bridges of gray matter may extend through the internal
capsule to connect the caudate with the putamen. As described previously, these voxels of gray
matter are not included in either segmentation. The putamen is larger anteriorly, and tapers towards
the back of the brain.
Given the difficulty with current MRI to reliably separate the basal forebrain and/or ventral
diencephalon from the ventral (subcommissural) portion of the globus pallidus (i.e., ventral
pallidum), this portion is not included in the globus pallidus segmentation.
The Brainstem
The brainstem comprises three parts shown in the figure below (left): the midbrain (Mid), the pons
and the medulla (Med). On a mid-sagittal section, the pons is characterized by an anterior bulge.
The medulla is inferior to the pons and is continuous with the spinal cord (SC). The midbrain is
superior to the pons and is continuous with diencephalic forebrain structures such as the thalamus
and the ventral diencephalon.
Unlike other structures, the segmentation of the brainstem begins in the midsagittal plane. The
view is then changed to the coronal plane, and the midsagittal segmentation is used to define the
superior and inferior brainstem borders. This process is detailed below.
First, identify the midsagittal section. It will appear similar to the image below (left) and will
typically appear in the yellow window in 3D Slicer.
To begin the segmentation, generate a threshold between gray matter and the exterior of the brain
(dark voxels). A good place to do so is indicated above by the yellow circle (left image). Be sure
not to include blood vessels in the threshold estimate (white asterisks in the image above). Select
‘Average’ as the Lower limit, and ‘Maximum’ as the Upper limit. Make sure the masking is set to
‘Outside all segments’ to avoid overwriting the fourth ventricle segmentation. Next, select the
Draw tool. Your first click should be immediately behind the posterior commissure, which is the
small white structure at the tip of arrow #1 (right image). This initial point should be in the dark
voxels in back of the posterior commissure. The second click will be at the tip of arrow #2. This
is the prepontine or interpeduncular fissure between the midbrain and the pons. This second click
will form a straight line through the brainstem and reflects the cut a neuropathologist uses to
separate the brainstem from the forebrain. Next, make a series of clicks close to the border of the
brainstem with the brain exterior. Be sure not to include blood vessels. Proceed around the pons
(#3) and down the medulla until there is a slight change in the angle of the medulla (#4), the
pyramidal decussation. Click at this point, and then click in front of the obex, the inferior portion
of the floor of the fourth ventricle (#5 on right image). From here, continue drawing the border
superiorly along the fourth ventricle (the fourth ventricle is shown as a white dashed line on the
left figure above). Proceed anteriorly between the cerebellum and the posterior aspect of the roof
of the midbrain (yellow curved arrow) until you arrive at the point where you began. Press Enter
or right click with the mouse to enclose the segment. Examine any unlabeled voxels between the
fourth ventricle and brainstem and assign them to one or the other ROIs based on their intensity.
Next, go to the coronal view, which is the green window in 3D Slicer. Find a section similar to the
middle panel below. This coronal section represents one of the most anterior sections through the
brainstem. The left panel shows a 3D brainstem overlaid on a midsagittal section. The vertical
yellow line in this panel represents the coronal section through the brainstem as illustrated in the
middle section below. The blue vertical line in this middle image represents the segment previously
drawn on the midsagittal section but shifted by 90 degrees. Thus, the planar appearance of the
segment in the sagittal plane now appears as a vertical line in the coronal plane. This vertical line
guides the segmentation of the brainstem (right panel). Use the Threshold tool in conjunction with
the Draw tool (the pen is useful here) to segment the brainstem. In more anterior coronal sections,
the brainstem will be completely disconnected from the rest of the brain. Make sure you move
anteriorly until the brainstem disappears to insure you have segmented it all.
More posteriorly in the coronal series, the brainstem will clearly connect with the rest of the brain.
The vertical blue line (middle panel below) will indicate the location of the brainstem (from
superior to inferior). The superior border of the brainstem is defined by convention as a line
connecting the lateral aspect of the interpeduncular fossa (tip of left red arrow, middle panel) with
the lateral invagination of the brain surface (tip of right red arrow, middle panel).
Once the interpeduncular fossa ends, the upper portion of the vertical brainstem line will end in
the middle of the brain (middle panel below). When this occurs, draw a horizontal line
perpendicular to the top of this vertical line to define the upper limit of the brainstem on this slice
(right panel below). Remember in each section to take the threshold of the brainstem with the
outside of the brain.
In more posterior sections, the top of the vertical line ends immediately below the cerebral
aqueduct (green arrows in middle image below). Draw a line from this point to the upper inflection
points of the lateral brainstem surface (tips of upper red arrows in middle image) on either side.
Unlike more anterior sections, this approach is necessary because a horizontal line drawn at this
level would no longer end at the exterior surface of the brainstem. In this coronal section, also
notice that the lateral borders of the brainstem are vertical lines that cut into the brainstem. These
lines are guided by inflection points that appear ventrally (two lower red arrows in middle image)
and separate a fiber tract called the middle cerebellar peduncle (red asterisks, right image below)
from the main part of the brainstem. Note that at this level, the root of the fifth cranial nerve
(trigeminal nerve) penetrates the lateral edge of the middle cerebellar peduncle and can often be
observed as small bumps (immediately lateral to red asterisks below).
Posterior to the section above, the vertical brainstem line will end above the aqueduct at the brain
exterior. Extend the line at its top until the brainstem angles superiorly (tips of green arrows on
right image below). At these points, angle lines inferiorly and laterally through the brainstem to
reach the inflection points (red arrows). The lateral borders of the brainstem at this level are
delineated in a similar manner to that described above.
The brainstem will then appear separated from the forebrain, as shown in the image set below.
The two paired bumps on the superior aspect of the brainstem, the inferior colliculi, typically are
separated from the rest of the brainstem at this level. Be sure to follow these colliculi posteriorly
and include them in the brainstem segmentation even if they do not directly connect, as illustrated
below (right panel, below).
More caudally, the inferior colliculi will disappear, and the vertical brainstem line will not have a
component superior to the fourth ventricle. In this instance, segment as illustrated below, using the
inflection points (red arrows, middle image below) as borders. At this coronal level, the border
between the brainstem and the fourth ventricle comprises mainly white matter, and a single
threshold may be used. However, regions of the brainstem contain gray matter (i.e., the facial
colliculi indicated by green arrows in the middle image below), and the threshold should be
adjusted in these areas accordingly.
As the brainstem ends posteriorly, the vertical line will progressively shorten and end inferiorly in
the substance of the brain (middle panel below). When this occurs, draw horizontal lines to
complete the segmentation inferiorly (right panel below).
The final step in the segmentation of the brainstem is to return to the sagittal series. Since there
may be slight differences in the threshold of the previously segmented fourth ventricle with the
brainstem and the threshold used to define the brainstem border, unlabeled voxels may be present
at the interface between the two ROIs. Scroll through the sagittal series and label all relevant voxels
as needed.
The Thalamus
The thalamus is an egg-shaped collection of nuclei.
There is one thalamus in each hemisphere. The two
thalami are separated by the third ventricle, and more
caudally, by the subarachnoid space of the transverse
cerebral fissure (TCF). The thalamus is bordered by the
foramen of Monro anteriorly (white asterisk), the
internal capsule laterally, and it is superior to the
midbrain posteriorly (Mid). The inferior border of the
thalamus is the hypothalamic sulcus (fissure of Monro,
red line) – an evagination in the third ventricle that
separates the thalamus superiorly from the ventral diencephalon (V) segmentation inferiorly. It is
important to note that the CMA convention does not include two classic thalamic nuclei within the
thalamus segmentation, the lateral and medial geniculate nuclei. Instead, these two nuclei are
included in the ventral diencephalon segmentation (vide infra).
While the hypothalamic sulcus may be evident in some brains in coronal sections, it is often useful
to employ the Guide Markup tool to define it more consistently. To do so, turn to the sagittal view,
and draw Guide lines starting with sections that are similar to that shown below. The section on
the left is closer to the midline and the sulcus is evident. The section on the right is more lateral
and the sulcus is less distinct. At this point, the anterior and posterior portions of the ventricular
system continue to be present. Join these points with a curved line that ‘cups’ the thalamus as
shown below.
Review the aVDC and pVDC segmentations on axial and sagittal views.
The Amygdala
The amygdala is located in the medial temporal lobe. It has an ovoid, almond-like shape and is
situated anteriorly and superiorly to an adjacent gray matter structure called the hippocampal
formation. Anteriorly, the amygdala borders the anterior portion of the temporal cortex.
Superiorly, the amygdala is bordered by the basal portion of the frontal lobe. Medially, the
amygdala borders the temporal cortex as well as the subarachnoid space adjoining the medial
surface of the temporal lobe. The lateral borders of the amygdala are the inferior horn of the lateral
ventricle and, more rostrally, the white matter of the anterior temporal lobe. Inferiorly, the
amygdala is bordered by the ventral cortex of the temporal lobe and, more posteriorly, the
hippocampal formation.
The amygdala is a relatively small structure, but one of the more difficult to segment. The
following text is divided into two parts. The first part will detail how to use the Guide Markup
tool in the NeuroSegmentation module to generate anatomically-defined reliable borders. The
second part will show how to use these borders in conjunction with other anatomical landmarks to
segment the amygdala in coronal sections.
More anteriorly, this approach shows the first coronal section of the amygdala, and indicates the
approximate borders of this region. The image below shows a sagittal section on the right with a
green Guide Line curve to delineate the anterior amygdalar border. The vertical line of the
crosshair in the sagittal view (right, below) shows the location of the coronal section illustrated on
the left. The transects (dots) shown in this coronal section are the results of several guide lines that
together approximate the anatomical borders of the anterior most section of the amygdala.
Guide Lines should also be drawn on the axial view (left on image below) to produce borders in
the coronal view (right image below).
It is important to note that the above illustrations are from an averaged brain where the borders
can be discerned. The Guide Line tools was developed for use in MRI scans where the borders
may not be as distinct, and the utility of the tool is best appreciated when applied to those brains.
Once the anterior amygdalar border as well as the border between the amygdala and the
hippocampal formation have been demarcated, turn to the coronal views to segment the
amygdala.
Review the hippocampal formation segmentation on the 3D, axial and sagittal series.
Inferior Horn of the Lateral Ventricle
During ILV segmentation, keep in mind that the ventricular space may be filled with choroid
plexus, which should be included in the segmentation (tip of yellow arrow). Turn off masking to
do so. Be sure to not confuse the choroid with the tail of the caudate nucleus (white asterisk, left
side of image), which appears superior to the ILV space.
The optic chiasm is a partial crossing of the optic nerves from the eyes.
The image to the right shows the optic chiasm and associated structures
in 3D overlaid on a coronal image. The optic nerve originates from the
back of the eye and courses posteriorly under the forebrain. The chiasm
(red arrow) represents a partial crossing of the optic nerves (right
image). Posterior to the chiasm (red arrow), two fiber tracts (by
convention termed optic tracts not optic nerves) emanate and course
posteriorly into the brain. The tracts, the nerves, and the chiasm together form the shape that gives
the chiasm its name (‘chiasm’ means shaped like the letter X).
According to CMA guidelines, the optic chiasm is first segmented in the coronal section in which
the third ventricle initially appears anteriorly (see below, dotted white line to left). Select a
threshold between the subarachnoid space and the white matter of the optic chiasm to produce a
segmentation outline like that observed in the image below (orange, right).
Continue segmenting the optic chiasm in more posterior sections. When the optic chiasm separates
into two distinct tracts (image below), no longer segment the optic chiasm.
Review the segmentation on axial and sagittal sections. Make sure that any unlabeled voxels
between the third ventricle and the optic chiasm are ascribed to one of the segmentations.
The Fifth Ventricle
Segment the fifth ventricle using the Threshold tool. Given the small size of the fifth ventricle,
this tool may be of limited utility; in these cases, use anatomical judgment to outline the borders.
Begin your segmentation at the coronal section in which the fifth ventricle is largest. Move to
more anterior and then to more posterior sections until the segmentation is complete.
Review the segmentation of the fifth ventricle on axial and sagittal series.
Glossary of Terms:
Sagittal Plane: An imaging plane that divides the brain into left and right halves. The midsagittal plane
is exactly mid-way between the hemispheres of the brain.
Coronal Plane: An imaging plane named for the coronal suture of the skull. This plane is parallel to the
long axis of the body, and perpendicular to the sagittal and axial planes.
Axial Plane: An imaging plane perpendicular to the long axis of the body.
Alveus: A layer of hippocampal axons adjoining the inferior horn of the lateral ventricle.
Anterior commissure: A prominent fiber tract crossing the midline and located inferior to the columns of
the fornix. This commissure mainly connects regions of the left and right temporal lobe.
Amygdala: The amygdala is an almond-shaped collection of subcortical nuclei in the anterior portion of
the temporal lobe. The amygdala is involved in sensory-sensory associations related to emotion (especially
fear and aggressive behavior), including sensory-visceral associations.
Arachnoid: The spider-like membrane that covers the brain. The arachnoid is the middle of three
membranes, together called meninges, that cover and protect the brain inside the skull. The subarachnoid
space is between the arachnoid membrane and the more interior pia.
Basal Ganglia: A group of interconnected subcortical nuclei. The basal ganglia comprise the caudate
nucleus, the putamen, the nucleus accumbens, the globus pallidus, the subthalamic nucleus, and the
substantia nigra.
Brainstem: The brainstem is a region of the neuraxis between the diencephalon and the spinal cord. It is
traditionally divided into three parts: midbrain, pons, and medulla. The brainstem contains fiber tracts
connecting the spinal cord with the forebrain, nuclei and tracts associated with cranial nerves, as well as
long-range neurotransmitter nuclei and systems controlling sleep, wake, and vigilance.
Caudate Nucleus: The caudate nucleus is a comma-shaped nucleus that forms the lateral border of the
lateral ventricle. It contains a large anterior head, an intermediate-sized body, a posterior bend, and a
slender tail. The caudate nucleus is one of the basal ganglia. It is connected most heavily with association
areas of the cerebral cortex and involved with circuits modulating cognitive and motor function.
Cerebellum: A large convolutional structure located in the brainstem region. It is separated from the pons
of the brainstem by the fourth ventricle. The cerebellum is involved in the sequencing and modulation of
movement as well as cognitive and emotional function.
Cerebellar Peduncles: Three white matter formations that connect the cerebellum with spinal cord,
brainstem and forebrain regions.
Cerebral Aqueduct: A small channel containing cerebrospinal fluid (CSF) that connects the third and
fourth ventricles. The aqueduct is located in the midbrain component of the brainstem and is included
within the fourth ventricle ROI for the purpose of segmentation.
Cerebral Peduncle: A large fiber bundle on the ventral surface of the midbrain comprising axons
emanating from the cerebral cortex and terminating in regions of the brainstem and spinal cord.
Cerebrospinal Fluid: The cerebrospinal fluid (CSF) is a clear secretion of the choroid plexus. It is
derived from blood, and fills the brain’s ventricular system (lateral ventricles, third ventricle, fourth
ventricle) as well as the subarachnoid space surrounding the brain.
Choroid Plexus: The choroid plexus is the highly vascular organ that secretes cerebrospinal fluid. The
choroid plexus is found in parts of the lateral ventricles, the third ventricle, and the fourth ventricle.
Claustrum: The claustrum is a thin sheet of gray matter lateral to the putamen. It has connections with
widespread regions of the cerebral cortex, but little is known about its function.
Cornu Ammonis: A term used to refer to numbered subdivisions of the hippocampus. Cornu Ammonis
is often abbreviated as CA, with a numerical suffix indicating the specific subfield (e.g., CA1).
Diencephalon: The second division of the neuraxis that includes the thalamus, the hypothalamus, the
habenular nuclei, and the subthalamic nuclei.
Dentate Gyrus: A subfield of the hippocampal formation resembling a tooth.
Dura: The outermost fibrous covering of the brain. The dura is one of three membranes, together called
meninges, that cover and protect the brain inside the skull.
External Capsule: A thin white matter pathway between the putamen and the claustrum.
Fifth Ventricle (also called the cavum septum pellucidum): A space filled with cerebrospinal fluid that is
not directly connected with the cerebral ventricular system. This space exists posterior to the anterior
bend (genu) of the corpus callosum and is bordered by the paired septum pellicuda laterally.
Foramen of Monro: The canal between each lateral ventricle and the third ventricle.
Fornix (pl: Fornices): A fiber bundle containing axons from cells in the hippocampus and terminating
principally in the mamillary bodies of the hypothalamus. The fornix has an appearance of an arch with
several portions: 1) the fimbria (fringe) refers to the region of the fornix where axons coalesce, 2) the
crus (legs) are the initial parts of the fornix that form the posterior bend of the arch, 3) the body, the
region of the fornix that forms the medial and inferior border of the lateral ventricle, 4) the columns, the
anterior bend of the arch that courses inferiorly to terminate in the hypothalamus.
Fourth Ventricle: A tent-shaped ventricular space between the brainstem and the cerebellum. The fourth
ventricle communicates with the third ventricle via the cerebral aqueduct. The fourth ventricle also
communicates with the subarachnoid space surrounding the brain via two lateral apertures and a median
aperture. The fourth ventricle, according to CMA guidelines, includes the cerebral aqueduct.
Globus Pallidus: One of the nuclei of the basal ganglia located medial to the putamen and lateral to the
internal capsule. It has two parts – a pars internus and a pars externus. These divisions have different
connections and functions, but are often difficult to distinguish on T1w MRI images. The globus pallidus
is the output nucleus of the basal ganglia, and its projections terminate in the subthalamic nucleus and the
thalamus.
Habenular nuclei (pl: habenulae): Nuclei that line part of the medial aspect of the posterior thalamus.
The habenular nuclei receive input from forebrain nuclei and relay it to the brainstem.
Hippocampal Formation: A region of the cerebral cortex curved under the margin of the temporal lobe
medially. The hippocampal formation is involved in spatial navigation and memory consolidation, and
consists of several interconnected regions: the subiculum, the cornu ammonis subfields, and the dentate
gyrus. A main white matter projection of the hippocampal formation is the fornix, which projects to the
mammillary bodies of the hypothalamus.
Hypothalamic Sulcus (of Monro): An invagination in the lateral wall of the third ventricle that separates
the thalamus superiorly from the hypothalamus and brainstem inferiorly.
Hypothalamus: A region of the diencephalon inferior to the hypothalamic sulcus. The hypothalamus is
involved in species-specific behaviors as well as control of visceral, autonomic and homeostatic function.
It contains many nuclei, including the mammillary bodies.
Inferior Horn of Lateral Ventricle: A region of the lateral ventricle located within the temporal lobe.
Internal Capsule: A roughly V-shaped white matter bundle containing projections from the cerebral
cortex that terminate in diencephalic, brainstem and spinal cord nuclei. The internal capsule has two
principal parts: the anterior portion between the caudate nucleus and the putamen/globus pallidus, and the
posterior portion between the thalamus and putamen/globus pallidus.
Inferior Colliculus: Paired nuclei that appear as little hills (colliculus (Latin): little hill) on the superior
aspect of the midbrain involved in auditory processing. The inferior and superior colliculi together
comprise the midbrain tectum.
Lateral Geniculate Nucleus: A thalamic nucleus located posterior and inferiorly to the main portion of
the thalamus. The axons of each optic tract terminate within the lateral geniculate nucleus and relay visual
signals from the contralateral visual hemifield through both eyes.
Lateral Ventricle: A roughly C-shaped space within each hemisphere filled with cerebrospinal fluid
(CSF). Each lateral ventricle has different parts: the anterior horn within the frontal lobe, the body within
the frontal and parietal lobes, the inferior horn within the temporal lobe, and the posterior horn within the
occipital lobe. The atrium (or trigone) of the ventricle is the confluence of the body, inferior and posterior
horns. Choroid plexus is present within the inferior horn, the atrium and the body of the lateral ventricle.
Lenticular Nucleus: A nucleus with the shape of a lens, comprising the globus pallidus and putamen.
Mammillary Bodies: Paired circular nuclei of the hypothalamus that receive projections chiefly from the
ipsilateral hippocampal formation via the fornix. The mammillary bodies are located in the inferior and
posterior portion of the diencephalon.
Medial Geniculate Nucleus of the Thalamus: located posterior and inferiorly to the main portion of the
thalamus, and lateral to the superior colliculus of the midbrain. The medial geniculate nucleus receives
auditory information and relays these signals to auditory regions of the cerebral cortex.
Medulla (medulla oblongata): The region of the brainstem between the pons and the spinal cord.
Meninges: The three coverings of the brain, including the outer dura, middle arachnoid and inner pia.
The meninges are located between the skull and the brain.
Midbrain: The upper region of the brainstem located between the pons and the diencephalon. It contains
the tectum (superior and inferior colliculi) posteriorly, and the cerebral peduncles anteriorly.
Middle Cerebellar Peduncle: A large fiber bundle connecting the pons of the brainstem with the
cerebellum.
Nucleus Accumbens: A region of the basal ganglia that connects the caudate nucleus and the putamen.
The nucleus accumbens is often referred to as the ventral striatum and is involved in reward and
reinforcement.
Optic chiasm: A midline structure ventral to the hypothalamus that is a partial crossing of the optic
nerves from each retina to the opposite hemisphere. The fiber bundles that emerge posteriorly from the
optic chiasm are termed the optic tracts.
Optic tracts: Fiber bundles emanating from the optic chiasms that convey visual signals from the
contralateral visual hemifield of both eyes to the lateral geniculate nucleus of the thalamus.
Pretectum: A region of nuclei located between the superior colliculus and the thalamus.
Pons: The region of the brainstem between the midbrain and the medulla. It is connected to the
cerebellum via the middle cerebellar peduncle.
Putamen: A nucleus of the basal ganglia lateral to the globus pallidus principally involved in motor
function. The putamen is separated from the claustrum laterally by the external capsule.
Pyramidal decussation: The region of the anterior medulla where motor axons from the cerebral cortex
undergo a partial crossing before entering the spinal cord.
Septum Pellucidum: A thin membrane that forms the medial border of the lateral ventricle. These left
and right membranes are often fused on the midline.
Spinal Cord: The region of the central nervous system located in the vertebral canal.
Striatum: A collection of nuclei including the caudate nucleus and the putamen, as well as the nucleus
accumbens. The caudate nucleus and putamen are often referred to as the dorsal striatum, and the nucleus
accumbens as the ventral striatum.
Subarachnoid space: A cerebrospinal fluid (CSF)-filled space between the pial and arachnoid layers of
the meninges. This space surrounds the brain.
Superior Colliculi: Paired nuclei on the superior aspect of the midbrain involved in redirection of gaze
and attention. The inferior and superior colliculi together comprise the midbrain tectum.
Tectum: A collective term for the superior and inferior colliculi of the brainstem.
Thalamus: A complex collection of nuclei in the diencephalon principally involved in the relay of signals
to and from the cerebral cortex.
Third Ventricle: A midline cerebrospinal fluid (CSF)-filled space in the diencephalon. The third
ventricle is connected with both left and right lateral ventricles via the foramen of Monro, as well as the
fourth ventricle via the cerebral aqueduct.
Transverse Cerebral Fissure: A specific extension of the subarachnoid space between the thalami and
fornices.
Uncus: The medial-most bulge of the medial temporal lobe. The uncus is visible from an inferior
perspective of the temporal lobe.
Ventral Diencephalon: A region inferior to the thalamus extending from the anterior commissure to the
posterior commissure. This region includes gray matter nuclei such as the hypothalamus, subthalamus,
habenular nucleus, and red nucleus, and white matter pathways such as regions of the internal capsule,
regions of the fornix, and the optic tract.