Characteristics and Limitations of A Secondary Dose Check Software For VMAT Plan Calculation
Characteristics and Limitations of A Secondary Dose Check Software For VMAT Plan Calculation
Characteristics and Limitations of A Secondary Dose Check Software For VMAT Plan Calculation
DOI: 10.1002/acm2.13206
KEY WORDS
dosimetric leaf gap, leaf offset, MLC model, Mobius3D, secondary dose check
----------------------------------------------------------------------------------------------------------------------------------------------------------------------
This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium,
provided the original work is properly cited.
© 2021 The Authors. Journal of Applied Clinical Medical Physics published by Wiley Periodicals, Inc. on behalf of American Association of Physicists in Medicine.
1 | INTRODUCTION rounded leaf tip of the MLC. There is no consideration of leaf height
and no leaf offset table. Alternatively, Mobius3D utilizes a full
Secondary dose calculations are utilized to serve as an independent rounded leaf-tip calculation using ray-tracing and considering the leaf
verification of the primary treatment planning system (TPS). This inde- height to define the transmission function, which results in a smooth
pendence is enhanced when the secondary check arrives in a pre-con- falloff of the fluence through the rounded leaf end.3
figured state with a standard beam model for a given machine/energy There have been investigations reported in the literature regard-
class. In this case, it is recommended that the user makes minimal, if ing the commissioning, validity and implementation of Mobius3D for
any, modifications to the software’s model configuration. When use as a secondary dose calculation tool.4–8 On average, prior works
changes are made, it is essential to have an understanding of the modi- saw typical agreement relative to ion chamber measurements in a
fiable factors and their impact on dose calculations, as well as how phantom of <2%,4,6–8 though differences as large as 5.5% were
parameter value variation relates to a measurement scenario. reported.8 These authors focused on the overall implementation of
Mobius3D (Varian Medical Systems Inc., Palo Alto, CA) is a sec- the software and validated the use of Mobius3D as a suitable sec-
ondary check software that provides quality assurance calculations ondary check software for treatment planning systems used within
for a full range of clinical photon and electron plans. For photon their clinic. Hillman et al. also investigated the Mobius3D MLC
beams, Mobius3D utilizes a CT dataset along with plan and structure model as applied specifically to SRS/SBRT treatments and looked at
information (exported from the primary TPS) to perform an indepen- a revised MLC model.9 Further, they investigated an alternative
dent convolution-superposition dose calculation for comparison with DLGC determination method that relied on sweeping gap plans,
the dose calculated by the primary treatment planning system.1 Ven- though noted that ultimately a DLGC optimization based on patient
dor-specific beam models which contain a set of default values are plans is likely necessary.9 Work by Kim et al. investigated the MLC
provided. Outside of the necessary linac calibration conditions, it is modeling accuracy in Mobius3D, observing higher uncertainties in
recommended that the beam model is maintained as provided unless the dose calculation for small fields, and noting that careful optimiza-
large variations are observed between the reference and measured tion of the DLGC is necessary for optimal performance.10
percent depth dose (PDD) and off-axis ratios (OAR). This work presents in-depth the determination and implications
Customization of the beam-model may be facilitated with an of the DLGC for a full range of clinically relevant plans, including
auto-modeling feature at the expense of reducing the independence both large-field VMAT and small-field SBRT cases. The optimization
of the beam model.2 In addition to built-in parameters, there is a ser- of the Mobius3D DLGC for both a TrueBeam with a Millennium
ies of machine configuration parameters whose values the user can MLC (MMLC) and a TrueBeamSTx with a high-definition MLC
adjust, including those related to the determination of treatment (HDMLC) emphasizes the necessity for a representative set of test
times (dose rate), deliverability (max MU/field), clearance (distance plans in DLGC optimization. The results show how a test plan suite
between isocenter and collimator surface; collimator radius), and in general plays in to TPS validation.
dose (dosimetric leaf gap correction). Of these parameters, the dosi-
metric leaf gap correction (DLGC) is the only one that will directly
2 | MATERIALS AND METHODS
affect the dose calculation for MLC-based plans, and subsequently
the dose calculation accuracy of the system.
2.A | Collective DLGC optimization
The Mobius DLG parameter contains two parts, an internal value
(DLGI), which is not exposed to the user and is determined by auto- The optimal DLGC value was determined for a TrueBeam with an
modeling routines executed by the vendor, and a correction (DLGC) MMLC and energies of flattened 6, 10, and 15 MV, as well as unflat-
which the user can vary. Prior to calculation, each MLC leaf position tened 6 and 10 MV. It was also determined for a TrueBeamSTx with
value in Mobius is moved by an amount of DLG/2 = an HDMLC and the same energies except 15 MV flattened. The DLGC
(DLGI + DLGC)/2. There are specific DLGI and DLGC values for was determined for each energy on each machine independently fol-
each machine and energy combination. According to Varian docu- lowing an optimization process that was a variation of that recom-
mentation, the DLGC in Mobius3D is modifiable by the user on a mended by Mobius3D,2 where our approach utilized multiple ion
per-machine, per-energy basis to help account for differences chamber measurements (in target, both on- and off-axis). The optimal
between real-world dosimetry and the inherent Mobius MLC trans- collective DLGC value for each energy was determined by comparing
mission model.2 Making the DLGC more positive increases the calcu- the Mobius3D calculated dose at several DLGC values to the mea-
lated dose, while making it more negative decreases the calculated sured ion chamber dose for a series of test plans.
dose. Essentially, the Mobius3D DLG can be interpreted as a single Seven VMAT test plans were utilized throughout the optimiza-
entry to a leaf offset table within the software, where the DLGC is tion: four geometrically based, and three anatomically based. The
used to tune the internal DLGI to the institution’s preference. four geometrically based plans were based on recommendations
An important distinction when considering the Mobius3D DLG is made in TG-119 and contained either a central cylinder, lateral cylin-
that it is not defined in the same manner as the DLG in the Eclipse der, large cylinder, or c-shape target structure.11 The anatomically
treatment planning system (DLGE). In Eclipse, the DLGE is an inher- based plans consisted of a representative head and neck, lung SBRT,
ent part of the step-wise transmission function utilized to model the and chest wall targets. The plans were chosen to cover a range of
218 | SHEPARD AND FRIGO
difference across eligible chambers was first calculated for each plan, and average value for a given plan/energy combination. We then
followed by an average across all plans to determine the total aver- observed the level of agreement between the primary TPS and the
age percentage dose difference at a given DLGC value. A linear fit secondary check software relative to measurements for the test
was applied to the total average dose difference (all plans and eligi- plans, to help aid in the determination of relevant action criteria
ble chambers for a given machine/energy) for either four or five when comparing the secondary check software to the primary TPS.
DLGC exploration values, and based on the fit, the collective DLGC
corresponding to the minimum absolute dose difference was taken
3 | RESULTS
to be the optimal value for the specific energy and machine.
were initially calculated in RayStation using standard clinical planning Optimal collective DLGC [mm]
procedures, and then exported to Mobius3D. The calculated average
6X 10X 15X 6FFF 10FFF
dose to relevant A1SL ion chamber structures in RayStation was
TrueBeam −0.02 0.89 −0.46 −0.71 0.07
compared to the corresponding average values to the same struc-
TrueBeamSTx 1.61 0.35 – 1.85 0.53
tures in Mobius3D. The differences were analyzed for their range
220 | SHEPARD AND FRIGO
F I G . 6 . Optimal DLGC vs. Average Leaf Position off Central Axis. increase in the collective DLGC. Further, applying the plan-removal
The optimal DLGC averaged across all energies is compared to the collective DLGC value to the two respective plans resulted in
MLC positioning characteristics of the plan. As the average leaf increases in the absolute dose differences of 0.6 0.4% and
position off the central became larger, the optimal DLGC became 0.2 0.1% for the lung SBRT plan and the lateral cylinder plan,
more negative. DLGC error bars are representative of a 1%
respectively. These changes in the absolute dose difference observed
dosimetric uncertainty and ALPCA error bars are given by the
with the plans excluded from the collective DLGC determination is
standard deviation across all energies.
demonstrated in Fig. 7(b).
1.1 0.8% (range: −0.4% to 2.6%) for the TrueBeamSTx system. clinics look to potentially implement tighter action criteria, it is
The average magnitude of the dose difference of the RayStation cal- essential that they do so keeping current limitations in mind. If the
culations compared to measurements was 0.7 0.6% (range: goal is to focus the scope on a small number of plans, and the DLGC
0.0%–2.4%) on the TrueBeam system, and 1.1 0.8% (range: has been optimized specifically for the given plan characteristics, it
0.1%–2.6%) on the TrueBeamSTx. may be reasonable to decrease the tolerance values, as in general,
Comparing to Mobius3D using optimized collective DLGC values, relatively good agreement between Mobius3D and measurements
the magnitude of the calculated dose difference relative to measure- was observed. However, when considering a wide range of potential
ments was less for RayStation in 24/35 and 12/28 plans for the plans as was investigated in this work, a tightening of the action cri-
TrueBeam and TrueBeamSTx machines, respectively. For RayStation teria could unduly raise flags due to plan disagreement from calcula-
and Mobius3D calculations relative to measurements for each plan, tion inaccuracy. In this scenario, it may be difficult to truly
it was observed that the RayStation calculations agreed with mea- determine whether disagreement between Mobius3D and the pri-
surements much better for the lung SBRT plan. The average dose mary calculation is due to a problem with the plan, the primary TPS,
difference magnitude across all energies on both machines was or inaccuracies in the Mobius3D dose calculation. This was effec-
1.0 0.7% (range: 0.1%–2.4%), whereas the Mobius3D average tively demonstrated when comparing Mobius3D to RayStation calcu-
dose difference magnitude was 3.4 1.3% (range: 2.1%–6.1%). The lations for the lung SBRT plan. Dose differences in the calculation of
plan that Mobius3D outperformed the RayStation model to the lar- the lung SBRT plan by RayStation and Mobius3D on the order of
gest extent was the chest wall plan, with an average absolute differ- 2%–5% indicate a tightening of the action criteria could result in the
ence of 0.7 0.4% (range: 0.0%–1.2%), compared to 1.2 1.0% onset of false positives. In a similar comparison of RayStation and
(range: 0.0%–2.6%) for the RayStation model. Mobius3D, Kim et al. observed large discrepancies for small-field
Evaluating directly the Mobius3D calculations at the optimal col- cases, which would be characteristic of the lung SBRT case investi-
lective DLGC relative to the RayStation calculations, the average gated in this work.10
dose difference was 0.2% 1.9% (range: −4.8% to 4.3%) for the The large maximum differences observed in the current study
TrueBeam, and −1.1% 1.6% (range: −5.2% to 1.7%) for the True- are believed to potentially be due to the variability in plan character-
BeamSTx. The largest dose differences between the two calculations istics investigated and the possibility that a single collective DLGC
were present for the lung SBRT plan where Mobius3D consistently value is not adequate. To further investigate the potential variability
calculated a dose lower than RayStation, with an average difference in the DLGC with varying plan characteristics, an analysis was per-
of −3.3% 1.1% (range: −5.2% to −2.2%). formed on a per-plan basis. By optimizing the DLGC for each plan,
energy, and machine, the optimal plan-specific DLGC values ranged
between −5.38 and 4.59 mm. Some of the plans had a shallower
4 | DISCUSSION slope in the dose difference versus DLGC data, indicating that a
wide range of DLGC values may result in a minimal dose difference
Performing the DLGC optimization based on minimizing the calcu- for these types of plans. However, the overall observed variations in
lated dose difference with measurements for seven VMAT plans the optimal plan-specific DLGC indicates how the choice of plans
allowed for determination of a single collective value for each energy used for the commissioning process can have a large impact on the
and machine. As expected, the average dose difference followed a collective DLGC that is ultimately chosen by the user, especially for
linear trend with DLGC. This produced an optimal collective DLGC plans whose slope (sensitivity) is higher.
value that results in a minimum dose difference of −0.1% 2.0%
for the TrueBeam, and −0.0% 1.5% for the TrueBeamSTx. Based Using plans that are representative of the full range of expected clin-
on the way in which the optimization was performed, values very ical plans is essential to the proper selection of the collective DLGC
near 0.0% were expected. They generally are in agreement with parameter value to be used. For instance, Fig. 7(a) shows that when
many of the prior publications addressing Mobius3D implementa- the lung SBRT plan was removed from the optimization, the collec-
tion. 4–8
However, in the determination of the collective DLGC, a rel- tive DLGC was reduced by 0.34 0.17 mm. On the contrary, if the
atively large range of dose difference values about the mean was lateral cylinder were removed, the collective DLGC became more
observed, as well as patterns that were similar across all energies positive, increasing by 0.52 0.21 mm. The ultimate effect of the
and machine/MLC models, but varying by plan. This study observed variability that may result if a non-representative suite of test plans
disagreement between Mobius3D and measurements of up to 6.1% was chosen for collective DLGC determination is demonstrated in
for the TrueBeam and 4.0% for the TrueBeamSTx when the collec- Fig. 7(b). The decision to potentially exclude a given plan from the
tive DLGC parameter value was used. Fontenot saw disagreement as collective DLGC determination therefore can lead to significant
large as 5.5%,8 but most prior publications reported values closer to changes in the resultantly determined optimal DLGC value. This is
2–3%.4,5,7 particularly true when considering cases that may define the limits
Mobius3D is often used with relatively large gamma parameter of treatment, such as very small or large fields and is demonstrated
tolerances of 5%/3 mm, providing an effective means for detecting by the lung SBRT case. Removing it from the collective DLGC deter-
gross errors and differences with the treatment planning system. As mination for the TrueBeam resulted in the average dose difference
SHEPARD AND FRIGO | 223
increasing from 3.9% to 4.5%. Prior studies by Kim et al. as well as spectrum of plans, it would likely be necessary for the MLC model to be
Hillman et al. noted inaccuracies in Mobius3D calculations for small- improved. Based on these results, MLC model limitations in the second
field deliveries, further strengthening the assertion that it is neces- check software could have the possibility of raising a false positive. Lastly,
sary to ensure the DLGC is optimized for the relevant clinical a comparison between the primary TPS, secondary TPS, and measure-
plans.9,10 ment, points out that one must validate their secondary TPS against mea-
In addition to target volume, the MLC position characteristics in surement, and not use agreement with the primary TPS for this purpose.
the DICOM RT-Plan data were used to further characterize the test
plans, focusing on the average leaf position relative to the central axis.
ACKNOWLEDGMENTS
Essentially, plans with leaf positions further from the central axis
required a more negative plan-specific DLGC. With only the ability to The authors would like to thank Dr. Adam Bayliss, Dr. Jessie Huang-
define a single DLGC, the model may struggle to accurately calculate Vredevoogd, and Stephanie Olson for assistance with plan creation,
dose for plans with characteristics different than what was used for as well as Dr. Jon Hansen and Maxwell Belanger for assistance with
the determination of the collective DLGC. This point is illustrated in data acquisition.
Fig. 6 where the optimal plan-specific DLGC for a given plan (averaged
across all energies) is plotted relative to the ALPCA through the course
CONFLICT OF INTEREST
of the plan. Considering the results observed for plans with varying
characteristics, multiple DLGC values may be necessary to ensure The authors have no conflict of interest to report.
accurate calculation for all clinical scenarios. In the current framework
of the software, this would require creating a separate machine for REFERENCES
plans with different characteristics. Without the ability for the DLGC
1. Childress N, Stevens E, Eklund D, Zhang M. Mobius3D White Paper:
to easily vary with plan characteristics, the accuracy of the software Dose Calculation Algorithm. In.: Mobius Medical Systems; 2012.
may be limited at the boundary extents of the plan characteristic con- 2. Inc.’ VMS. Mobius 3D: Instructions for Use; 2020.
sidered, as was the case for the lung SBRT plan. 3. LoSasso T, Chui CS, Ling CC. Physical and dosimetric aspects of a multi-
This work focused on the implementation of the DLGC for VMAT leaf collimation system used in the dynamic mode for implementing
intensity modulated radiotherapy. Med Phys. 1998;25:1919–1927.
deliveries; however, it is important to consider the potential impact on
4. McDonald DG, Jacqmin DJ, Mart CJ, et al. Validation of a modern
conformal arc deliveries as well. This is particularly relevant at target second-check dosimetry system using a novel verification phantom. J
edges and for small-field conformal arc plans where the DLG will consti- Appl Clin Med Phys. 2017;18:170–177.
tute a larger fraction of the full irradiation field width. Users should be 5. Kodama T, Saito Y, Hatanaka S, Hariu M, Shimbo M, Takahashi T.
Commissioning of the Mobius3D independent dose verification sys-
cautious in the implementation of large positive or negative DLGC values
tem for TomoTherapy. J Appl Clin Med Phys. 2019;20:12–20.
optimized based on larger fields and which could have a substantial 6. Nelson CL, Mason BE, Robinson RC, Kisling KD, Kirsner SM. Com-
impact on small-field conformal arcs. It would be prudent of the user to missioning results of an automated treatment planning verification
verify the validity of DLGC values on a series of conformal arc test plans system. J Appl Clin Med Phys. 2014;15:4838.
7. Clemente-Gutiérrez F, Pérez-Vara C. Dosimetric validation and clini-
as well, if the desire is to implement the same model as was developed
cal implementation of two 3D dose verification systems for quality
for the VMAT plans. This point further emphasizes the necessity to use, assurance in volumetric-modulated arc therapy techniques. J Appl
or at the very least validate, a full representative suite of test plans for Clin Med Phys. 2015;16:5190.
the determination of the proper DLGC. 8. Fontenot JD. Evaluation of a novel secondary check tool for inten-
sity-modulated radiotherapy treatment planning. J Appl Clin Med
Phys. 2014;15:4990.
9. Hillman Y, Kim J, Chetty I, Wen N. Refinement of MLC modeling
5 | CONCLUSION improves commercial QA dosimetry system for SRS and SBRT
patient-specific QA. Med Phys. 2018;45:1351–1359.
10. Kim J, Han MC, Lee E, et al. Detailed evaluation of Mobius3D dose
A Mobius3D DLGC optimization procedure was implemented on both a calculation accuracy for volumetric-modulated arc therapy. Phys
TrueBeam with an MMLC and a TrueBeamSTx with an HDMLC. Optimal Med. 2020;74:125–132.
DLGC parameter values based on all test plans investigated were able to 11. Ezzell GA, Burmeister JW, Dogan N, et al. IMRT commissioning: mul-
be determined through the comparisons of calculated and measured tiple institution planning and dosimetry comparisons, a report from
AAPM Task Group 119. Med Phys. 2009;36:5359–5373.
dose. While the DLGC was able to be optimized for the collective dose
12. Lopes MDC, Santos T, Ventura T, Capela M. Application of the TRS
difference of the plans, the optimal collective DLGC was not the same as 483 code of practice for reference and relative dosimetry in
the optimal DLGC for each plan individually. Ultimately, the DLGC value tomotherapy. Med Phys. 2019;46:5799–5806.
determined from the optimization procedure will be dependent on the 13. Desai VK, Labby ZE, DeWerd LA, Culberson WS. On the implemen-
tation of the plan-class specific reference field using multidimen-
test plan spectrum, making it essential for users to consider how the soft-
sional clustering of plan features and alternative strategies for
ware will be used and the shortcomings that may result from a given test improved dosimetry in modulated clinical linear accelerator treat-
plan suite. In order to achieve an increased accuracy across a full ments. Med Phys. 2020;47:3621–3635.