Artificial Intelligence Applications and Ethical Challenges in Oral and Maxillo-Facial Cosmetic Surgery: A Narrative Review
Artificial Intelligence Applications and Ethical Challenges in Oral and Maxillo-Facial Cosmetic Surgery: A Narrative Review
Abstract
Artificial intelligence (AI) refers to using technologies to simulate human cognition to solve a specific problem. The
rapid development of AI in the health sector has been attributed to the improvement of computing speed, exponen-
tial increase in data production, and routine data collection. In this paper, we review the current applications of AI for
oral and maxillofacial (OMF) cosmetic surgery to provide surgeons with the fundamental technical elements needed
to understand its potential. AI plays an increasingly important role in OMF cosmetic surgery in various settings, and
its usage may raise ethical issues. In addition to machine learning algorithms (a subtype of AI), convolutional neural
networks (a subtype of deep learning) are widely used in OMF cosmetic surgeries. Depending on their complexity,
these networks can extract and process the elementary characteristics of an image. They are, therefore, commonly
used in the diagnostic process for medical images and facial photos. AI algorithms have been used to assist surgeons
with diagnosis, therapeutic decisions, preoperative planning, and outcome prediction and evaluation. AI algorithms
complement human skills while minimizing shortcomings through their capabilities to learn, classify, predict, and
detect. This algorithm should, however, be rigorously evaluated clinically, and a systematic ethical reflection should
be conducted regarding data protection, diversity, and transparency. It is possible to revolutionize the practice of
functional and aesthetic surgeries with 3D simulation models and AI models. Planning, decision-making, and evalua-
tion during and after surgery can be improved with simulation systems. A surgical AI model can also perform time-
consuming or challenging tasks for surgeons.
Keywords Artificial intelligence, Deep learning, Machine learning, Orthognathic surgery, Rhinoplasty
Background
AI (artificial intelligence) is the creation of machines
capable of performing tasks that usually require humans.
*Correspondence: Its use dates to the 1950s. As a subfield of AI, machine
Rata Rokhshad
[email protected] learning uses algorithms to learn intrinsic statistical
1
Topic Group Dental Diagnostics and Digital Dentistry, ITU/WHO Focus patterns and structures in data, allowing predictions of
Group AI on Health, Berlin, Germany
2
yet-unknown variables (Fig. 1). Data-driven algorithms
Department of Medicine, Boston University Medical Center, Boston, MA,
USA can be built by machines, and thus, they can solve pre-
3
College of Dentistry, Department of Oral & Maxillofacial Surgery, diction problems without human intervention. Artificial
Gangneung-Wonju National University, Gangneung, South Korea
4
neural networks (ANN) mimic the human brain nonlin-
Department of Oral & Maxillofacial Surgery, University of Florida, College
of Medicine, Jacksonville, FL, USA early using artificial neurons like human neural networks.
5
Maxillofacial Surgery & Implantology & Biomaterial Research The neural network can simulate human cognitive capa-
Foundation, Tehran, Iran
6
bilities, such as solving problems, making decisions, and
Iface Academy, Atlanta, GA, USA
learning new things [1, 2]. A “deep learning” architecture
This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply 2023. Open
Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation,
distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source,
provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this
article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is
not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the
permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativeco
mmons.org/licenses/by/4.0/.
Rokhshad et al. Maxillofacial Plastic and Reconstructive Surgery (2023) 45:14 Page 2 of 7
Table 1 The specific search query for each database (till 30th December 2022)
Database Keywords Results
PubMed ("Artificial intelligence" OR "Machine learning" OR "deep learning" OR "neural network" OR "machine intelligence") AND 256
("cosmetic" OR "aesthetic" OR "facial") AND "surgery"
Google Scholar allintitle:("Artificial intelligence" OR "Machine learning" OR "deep learning" OR "neural network" OR "machine intelligence") 21
AND ("cosmetic" OR "aesthetic" OR "facial") AND "surgery"
Scopus TITLE-ABS-KEY ( ( "Artificial intelligence" OR "Machine learning" OR "deep learning" OR "neural network" OR "machine 245
intelligence" ) AND ( "cosmetic" OR "aesthetic" OR "facial" ) AND "surgery" )
Embase (’artificial intelligence’/exp OR ’artificial intelligence’ OR ’machine learning’/exp OR ’machine learning’ OR ’deep learning’/ 701
exp OR ’deep learning’ OR ’neural network’/exp OR ’neural network’ OR ’machine intelligence’/exp OR ’machine intelligence’)
AND (’cosmetic’/exp OR ’cosmetic’ OR ’aesthetic’ OR ’facial’) AND (’surgery’/exp OR ’surgery’)
Web of Science ("Artificial intelligence" OR "Machine learning" OR "deep learning" OR "neural network" OR "machine intelligence") AND 178
("cosmetic" OR "aesthetic" OR "facial") AND "surgery"
IEEE ("Artificial intelligence" OR "Machine learning" OR "deep learning" OR "neural network" OR "machine intelligence") AND 65
("cosmetic" OR "aesthetic" OR "facial") AND "surgery"
have been used, including back-propagation neural net- prediction algorithms. Machine learning algorithms can
works (BPNNs) for identifying nose bones, random for- predict the results of each surgeon if photographs taken
ests, and support vector machines [11–13]. during perioperative surgery are available. Computerized
There are lots of technical challenges associated with simulations can become more realistic by incorporating
rhinoplasty in plastic surgery. Computer-aided models AI.
would significantly benefit rhinoplasty over any other In a study by Dorfman et al. [14], a detailed photo-
cosmetic surgery because of its complexity and sig- graphic analysis involving 68 facial measurements and
nificant aesthetic and functional consequences for the 128 data points generated for each photo, combined with
patient. Considering the inherently visual nature of rhi- a ranking CNN algorithm (Microsoft Azure Face API),
noplasty, AI applications are a fertile field. A machine eliminates human layperson error and yields an accurate
learning algorithm can recognize hidden patterns and estimate of human age. A CNN algorithm has also been
accurately predict outcomes based on this visual nature, shown to outperform human references when estimat-
which can be converted into raw data. Moreover, as so ing age. The CNN algorithm was programmed to resize
many pre- and postoperative photos are available, it is and crop all included patient photos so that the eyes and
relatively easy to create a rich database of pre-and post- lips of every patient could be measured from a standard
operative photos to train the algorithms for a complete location. Not only were all included patient photos fron-
predictive accuracy that humans cannot match. AI mod- tal shots with the face in a neutral pose, but the CNN
els designed especially for rhinoplasty have been iden- algorithm was also specifically programmed to measure
tified; these models use different AI domains and are the eyes and lips of all included patients from a standard
implemented at various stages of preoperative planning location. As demonstrated by the correlation coefficient
and postoperative outcomes assessment. of 0.9, both smiling and frowning do not affect mood,
However, the gap between ideal simulation and actual self-perception, and, ultimately, age determination [6, 14,
outcomes in rhinoplasty prevents us from maximizing 15]. Moreover, through a combination of 3D image regis-
the benefits of technological implementation in rhino- tration technology and databases, Zeng et al. developed a
plasty. However, 3D simulations and computerized analy- virtual planning system to accurately estimate the dimen-
ses benefit surgeons in preoperative and postoperative sions of forehead flaps used for nasal defect reconstruc-
management. There is an apparent gap in patient satisfac- tion (Fig. 2) [16].
tion with rhinoplasty, as reflected in the relatively high Using perioperative photographs, Chinski et al. [15]
revision rates. However, machine learning can help fill developed an AI model that accurately simulates the out-
this gap with its predictive capabilities and pattern rec- comes of rhinoplasty surgeries. Residents and specialists
ognition abilities. It is possible to train machine learning in otolaryngology evaluated simulations created by the
algorithms using perioperative photographs to produce model. A surgeon’s simulation image and the AI model’s
more realistic simulations based on the 3D models. It image were shown randomly to the evaluators. Using a
is more accurate and realistic to make predictions with Likert scale, the participants expressed how much they
machine learning when combined with perioperative agreed with the simulations. AI simulations were agreed
photography databases rather than with ideal robotic upon by 68.4% of evaluators, while surgeon simulations
Rokhshad et al. Maxillofacial Plastic and Reconstructive Surgery (2023) 45:14 Page 4 of 7
were agreed upon by 77.3%. However, despite higher surgery. Based on the results, the models have shown a
agreement rates among experts in the surgeon’s simu- high degree of accuracy of 85 to 95.6% [20]. Addition-
lations, the model achieved promising results. Before ally, AI models predicted the perioperative blood loss
meeting in person with a particular surgeon, patients can and systemic infections following orthognathic surgery
generate a realistic simulation of the postoperative out- in addition to predicting the future need for orthognathic
come to form an accurate appraisal of the potential out- surgery [4, 19, 21].
come [6, 15]. In a study by Hong et al., the accuracy of AI-assisted
cephalometric landmark detection in jaw orthognathic
Orthognathic surgeries surgery cases had been reported to be 75%, even when
An orthognathic surgeon’s clinical experience is essential orthodontic brackets, surgical plates, screws, fixed
to creating a detailed treatment plan, and the plan plays retainers, genioplasty, and bone remodeling were present
a vital role in the outcome [17]. As a surgeon designs [22]. A CNN model was 94.4% accurate for diagnosing
and fabricates surgical splints based on CT (computed orthognathic surgery cases using both lateral and frontal
tomography scan) or CBCT (Cone-beam computed cephalograms [23]. According to a study by Jeong et al.,
tomography systems) models, 3D craniomaxillofacial deep learning CNN was able to accurately diagnose sur-
features are automatically registered [18, 19]. Thus, gical patients based on facial photographs (frontal and
measuring the amount and direction of hard and soft tis- lateral) [24]. In a study by Tanikawa et al., they evaluated
sue movements in 3D before orthognathic surgery can AI for predicting the 3D facial shape after orthodontic
be valuable for determining the amount and direction treatment and orthognathic surgery (Fig. 3) [25]. This
of surgical interventions. Due to cleft-related deformi- confirms the clinical acceptability of AI systems for pre-
ties and scar tissue, it is especially beneficial for treating dicting facial morphology after treatment.
patients with clefts as their soft tissues differ both mor-
phologically and behaviorally from those of non-cleft Future applications
patients [18]. AI can be used to identify precise land- AI has great potential for OMF cosmetic surgeries
marks, analyze rapid digital cephalometric data, make as one of many specialties. Thinking machines could
clinical decisions, and predict treatment outcomes using improve the efficiency and patient satisfaction of plastic
software enabled by AI. surgeons’ diagnostic, case-planning, and perioperative
Additionally, artificial intelligence has been applied to tasks. In order to make surgical decisions, the surgeon
presurgical orthopedics, speech pathology detection, and must be able to create an appropriate differential diag-
the need to predict the need for CLP (cleft lip and palate) nosis list, determine the best tests for establishing the
Rokhshad et al. Maxillofacial Plastic and Reconstructive Surgery (2023) 45:14 Page 5 of 7
Fig. 3 In a study by Tanikawa et al., facial morphology in Japanese patients after orthognathic surgery and orthodontic treatment was predicted
using AI [2]. Surgery group pre-treatment actual facial changes (top-left) and the superimposition of pre-treatment and post-treatment actual facial
changes (blue and yellow). After surgery, the blue column indicates a downward displacement after treatment, and the yellow column indicates
an upward displacement after treatment. When viewed antero-posteriorly, yellow indicates protrusion, while blue indicates retrusion. A custom
MATLAB program was used to create the figures
diagnosis, and devise a plan to deal with the diagnosis Ethical issues
using heuristic techniques and informed judgment. AI- Multiple ethical concerns arise when AI is introduced
enabled decision-making tools combined with predic- into OMF cosmetic surgeries, especially in a plastic sur-
tive analytics and integrating human surgical intuition geon’s clinical practice. Many ethical dilemmas arise from
hold great promise for improving surgical outcomes. AI systems that claim to classify attractiveness objec-
The surgeon could make real-time decisions periopera- tively. Ethnicity and gender can be discriminated against.
tively based on 3D planning, anatomical localization, In isolation, AI could lead to the propagation of racial
and surgical navigation [15, 18, 21, 26]. Complex sur- division and a loss of diversity in cosmetic surgeries [27].
gical procedures cannot be performed with current AI Dataset size is also a significant limitation, particularly
tools. They may, however, become capable of perform- when training CNN, which is particularly data intensive.
ing more complex tasks in the future. OMF cosmetic Training data, algorithms, parameters, and quality influ-
surgeries could be improved through technological ence the training data needed [10, 28, 29]. Most of the
advancements, reducing the amount of time spent studies on applications of AI in OMF cosmetic surgeries
anesthetizing patients and decreasing their recovery had limited sources of datasets.
time after surgery. This technology also presents excit- A small dataset can be overcome in several ways. Spe-
ing opportunities for improving surgical outcomes in cific data augmentation techniques can partially address
low- and middle-income countries with a need for sur- the problem, especially in geometric deformation image
geons and their expertise and limited resources. processing. However, collecting datasets from different
Similarly, the armed forces may use AI surgical centers containing different genders, ages, and nation-
machines to treat injuries far away from medical cent- alities will increase the generalizability of the AI model.
ers. It is still being determined whether robot-assisted Black patients and providers are underrepresented in
surgery is cost-effective in plastic surgery, as in other rhinoplasty and blepharoplasty [30]. It is essential to
specialties. A national healthcare system should deter- discuss the validity of assessing attractiveness based
mine this before implementing it widely. on data obtained from a dating platform. According to
Rokhshad et al. Maxillofacial Plastic and Reconstructive Surgery (2023) 45:14 Page 6 of 7
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in pub-
lished maps and institutional affiliations.
© This is a U.S. Government work and not under copyright protection in the
US; foreign copyright protection may apply 2023. This work is published
under http://creativecommons.org/licenses/by/4.0/(the “License”).
Notwithstanding the ProQuest Terms and Conditions, you may use this
content in accordance with the terms of the License.