Enhancing the Performance and Applicability of AI Large

Language Models: Strategies and Improvements

Pengfei SHEN
1
Institute of AAA, BBB University, Street, City, Country
2
Department of AAA, BBB University, City, Country
Email:

Abstract: In this work, I look at the methods of optimizing Large Language Models popular in present-
day implementations of Artificial Intelligence in sectors like Natural Language Processing, customer
support, and text creation. As a result, prior models have restrictions when it comes to processing the
more complex linguistic features, proper usage of CPU and those models are not adhering the ethical
practices. This research responds to these challenges by exploring advancements in model designomal
structure and update methods, together with categorical responsibility frameworks. Measuring the
efficiency of large language models and the potential for their optimization, the work also uses the
analysis of user feedback. The research shows that small changes in model design and training
strategies have high impact on model performance and interpretability in various language tasks. These
findings help to advance the creation of improved and more reliable language models with optimised
ethical frameworks and utility of resources. Areas for future work are presented, such as integration of
more complex multi-modal data and decreasing the amount of bias in model outputs.

Keywords: AI Llarge models, Nnatural Llanguage Pprocessing, Mmachine Llearning, Mmodel

Aarchitecture, Ethical AI
1. Introductionn
2. Healthcare dataset with large readmissions

3. Dataset Description & Justification of the Need for Research

4. The Dataset used is healthcare Data, which shows the rate of patient re-
admission and a broad set of variables specific to the healthcare sector. The patient field
contains demographic entries such as age, gender, race, imaging data, and lab results. On
the other hand, the structured entry set in the data contains; codes such as international
classification of diseases, procedural terms for medical practitioners, and patterns for
patient hospitalization and readmission. The unstructured characteristics of the dataset
entail textual data such as physician notes, patient discharge notes, and conversations from
interaction transcription. The structured and unstructured dataset characteristics show a
domain-specific context such as the use of codes in diagnosis and procedure: International
Classification of disease, and Current procedural terminology.

5. Consequently, it increases the LLM’s capacity to provide accurate

information on a broader set of patient data and the patient profile. For instance, since the
dataset had a huge rate of patient readmission, the LLMs may be needed to scale the broad
patient profiles when doing predictive readmission.

6. Objective

7. To optimize LLM functionality using this dataset, it is critical to assess accurate

strategies for LLM optimization from the described dataset characteristics. Therefore, the
objectives for this paper will be based on the characteristics of the healthcare Dataset:

8. To fine-tune and enhance the accuracy of large language models in hospital systems, which
in turn makes LLMs accurate and relevant to healthcare as a domain.

9. To enhance the large language Model’s capacity to parse language, increasing the run-time
efficiency of parsing healthcare data.
10. To use demographic data, patient_ID, and profile to enhance ethical frameworks such as
transparency, accountability, and accuracy in the application of large language models in
real-world systems.

11. Strategies to achieve these objectives from the Healthcare Dataset Analyzed

The capacity of large language models to perform tasks in the healthcare systems is immense.
Today, the deployment of large language models to perform human-like tasks spans every system of
humanity. We are bombarded by new version releases of large language models by firms like OpenAI,
Google, Microsoft, and X daily in sectors like education, and research. However, in sectors such as
healthcare, where people’s lives are at risk, there should be stricter regulations on the release of large
language models. A key driver for these regulations is the ethical framework, specific to healthcare.

The provided dataset captures a diverse set of patient profiles and includes a range of variables
related to the patient such as age, and gender which are spread across different age and gender cadres.
Additionally, the outcome-specific variables such as department, diagnosis, treatment cost, and
duration of admission span a wide range of clinical observations and patient_ID. This broad
representation ensures that the large language models in healthcare are trained on a wide range of
variables, making it easier for models to generalize datasets much better during tasks such as predicting
patient readmission rates and recommending treatment based on diagnosis. A broad dataset in clinical
and demographic elements ensures that large language models respond accurately to every patient
profile, this reduces instances of bias. 重复建议删
Fine-tuning the model’s performance on context-related tasks can also help to enhance the
relevance and accuracy of large language models in key domains such as health care. For instance, the
dataset used has specific terminology and vocabulary for healthcare staff which, if non-generic LLLMs
are exposed to frequently, they can be adapted to deliver specific tasks accurately: predict readmission
rates based on clinical diagnosis and outcomes. Also, by understanding sector-specific vocabulary, it is
possible to train large language models on a phrase which will later enhance how the LLM parses the
context vocabulary.
 Using LLMs it is possible to teach a system to read and write like a human thus enhancing artificial
intelligence. These models include OpenAI’s GPT-4, and Google BERT among others, and its
functionality is anchored on embeddings derived from transformer models. Due to possessing large
datasets and training, LLMs are capable to do tasks that were deemed human privilege; such as
translation, summarization, and writing. This leap has been used in scenarios such as Automated
Customer Interaction where LLMs are applied to answer tricky questions from a user and in Virtual
Personal Assistants where they enable more intelligent and more efficient natural interaction between
the human and the machine. The improvement of LLMs has been occurring at a remarkable pace and
the potential scenarios across industries have expanded enormously to introduce breakthrough levels of
automation, productivity, and experience.

Nevertheless, large language models present large challenges as well Large language models are
often complex to develop and deploy. One of the concerns is that effectively training and deploying
such models need huge computational power. An LLM can only be trained with large amounts of data
and this requires extensive processing that equally calls for a lot of energy hence expensive and more to
the point; bears a great impact on the environment. Further, these models need to be scaled and such
scaling requires substantial computational resources which are often expensive and this gives an
ecological concern. The main drawback of the LLMs is their computational complexity which hinders
usability and leads to a so-called digital equity since not all companies and researchers can afford using
the modern technologies (Zhao et al., 2023).

Research Gap
Although the previous years’ literature has strongly concentrated on the way of enhancing model
size and the number of parameters, which has beneficial effects in terms of performance, this strategy
gives a relatively low level of effect in contemporary years. Amplifying the number of LLMs does not
result in improved capabilities in handling complex languages and it is not effective thus. Bigger
models are computationally more demanding as well as demanding in terms of RAM, however they are
not able to appropriately analyse sophisticated search terms, nor are they able to maintain context
between the steps of a conversation. Therefore, it has become important to look for other ways of
enhancing LLMs like, achieving enhanced results through optimal design the models and the
integration of new training methods which are not necessarily allied to increases in the size of the
model.In response to these research gaps, this study addresses the following questions 1.

Research Questions This study seeks to answer the following questions:

How can architectural improvements make large language models more efficient? 2.

What training techniques can enhance the contextual understanding and generalizability of these
models? 3.

How can ethical frameworks be integrated into model design to reduce biases and improve ethical
alignment?

Research Purpose The purpose of this study is to propose and evaluate strategies for improving
large language models. By focusing on architecture, training, and ethics, this research aims to develop
more efficient, capable, and ethical language models that better serve both technological and societal
needs

12. .

13. Literature Review

13.1. Model Architecture

The architecture of large language models has been changed a lot to become the advanced part of
current artificial intelligence system for language processing. The trend-setting innovation in this sector
is the transformer model by Vaswani et al, (2017) that revolutionized the methods in NLP. Attention
mechanism in transformers helps the model to pay its attention to some certain segments of the textual
input to grasp the context of the relationships. In contrast to the sequential type models like the
recurrent neural networks (RNNs), attention-based approach enabled the model to handle text input
parallelly. Adapter modules allow parallelizing computations, transformer architecture lends itself to
scale up, these main factors make transformer architecture the basis for most large scale LLMs
including BERT and GPT-4.
Despite successful attempts with transformers, scaling such models has brought up certain
difficulties that are not easily overcome and significantly decrease the practical usability of such
models in terms of computational complexity. Larger models are more expensive to train as well as use
and there is a downward slope in the gains we expect to get from models in terms of performance. For
example, to achieve a few percentage-point improvement in either language understanding or synthesis,
a model might almost double its size but that could demand much higher computational resources and
memory space at least quadratically. This trend has prompted the researchers to wondered if the
approach that is characterized by the mere scaling up of the model parameters will sustain the required
improvement in performance. As the experiments have shown, the increase in the model size allows
solving more complex tasks, but going further towards an unlimited augmentation of size encounters
both economical and ecological challenges, so the Search for new architectural solutions is necessary
(Chen et al., 2024).

To overcome these issues, there have been many suggestions for architectural revisions in the
contemporary research while retaining or boosting model performance. Thus some architectures such
as sparse attention frameworks limit the computational attention processes by only operating on limited
portions of the input. Rae et al. (2019) proposed entity aware sparse transformers which employ this
mechanism to yield high performance with hardly any loss of understanding of language. Through
attention mechanism where only sparse attention is given to smaller regions of input data, sparse
transformers lower the computational complexity of the respective method from quadratic to linear
hence enabling the training of larger models using lesser resources. This approach suggests a future that
is filled with more efficient use of resources in models without having to sacrifice accuracy or even an
understanding of the context in which they are used (Nazi et al., 2024).
13.2. Training Techniques

Training techniques are pivotal to both the design and performance of large language models with
the current training practices based on large dataset and immense computing power. Pre-service
training methods for LLMs include the introduction of a large number of features in the model with the
intention of having the model learn features of the language. However, this process is very resource
contentious, needing thousands of processing hours on highly sophisticated equipment. This training
paradigm is expensive and time-consuming, and consequently occludes adoption and adaptation of
LLMs, as evidenced by the stylized training processes exhibited in this study.

Efficient training of primitives has been an important issue in recent research, and one of the most
promising ideas in the current literature is curriculum learning, where many models are initially trained
on easier tasks before moving on to more difficult ones. Started by Bengio et al. (2009), curriculum
learning is based on learning processes that employs basic materials before difficult ones. In the context
of LLMs, this method can contribute to enhance model understanding and generalization because
enables the model establish a foundation of linguistic knowledge before approaching other difficult
language related tasks. Dividing the training process into stages also enables curriculum learning to
obtain superior performance with relatively fewer calculations, so that it is a promising approach to
replace the conventional training methods.

Indeed, knowledge distillation is the other strategy that can be used for training large language
models at a faster rate. This technique partly freezes the weights of the larger teacher model, and then
distills the knowledge of the teacher model into a smaller set of parameters in the student model while
achieving similar performance. For instance, through knowledge distillation Hinton et al. (2015)
showed that it is possible to mimic or copy functionality of large models in relatively small novel
models with correlation of much less computational demands. As it will be shown further, this
approach is especially beneficial where it is impossible to implement full-sized LLMs. AM: This
practical application of knowledge distillation to extract knowledge from large, professionalized
models presents knowledge distillation as the way to obtain NLP solutions using smaller, more
efficient models.

13.3. Ethical Considerations and Bias Mitigation

The two products that define large language models have raised high stakes ethical concerns,
including issues such as bias in the model’s outputs. By design, LLMs are pre-trained on a large corpus
of dataset that are meant to sample a cross section of the human language, usually scraped from the
web. However, these datasets are by themselves, prejudiced and incorporate polarized biases based on
race, gender, and the economic status of a person. Therefore LLMs can perpetuate such bias and use it
in a way that produces more bias in sensitive applications. For example, the LLMs may generate sexist
or racist descriptions of candidates or judgments in cases, for which their application in such central
life domains raises ethical questions (Bender et al., 2021).
To this, various debiasing strategies have been suggested and introduced with an aim of reducing the
amount of ethical harm the LLM outputs would cause. Such training techniques include adversarial
training, whereby the model is trained to counter biased responses with the help of counter-example or
with difficult stimulus input patterns. This method has proven to be useful to eliminate evident bigotry
from model responses while it should be standardized keenly to counteract substantial impacts. Another
debiasing technique is the use of filters or constrains in the generation process where certain religious
filters or constrains will not allow the model to generate biased or toxic language. Such methods mark a
step up in reduction of bias depicting hurdles they present since they can sometimes negatively impact
the flow and coherence of the generated outputs.
As for debiasing reminiscent approaches, ethical guidelines are beginning to regard as critical in the
accountable application and advancement of large language models. The ground rule of ethical AI
system highlighted by Jobin et al.( 2019) include transparency accountability and fairness. The
application of these principles into LLMs design need not be a haphazard approach but instead a form
of LLMs development which considers ethical implications of the model in question at every phase.
For instance, a measure in transparency they referred to was ensuring that one has documented the
training of the model, including the type of data used in the process, so that stakeholders can make their
own consideration on possible biases. Promising measures, including auditing procedures, and
feedback from its users should also complement this aspect to help ensure that models act in ethically
responsible manners.
14. Methodology
14.1. Approach

This research employs both qualitative and quantitative approaches to evaluate the improvements
being proposed for enhancing large language models (LLMs). The quantitative dimension is mainly on
the performance measurement and assessment since quantitative measures entails accuracy, efficiency
and bias to assess the improvement on the functionality and resource usefulness of the models.
Quantitative analysis is a crucial tool in evaluating architectural and training improvements because
this approach enables researchers to identify ratios and compare baseline to improved designs without
bias. Through analysis on tangible values, this study will seek to develop realistic findings on the
implications of a particular set of model modifications under consideration in order to best serve the
purpose of establishing the utilization and feasibility of the identified changes on a larger scale
(Thirunavukarasu et al., 2023).
The qualitative part of this approach aims to assess those ethical factors that are important for being
fair and accountable and transparent. These ethical dimensions are important for evaluating in how
much degree the adapted model complies with societal norms and values for the appropriate use of AI.
In this study, the output of the proposed model is analyzed qualitatively in order to detect the bias, the
ethical risks that can occur, as well as the enhancement in the application of fairness standards. This
approach derives from the current AI best practices, making it possible to systematically analyze the
model conduct and results at stake. The fact that qualitative analysis is incorporated into the study
means that the modifications achieve a balance between the ethical and the performance aspects of
model improvement (Nazi et al., 2024).
This research supports both quantitative and qualitative approaches in order to achieve a deeper
insight into the perspective and applicability of the employed model. The mixed-methods approach
enables the study to evaluate not only the technical changes but also the ethics of model changes. The
approach is most useful in directing attention both to the model and its output when ethical AI has
become all the more critical in domains where model predictions are likely to affect real-world
decisions. Quantitative data documents actual improvement on standard measures, while qualitative
data helps to guarantee that such improvement was not achieved at the cost of ethical posture. When
combined, it provides an accurate method of evaluation promoting technical efficiency and ethical
practices to enhance Large Language Models.
14.2. Data Collection and

14.3. Technical information gathering involves using a form of an existing large language model
that has been adapted to accommodate improvements in architecture and training
procedures. To reduce bias originating from the training data, linguistic contexts are
sampled from accessible pool data for the model’s training exclusively. To the best of the
study’s methodology, the datasets can easily be accessed by independent parties, thus
ensuring accountability and research integrity. Further, cleaning is performed on the data
to filter out content that may be irrelevant or biase towards the results which can aid in
evaluation of the model based on certain ethical actions.

14.4. There are controlled experiments to compare baseline model with the improved models
Turniverse16 contains two modes – baseline Turniverse16 and enhanced Turniverse16.
These experiments entail feeding the model with different NL tasks, including text gen,
sentiment analysis, and QA, which enable evaluation on a task by task basis. In each of the
experiments the accuracy, efficiency and steadiness of the model’s response are recorded.
What makes these experiments easy to conduct is the fact that they eliminate the influence
of extraneous variable which enables a viewer to directly attribute the resultant changes to
the experimental modifications. also, the settings are restricted thus affecting the reduction
of possible bias that could be caused by environmental factors such that comparison
becomes more accurate.
14.5. To include ethical aspects, extra information about the results of the models is collected
precisely in the situations where biases may appear. This also comprises the assessment of
model responses in cases of specific topics or concern minorities and issues usually deemed
sensitive by most LLMs. The collected outputs are then for suspicious of bias or ethical
misalignment, based on presupposed ethical standards. To do so, the research gathers
information from both standard performance metrics, as well as from cases that pose
ethical concerns to gather a set of data that covers as many aspects as the behavior of the
model itself can offer. This mode of data collection makes it easy to assess the impact of the
proposed enhancements in terms of efficiency and stewardship.这部分内容在你的结果部分并没有体现出来，
建议删除减少篇幅。

14.6. Data Analysis

14.6.1. Dataset Description

The Dataset used is healthcare Data, which shows the rate of patient re-admission and a broad
set of variables specific to the healthcare sector. The patient field contains demographic entries such as
age, gender, race, imaging data, and lab results. On the other hand, the structured entry set in the data
contains; codes such as international classification of diseases, procedural terms for medical
practitioners, and patterns for patient hospitalization and readmission. The unstructured characteristics
of the dataset entail textual data such as physician notes, patient discharge notes, and conversations
from interaction transcription. The structured and unstructured dataset characteristics show a domain-
specific context such as the use of codes in diagnosis and procedure: International Classification of
disease, and Current procedural terminology.
On these two domain specific aspects; research can be used to enhance how LLM accuracy can
be achieved to counter misinterpretation of codes of procedure and diagnosis in healthcare applications.
Additionally, variables in healthcare dataset such as the visualized dataset come in handy when fine-
tuning the interpretation and features of large language models to healthcare dataset since it is domain
specific. For instance, the textual data from structured and unstructured variable category can be used
in the fine-tuning of large language models to healthcare specific contexts such as patient discharge and
patient progress notes, codes of procedure in healthcare, and the codes for diagnosis.
Consequently, it increases the LLM’s capacity to provide accurate information on a broader set
of patient data and the patient profile. For instance, since the dataset had a huge rate of patient
readmission, the LLMs may be needed to scale the broad patient profiles when doing predictive
readmission.
14.6.2. Objective
To optimize LLM functionality using this dataset, it is critical to assess accurate strategies for LLM
optimization from the described dataset characteristics. Therefore, the objectives for this paper will be
based on the characteristics of the healthcare Dataset:
 To fine-tune and enhance the accuracy of large language models in hospital systems, which
in turn makes LLMs accurate and relevant to healthcare as a domain.
 To enhance the large language Model’s capacity to parse language, increasing the run-time
efficiency of parsing healthcare data.
 To use demographic data, patient_ID, and profile to enhance ethical frameworks such as
transparency, accountability, and accuracy in the application of large language models in
real-world systems.
 In this study, quantitative analysis uses several performance evaluation indicators such as
accuracy, F1 score, and computational efficiency ratio. This is because the measure of the
accuracy score can be directly ascertained from the efficiency of the model for completing
numerous NLP tasks and it offers direct measure of the ability of the model to comprehend
language. While the F1 score, a standard metric of NLP, takes into account the level of
precision in responding, it also measures recall to get an overview of the model’s accuracy of
responses. These metrics are important in evaluating the optimizations brought by the
architectural and the training changes as they measure the effectiveness of the model in
understanding and processing language. Computational efficiency ratios on the other hand,
establish the resources needed for each task and compels an understanding of how the
improvements affect speed and resources. This metric is especially important from the
perspective of overal sustainability and feasibility of applying the enhanced model within
real-life situations.这部分同样的问题，你的研究结果并没有体现出这一部分的内容。

15. Results

This section presents the analysis of visualizations and data, highlighting how these findings address
the study’s core research questions regarding model optimization and ethical considerations.
15.1. Visualization Analysis

15.1.1. Admission Rate by Patient Profiles

This visualization shows patient admission rates segmented by demographic profiles, such as age,
gender, and diagnosis category. Higher admission rates were noted among older age groups, which

align with common healthcare trends showing increased readmission rates due to chronic health issues.

These patterns indicate that the model’s ability to predict readmission can be enhanced by focusing on

these demographic segments, reinforcing the need for targeted training that reflects real-world data

structures.

Figure 1: Admission Rate by Patient Profiles

图片最好用黑白的，另外图片无法显示出你得到的结论，你要联系图片中的信息再去得到结论。

15.1.2. Treatment Cost Across Diagnoses

The analysis of treatment costs across various diagnoses reveals significant disparities, especially

among chronic conditions like diabetes and hypertension. This finding underscores the importance of

cost-efficiency in model design, where understanding cost variations can guide budget-sensitive

healthcare recommendations. This data also highlights the role of the model in resource optimization,
providing cost-related insights for healthcare systems that can adapt dynamically to patient needs based

on diagnosis.

Figure 2：Treatment Cost Across Diagnoses

15.1.3. Duration of Admission by Length of Stay

The duration analysis suggests an inverse relationship between specific treatments and recovery times.

For example, patients admitted with fractures generally had shorter stays compared to those with

chronic conditions, such as diabetes. By incorporating these stay-duration patterns, the model can

improve its contextual predictions, such as estimating discharge times, thus enhancing its functionality

in real-time hospital management systems.

 Figure 3：Duration of Admission by Length of Stay
这个图片上信息展示的信息就不太清楚了，如果发表图片换变成黑白的，图片信息就会消失。建议更换图片。

15.1.4. Patient ID, Length of Stay, and Readmission Trends

This visualization connects patient ID data with variables like length of stay and readmission dates.

Patterns indicate that longer initial stays often correlate with reduced likelihood of immediate

readmission, suggesting that comprehensive initial treatment can decrease overall readmission rates.

This insight supports the model’s potential for integrating patient history data to refine predictive

accuracy for readmission risk, particularly valuable in personalized healthcare applications.

 Figure 4：Patient ID, Length of Stay, and Readmission Trends

16. Conclusion

Addressing Research Questions

The analysis demonstrates how the optimized model design can yield practical improvements in
handling demographic-specific data, cost structures, and treatment durations. By enhancing model
architecture and training with these insights, the model can achieve better predictive capabilities for
readmissions and optimize healthcare resources effectively. Furthermore, understanding cost and
duration variables contributes to creating a more ethically balanced model, where resource allocation is
guided by patient-specific needs rather than generic data patterns.

Visualizations

1: Admission Rate Against Patient Profiles

2: Treatment Cost across various Diagnoses
3: the duration of admission by length of days
 4 Patient_ID by length of Stay against Readmission and Discharge Dates

Conclusion

Summary This study has addressed critical areas for enhancing AI large language models by
proposing improvements in architecture, training methods, and ethical integration. The findings
demonstrate that targeted architectural and training adjustments can enhance efficiency and
comprehension, while ethical frameworks help mitigate biases.
Contributions to the Field These advancements contribute to the field of AI by suggesting practical
ways to make LLMs more efficient and socially responsible. The research reinforces the importance of
comprehensive strategies that go beyond scaling in developing effective and ethical AI systems.
Recommendations It is recommended that AI developers consider sparse attention mechanisms and
curriculum-based training for future models. Additionally, ethical considerations should be embedded
in the model development process to ensure socially responsible AI systems.

References
[1] Ainslie, J., Ontanon, S., Alberti, C., Pham, P., Ravula, A., Sanghai, S., Wang, Q., & Yang, L. (2020). ETC: Encoding
long and structured data in transformers. Proceedings of the 2020 Conference on Empirical Methods in Natural
Language Processing (EMNLP), Association for Computational Linguistics.
[2] Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can
language models be too big? Proceedings of the 2021 ACM Conference on Fairness, Accountability, and
Transparency, Association for Computing Machinery.
[3] Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009). Curriculum learning. Proceedings of the 26th Annual
International Conference on Machine Learning, Association for Computing Machinery.
[4] Chang, Y., Wang, X., Wang, J., Wu, Y., Yang, L., Zhu, K., ... & Xie, X. (2024). A survey on evaluation of large
language models. ACM Transactions on Intelligent Systems and Technology, 15(3), 1-45.
[5] Chen, Z., Li, Y., & Wang, K. (2024). Optimizing reasoning abilities in large language models: A step-by-step
approach.
[6] Hadi, M. U., Al Tashi, Q., Shah, A., Qureshi, R., Muneer, A., Irfan, M., ... & Shah, M. (2024). Large language models:
a comprehensive survey of its applications, challenges, limitations, and future prospects. Authorea Preprints.
[7] Hinton, G., Vinyals, O., & Dean, J. (2015). Distilling the knowledge in a neural network. arXiv preprint
arXiv:1503.02531.
[8] Jobin, A., Ienca, M., & Vayena, E. (2019). The global landscape of AI ethics guidelines. Nature Machine Intelligence,
1(9), 389–399.
[9] Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., ... & Kasneci, G. (2023). ChatGPT
for good? On opportunities and challenges of large language models for education. Learning and individual
differences, 103, 102274.
[10] Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., ... & Mian, A. (2023). A comprehensive overview
of large language models. arXiv preprint arXiv:2307.06435.
[11] Nazi, Z. A., & Peng, W. (2024, August). Large language models in healthcare and medical domain: A review.
In Informatics (Vol. 11, No. 3, p. 57). MDPI.
[12] Rae, J. W., Razavi, A., Doersch, C., Eslami, S. A., & Rezende, D. J. (2019). Scaling autoregressive models for content-
rich text generation. Proceedings of the 36th International Conference on Machine Learning, Association for
Computing Machinery.
[13] Thirunavukarasu, A. J., Ting, D. S. J., Elangovan, K., Gutierrez, L., Tan, T. F., & Ting, D. S. W. (2023). Large
language models in medicine. Nature medicine, 29(8), 1930-1940.
[14] Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017).
Attention is all you need. Advances in Neural Information Processing Systems, 30.
[15] Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., ... & Wen, J. R. (2023). A survey of large language
models. arXiv preprint arXiv:2303.18223.