1.Abstract
1.Abstract
1. This paper reviews the research trends that link the advanced technical aspects of
recommendation systems that are used in various service areas and the business aspects of
these services. First, for a reliable analysis of recommendation models for recommendation
systems, data mining technology, and related research by application service, more than
135 top-ranking articles and top-tier conferences published in Google Scholar between 2010
and 2021 were collected and reviewed. Based on this, studies on recommendation system
models and the technology used in recommendation systems were systematized, and
research trends by year were analyzed. In addition, the application service fields where
recommendation systems were used were classified, and research on the recommendation
system model and recommendation technique used in each field was analyzed.
Furthermore, vast amounts of application service-related data used by recommendation
systems were collected from 2010 to 2021 without taking the journal ranking into
consideration and reviewed along with various recommendation system studies, as well as
applied service field industry data. As a result of this study, it was found that the flow and
quantitative growth of various detailed studies of recommendation systems interact with the
business growth of the actual applied service field. While providing a comprehensive
summary of recommendation systems, this study provides insight to many researchers
interested in recommendation systems through the analysis of its various technologies and
trends in the service field to which recommendation systems are applied.
2. Recommender systems are efficient tools for filtering online information, which is
widespread owing to the changing habits of computer users, personalization trends, and
emerging access to the internet. Even though the recent recommender systems are eminent
in giving precise recommendations, they suffer from various limitations and challenges like
scalability, cold-start, sparsity, etc. Due to the existence of various techniques, the selection
of techniques becomes a complex work while building application-focused recommender
systems. In addition, each technique comes with its own set of features, advantages and
disadvantages which raises even more questions, which should be addressed. This paper
aims to undergo a systematic review on various recent contributions in the domain of
recommender systems, focusing on diverse applications like books, movies, products, etc.
Initially, the various applications of each recommender system are analysed. Then, the
algorithmic analysis on various recommender systems is performed and a taxonomy is
framed that accounts for various components required for developing an effective
recommender system. In addition, the datasets gathered, simulation platform, and
performance metrics focused on each contribution are evaluated and noted. Finally, this
review provides a much-needed overview of the current state of research in this field and
points out the existing gaps and challenges to help posterity in developing an efficient
recommender system.
9. In the past decade, Machine Learning (ML) models have become a critical part of
large scale analytics frameworks to solve different problems, such as identify trends and
patterns in the data, manipulate images, classify text, and produce recommendations. For
the latter (i.e., produce recommendations), ML frameworks have been extended to
incorporate both specific recommendation algorithms (e.g., SlopeOne [1]), but also more
generalised models (e.g., K-Nearest Neighbours (KNN) [2]) that can be applied not only to
recommendation tasks, such as rating prediction or item ranking, but also other classes of
ML problems. This thesis examines an important and popular area of the Recommendation
Systems (RS) design space, focusing on algorithms that are both specifically designed for
producing recommendations, as well as other types of algorithms that are also found in the
wider ML field. However, the latter will be only showcased in RS-based use-cases to allow
comparison with specific RS models. Throughout the past years, there have been increased
interest in RS from both academia and industry, which led to the development of numerous
recommendation algorithms [3]. While there are different families of recommendation
models (e.g., Matrix Factorisation (MF)- based, K-Nearest Neighbours (KNN)-based), they can
be grouped in three classes as follows: Collaborative Filtering (CF), Content-based Filtering
(CBF), and Hybrid Approaches (HA). This thesis investigates the most popular class of RS,
namely Collaborative Filtering-based (CF) recommendation algorithms, which recommend
items to a user based on similar users’ preferences. One of the current challenges in
building CF engines is the selection of the algorithms to be used for producing
recommendations. It is often the case that a one-CFmodel-fits-all solution becomes
unfeasible due to the dynamic relationship between users and items, and the rate at which
new algorithms are proposed in the literature. This challenge is exacerbated by the constant
growth of the input data, which in turn impacts the efficiency of these models, as more
computational resources are required to train the algorithms on large collections to attain a
predefined/desired quality of recommendations. In CF, these challenges have also impacted
the way providers deliver content to the users, as they need to strike a balance between
revenue maximisation (i.e., how many resources are spent for training the CF models) and
the users’ satisfaction (i.e., produce relevant recommendations for the users). In addition, CF
models need to be periodically retrained to capture the latest user preferences and
interactions with the items, and hence, content providers have to decide whether and when
to retrain their CF algorithms, such that the high training times and resource utilisation costs
are kept within the operational and monetary budget. Therefore, the problem of estimating
resource consumption for CF becomes of critical importance. In this thesis, we address the
pressing challenge of predicting the efficiency (i.e., computational resources spent during
training) of traditional and neural CF for a number of popular representatives, including
algorithms based on Matrix Factorisation (MF), KNearest Neighbours (KNN), Co-clustering,
Slope One schemes, as well as well-known types of Deep Learning (DL) architectures, such
as Variational Autoencoder (VAE), Multilayer Perceptron (MLP), and Convolutional Neural
Network (CNN). To this end, we first study the computational complexity of the training
phase of said CF models and derive time and space complexity equations. Then, using
characteristics of the input and the aforementioned equations, we contribute a methodology
for predicting the processing time, memory overhead, and GPU utilisation of the CF’s
training phase. Our contributions further include an adaptive sampling strategy, to address
the trade-off between the computational cost of sampling the dataset and training the CF
models on the said samples and the accuracy of the estimated resource consumption of the
CF trained on a full collection. Furthermore, we provide a framework which quantifies both
the training efficiency (i.e., resource consumption) of CF, as well as the quality of the
recommendations produced by the said CF once it has been trained. Finally, systematic
experimental evaluations demonstrate that our methodology outperforms state-of-the-art
regression schemes (i.e., BB/GBM) by a considerable margin (e.g., for predicting the
processing time of CF, the accuracy of WB/LR is 160% higher than the one of BB/GBM), with
an overhead that is a small fraction (e.g., 3-4 times smaller) of the overall requirements of
CF training.
10. Recommender systems have been an efcient strategy to deal with information
overload by producing personalized predictions. Recommendation systems based on deep
learning have accomplished magnifcent results, but most of these systems are traditional
recommender systems that use a single rating. In this work, we introduce a multi-criteria
collaborative fltering recommender by combining deep neural network and matrix
factorization. Our model consists of two parts: the frst part uses a fused model of deep
neural network and matrix factorization to predict the criteria ratings and the second one
employs a deep neural network to predict the overall rating. The experimental results on
two datasets, including a real-world dataset, show that the proposed model outperformed
several state-of-the-art methods across diferent datasets and performance evaluation
metrics.
13.With the increasing volume of news articles available on the internet, personalized
news recommendations have become increasingly important for users to discover relevant
and interesting news articles. However, traditional recommender systems often fail to
capture the dynamic nature of users' preferences and the changing trends in news articles.
To address this challenge, this paper proposes a context-aware personalized news
recommendation system that incorporates contextual information to enhance the
personalization of news recommendations. The approach involves collecting, extracting,
exploring, cleaning, and processing a large dataset of news articles from 19 distinct internet
news sources, totaling 22,657 English pieces. Four diferent recommender systems were built
using diferent techniques, including content-based methods such as TF-IDF, Bag-of-Words,
and Word2Vec, and a collaborative fltering system based on click behavior. To evaluate the
efectiveness of our models, we used a combination of standard comparison metric, including
precision and recall, and user feedback. To demonstrate the applicability of the model, a
web interface was constructed, and we used RMSE and MAE to evaluate the performance of
the collaborative fltering model. In addition, we conducted a comparative study to compare
the accuracy of diferent algorithms with diferent baseline methods, including random and
recency. The evaluation results showed that incorporating contextual information and
collaborative fltering can signifcantly improve the personalization of news
recommendations. The study suggests that the collaborative fltering model based on click
behavior is the most efective approach, with a mean MAE of 0.0252 and a mean RMSE of
0.0364. The content-based models were also efective approaches for recommending news
articles, outperforming the baseline approaches.
14. In an era where digital information is abundant, the role of recommender systems
in navigating this vast landscape has become increasingly vital. This study proposes a novel
deep learning-based approach integrating multi-context and multi-criteria data within a
unified neural network framework. The model processes these dimensions concurrently,
significantly improving the precision of personalized recommendations. Traditionally, such
systems use a two-dimensional user-item preference matrix based on users’ overall ratings.
Context-aware and multi-criteria recommender systems extend traditional methods with
context awareness and multiple criteria. In contrast to traditional methods, our approach
intricately weaves together multi-context and multi-criteria data within its architecture. This
concurrent processing enables sophisticated interactions between context and criteria,
enhancing recommendation accuracy. While context-aware systems incorporate contextual
information such as time and location when making recommendations, multicriteria-based
approaches offer a spectrum of evaluative criteria, enriching the user experience with more
tailored and relevant suggestions. Although both approaches have advantages in producing
more accurate and personalized referrals, context information and multi-criteria ratings
have not been employed together for producing recommendations. Our research proposes a
novel deep learning-based approach for the multicontext, multi-criteria recommender
system to address this gap. In contrast to traditional approaches that process context-aware
recommender systems and multi-criteria recommender systems separately, our deep
learning model intricately weaves together multi-context and multi-criteria data within its
architecture. This integration is not staged; both dimensions are concurrently processed
through a unified neural network framework. The model facilitates a sophisticated
interaction between context and criteria by embedding these elements into the core of the
network’s multiple layers. This methodology enhances the system’s adaptability and
significantly improves its precision in delivering personalized recommendations, leveraging
the compounded effects of contextual and criteria-specific insights. Experiments on
TripAdvisor and ITMRec multi-context multi-criteria datasets demonstrate that the proposed
method provides more accurate predictions than the state-of-the-art recommendation
techniques. Context-aware multi-criteria ratings offer a promising opportunity to improve
recommendation models.
15. Traditional collaborative filtering based recommender systems deal with the two-
dimensional user-item rating matrix where users have rated a set of items into the system.
Although traditional recommender systems are widely adopted but they are unable to
generate effective recommendations in case of multi-dimensionality i.e. multi-criteria
ratings, contextual information, side information etc. The curse of dimensionality is the
major issue in the recommendation systems. Therefore, in this paper, we proposed a
clustering approach to incorporate multi-criteria ratings into traditional recommender
systems effectively. Furthermore, we compute the intra-cluster user similarities using a
Mahalanobis distance method in order to make more accurate recommendations and
compared the proposed approach with the traditional collaborative filtering based method
using Yahoo! Movies dataset
In recent years, recommender systems (RS) have become essential tools for
filtering overwhelming volumes of information across domains such as e-commerce,
entertainment, and education. These systems aim to deliver personalized
recommendations based on user preferences, but they face challenges like
scalability, cold-start issues, and data sparsity. Traditional collaborative filtering
(CF) methods, while widely adopted, often fall short when handling complex, multi-
dimensional data such as contextual information and multi-criteria ratings. To
address these limitations, research has advanced towards context-aware
recommender systems (CARS) and multi-criteria recommender systems (MCRS),
integrating additional data such as time, location, and user-specific criteria into the
recommendation process.