Volume 8, Issue 6, June – 2023 International Journal of Innovative Science and Research Technology

ISSN No:-2456-2165

Implementation of Data Warehouse Technology in

Academic Data Management
Ubash Yadav1 Hira Lal Bhandari2 Sushil Poudel3
Nepal Open University Nepal Open University Nepal Open University
[email protected] [email protected] [email protected]

Abstract:- In the current time of digital flux of data, international economic, political, and social developments, it
existing techniques of data warehouse cannot handle the must compete with other institutions. Additionally, a number
complexity and analyzing processes of getting meaningful of interest groups anticipate the university to quickly come
information. Extending an existing data warehouse up with answers that are appropriate for their demands.
solution requires the adoption of big data technology. Higher education must assess the large data sources produced
Academic institutions have already with plenty of data, so to overcome this situation in order to make the appropriate
with the day by day incremental academic data in the judgments required to handle these quick changes. The
institutions comes with the need of big data technology. majority of colleges spend a lot of money on information
Academia requires top level management of data so that technology.
the tools are used to extract the information from
records. Those information obtained support in the A. Data warehouse components
decision-making process at the top level management. In With the help of the diagram [3] below, we will learn
this article, we explore how data ware house technology more about the architecture and components of a data
has been implemented to manage academic databases and warehouse:
finds out the best one techniques used for data ware
house. At the end of the paper, we suggest the best
implementation techniques used in the warehouse in this
current time.

Keywords:- Academic Data , Data Warehouse, RTDW, ETL.

I. INTRODUCTION

The term data warehousing refers to the practice of

storing corporate data in a second location, usually remote
from existing production systems. This site will be a place
where you can report requests and make inquiries. This data
is similar to real operational data [1]. A data warehouse is
always a physically separate data store, transformed from
Fig 1 Data Warehouse Architecture
application data in production. The data warehouse is
physically separate from the application data, but both can be
A data warehouse is based on an RDBMS server, a
on the same computer.
central information store surrounded by several key data
warehouse components that make the entire environment
Data warehousing is the process of building and using a functional, manageable, and accessible.
data warehouse. Data warehouses are created by integrating
data from multiple disparate sources to support analytical B. Data Warehouse Models
reporting, structured and ad-hoc queries, and decision-
making. Data warehousing includes data cleansing, data  Enterprise warehouse [4]
integration, and data integration.
An Enterprise Data Warehouse (EDW) is a relational
data warehouse that contains a company's business data,
Data warehouses are optimized for analyzing large including information about its customers. EDW enables data
amounts of data rather than the performance speed of analysis that can provide actionable insights. Like all data
individual transactions. This is the basic approach you can
warehouses, an EDW collects and aggregates data from
use to meet your organization's reporting obligations and
multiple sources and acts as a repository for most or all
query statistical analysis [2]. enterprise data, enabling broad access and analysis.
Academia operates in gradually complex and
 Data Mart [5]
competitive environment. To stay up with national and

IJISRT23JUN1275 www.ijisrt.com 1029

Volume 8, Issue 6, June – 2023 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
A data mart is a subset of a data warehouse focused on a
specific business area, department, or subject area. Data
marts make specific data available to defined groups of users The paper [8] by Leo Willyanto Santoso* and Yulia
so that they can quickly access key insights without wasting have proposed Hadoop as big data analytic tools to be
time searching through your data warehouse, will be For implemented for data ingestion/ staging. This paper has
example, many companies may have data marts that serve proposed the system so as to handle the unstructured data
specific departments within the company, such as finance, which is not possible with traditional data warehouse
sales, and marketing. technology using extract load and transfer (ETL) process.
The system has been improved to handle several data quality
 Virtual warehouse [6] issues such as duplicate data, inconsistent data and garbage
The virtual warehouse is another term for the data data. Hadoop has been implemented to enhance relational
warehouse. A data warehouse is a computer tool designed to database management system (RDBMS) as data ingestion/
simplify decision-making in business management. Collect staging tool as well as for data management and data
and display point-in-time business data to create a snapshot presentation platform.
of the state of your business at that point in time. Virtual
warehouses often collect data from various sources. The paper [1] by A F Neamah also has proposed
Hadoop as big data analytic tools to be implemented for data
C. Statement of the Problem ingestion/ staging. This paper has proposed the system so as
This research explores different hurdles and difficulties to handle the unstructured data which is not possible with
faced during data management using data warehouse traditional data warehouse technology using extract load and
management in the academic institutions on the literature transfer (ETL) process. The system has been improved to
review basis. Data management in the academia is become handle several data quality issues such as duplicate data,
major problems in this current time of digital data flux which inconsistent data and garbage data. Hadoop has been
are associated with academic purpose. This research study implemented to enhance relational database management
has the major focus on why data generated from academic system (RDBMS) as data ingestion/ staging tool as well as
institutions are raising problems in problem in education. for data management and data presentation platform.

 Other problem areas: The research article [9] by Sonia Ordoñez Salinas and
Mistakes in information can prompt detailing issues. Alba Consuelo Nieto Lemus have proposed the model of
The mail may not reach its destination if the address integrating data warehouse and big data techniques to better
information is incorrect. enhance the performance of traditional data warehouse. This
paper also uses the NoSQL database technology to overcome
D. Objectives of the research the lacks of SQL database. We present a revision of the state-
This paper has performed review of different recently of-the-art in integration proposals from the point of view of
published research papers. The paper has explored about data the purpose, methodology, architecture and underlying
ware house and associated technologies for better technology, highlighting the common elements that support
understanding the concept regarding storage techniques with both technologies that may serve as a starting point for full
ware house concept. In this way, this paper has the following integration and we propose a proposal of integration between
research objective: the two technologies.
 To find out techniques used in the data ware house
technology in academic data management. III. METHODOLOGY
 To understand the importance of data ware house
technology in the academic context of academic data The major work of the study is to find out the best
management. techniques in data warehouse to manage academic data.
Literature review is the main method of performing
II. REVIEW OF LITERATURES comparative study to find out the most preferred technique
from recently used data warehouse techniques.
This paper reviews previous research articles,
conference papers and dissertations. This work performs  Data Description
study on the review bases. Previously published research Data used in this research are papers, article, conference
papers and articles are sources of study. We explore, discuss paper and digital mediums such as website and different
and analyze the previous studies so that major techniques survey portals. Sources used to perform the research are
used in data warehousing are traced. This way we find the recently published materials and the survey.
best techniques used in the data warehousing.
The method includes different stages for performing the
Data warehouse technology, most popular deep learning research task that has been presented below [10]:
methods proposed by Bo Zhao1,2 and Yanjin Liu3 in [7] i.e.
HWPCNNs are used to allow optimal outcomes in the
management of physical education quality. The quality is
better enhanced with the comparison to benchmarks and then
redefined for higher levels of precision.

IJISRT23JUN1275 www.ijisrt.com 1030

Volume 8, Issue 6, June – 2023 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165
V. CONCLUSION

After the study of previously performed researches, we

come to the thorough understanding the concept of data
warehouse and its importance in this huge generation of
academic data in several forms like structured, unstructured
and semi-structured data. Data warehousing is the most
important in decision making process so as to direct the
institution on right track for future advancement. Majorly, we
have found out different four techniques used in data
warehousing to management academic data. They are:
 Deep learning methods HWPCNNs
 Big data tool i.e. Hadoop
 Integration of data warehouse and big data techniques

This way, we come to the conclusion that traditional

data warehousing techniques are insufficient in handling real
time data and as well as heterogeneous forms of data
generated in academic institutions to better achieve the
efficacy in managing those data.

REFERENCES

Fig 1 Data Warehouse Architecture [1]. A. F. Neamah, “Adoption of Data Warehouse in

University Management: Wasit University Case Study,”
The paper basically contains five stages to perform the J. Phys. Conf. Ser., vol. 1860, no. 1, 2021, doi:
research task. Firstly introduction section briefly talks about 10.1088/1742-6596/1860/1/012027.
data warehouse, its importance and pinpoints the problems [2]. J. Kembro and A. Norrman, “The transformation from
indicated in the different studies. In the Review of literature manual to smart warehousing: an exploratory study with
section, we present the reviews of relevant papers so as to Swedish retailers,” Int. J. Logist. Manag., vol. 33, no. 5,
enhance the differences between the techniques used in the pp. 107–135, 2022, doi: 10.1108/IJLM-11-2021-0525.
data warehouse technology. In the abstract, we present the [3]. “Data Warehouse Architecture, Components &
summary form of the article and focus the task performed. Diagram Concepts.” https://www.guru99.com/data-
And the major section of the article is methodology which warehouse-architecture.html (accessed Jun. 15, 2023).
talks about how research has been performed to find out the [4]. “What is an Enterprise Data Warehouse (EDW)? |
facts and get the result of the work. Snowflake.” https://www.snowflake.com/guides/what-
enterprise-data-warehouse (accessed Jun. 15, 2023).
IV. DISCUSSION [5]. “What is a Data Mart | IBM.”
https://www.ibm.com/topics/data-mart (accessed Jun.
Data warehousing can play the vital role in making 15, 2023).
decision in every institutions. The data generated day by day [6]. “What Is a Virtual Warehouse? | Techwalla.”
is very complex so it requires better improvement and https://www.techwalla.com/articles/what-is-a-virtual-
assessment of technology in managing several forms of data warehouse (accessed Jun. 15, 2023).
in the form of structured, semi-structure and unstructured. [7]. B. Zhao and Y. Liu, “Application of Data Warehouse
Here, in this research we have performed the review of Technology Based on Neural Network in Physical
literatures to find out recently used techniques in proper data Education Quality Management,” Math. Probl. Eng.,
management in the academia. The importance of exploration vol. 2022, 2022, doi: 10.1155/2022/4456885.
and analysis of data has significantly raised the importance in [8]. L. W. Santoso and Yulia, “Data Warehouse with Big
decision making process for the institutions. Data Technology for Higher Education,” Procedia
Comput. Sci., vol. 124, pp. 93–99, 2017, doi:
The process of decision making is being so much 10.1016/j.procs.2017.12.134.
complicated in context of huge production of data day by [9]. F. Engineering, “D w b d,” vol. 9, no. 2, pp. 1–17, 2017,
day. This has been the very complicated because of its doi: 10.5121/ijcsit.2017.9201.
[10]. “How to Write a Scientific Review Article - Enago
Academy.” https://www.enago.com/academy/how-to-
write-a-scientific-review-article/ (accessed Jun. 14,
2023).

IJISRT23JUN1275 www.ijisrt.com 1031