An Efficient Classification of MRI Brain Images
An Efficient Classification of MRI Brain Images
March 3, 2021.
Digital Object Identifier 10.1109/ACCESS.2021.3061487
Corresponding authors: Muhammad Assam ([email protected]), Hira Kanwal ([email protected]), Arif Mehmood
([email protected]), and Gyu Sang Choi ([email protected])
This work was supported in part by the Basic Science Research Program through the National Research Foundation of Korea (NRF)
funded by the Ministry of Education under Grant NRF-2019R1A2C1006159, and in part by the Ministry of Science and ICT (MSIT),
South Korea, under the Information Technology Research Center (ITRC) support program, supervised by the Institute for Information and
Communications Technology Promotion (IITP), under Grant IITP-2020-2016-0-00313.
ABSTRACT The unprecedented improvements in computing capabilities and the introduction of advanced
techniques for the analysis, interpretation, processing, and visualization of images have greatly diversified
the domain of medical sciences and resulted in the field of medical imaging. The Magnetic Resonance
Imaging (MRI), an advanced imaging technique, is capable of producing high quality images of the human
body including the brain for diagnosis purposes. This paper proposes a simple but efficient solution for the
classification of MRI brain images into normal, and abnormal images containing disorders and injuries.
It uses images with brain tumor, acute stroke and alzheimer, besides normal images, from the public dataset
developed by harvard medical school, for evaluation purposes. The proposed model is a four step process,
in which the steps are named: 1). Pre-processing, 2). Features Extraction, 3). Features Reduction, and 4).
Classification. Median filter, being one of the best algorithms, is used for the removal of noise such as salt
and pepper, and unwanted components such as scalp and skull, in the pre-processing step. During this stage,
the images are converted from gray scale to colored images for further processing. In second step, it uses
Discrete Wavelet Transform (DWT) technique to extract different features from the images. In third stage,
Color Moments (CMs) are used to reduce the number of features and get an optimal set of characteristics.
Images with the optimal set of features are passed to different classifiers for the classification of images.
The Feed Forward - ANN (FF-ANN), an individual classifier, which was given a 65% to 35% split ratio for
training and testing, and hybrid classifiers called: Random Subspace with Random Forest (RSwithRF) and
Random Subspace with Bayesian Network (RSwithBN), which used 10-Fold cross validation technique,
resulted in 95.83%, 97.14% and 95.71% accurate classification, in corresponding order. These promising
results show that the proposed method is robust and efficient, in comparison with, existing classification
methods in terms of accuracy with smaller number of optimal features.
INDEX TERMS Color moments (CMs), feed forward artificial neural network (FF-ANN), random subspace,
random forest, bays.net, principle component analysis (PCA), discrete wavelet transforms (DWT).
This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see https://creativecommons.org/licenses/by/4.0/
VOLUME 9, 2021 33313
M. Assam et al.: Efficient Classification of MRI Brain Images
are: preprocessing, features extraction, features reduction and HG and LG GBMs. The average accuracy achieved, for this
classification of brain MRI images [1], [5]. The preprocessing work, was 90%. In short, the results produced using both
is the simplest phase among all phases of the classification techniques were good but in term of accuracy, the perfor-
model. In preprocessing stage, a noise removal algorithm is mance of supervised techniques was better than unsupervised
used for the removal of salt-and-pepper noise, and unwanted techniques.
components such as scalp and skull from the images. Due to This research work proposes quite a useful technique to
the removal of noise from images, their quality is improved. automate the time-consuming manual procedure of physi-
In this stage, the images are also converted from gray scale to cians, and provides a clear and effective methodology for the
color (RGB) images and, thus, the utilisation of rich informa- classification of MRI images into sound images and abnormal
tion in colored images increase classification accuracy. For images containing disturbances and injuries. The proposed
the removal of noise from images, a number of algorithms technique is using a four step process, in which, an image
are used [6], in which the median filter has performed better passes through four stages termed as: Preprocessing, Features
for the removal of salt and pepper noise from images. It is Extraction, Features Reduction and Classification. Median
also better because of not distressing the edges of images [7]. filter is used in preprocessing stage for the removal of noise
Feature extraction stage, which is followed by the pre- such as salt-and-pepper, and unwanted components such as
processing, is not only important but also a difficult task scalp and skull. These images are, then, converted from gray
[8], [9], in which the format of an image is changed to a scale to color (RGB) images for further processing. Discrete
set of features. Images contain a lot of features but most of Wavelet Transform (DWT) is applied for features extraction
them are redundant, which are not useful for classification. in second stage. Color Moments (CMs) are used to reduce and
The most monotonous task is the selection of an optimal set select the optimal set of features. These optimal features are
of features. A number of techniques are available to extract sent to FF-ANN using percentage split and hybrid classifiers
features from images, in which Discrete Wavelet Transform named: Random Subspace with Random Forest (RSwithRF)
(DWT) [1], [10]–[12], Principle Component Analysis (PCA), and Random Subspace with Bayesian Network (RSwithBN)
Independent Component Analysis (ICA), gabor features, and using 10-Fold cross validation for recognizing sound brains
minimum noise fraction transform [13]–[16] are the most and brains with distinctive sicknesses.
widely used. When features are extracted, irrelevant features The existing methods use a large set of parameters for
need to be reduced as they increase compilation time and classification purposes, which greatly increase their complex-
memory usage. In this stage, those features are selected that ity in terms of space and time. The current studies, espe-
are optimal and useful. Several algorithms such as Genetic cially those using hybrid classifiers, are carried out using T1
Algorithm (GA) [17], PCA [1], [18], [19], ICA [20] and weighted images. The basic aim of the this research is to
Linear Discriminant Analysis (LDA) [21] are used for dimen- develop a fast and efficient method that determines and uses
sionality reduction. This reduced set of features is used in the a small set of optimal parameters. This work has used hybrid
last stage for classification. There are two broad categories classifiers for an improved accuracy. Furthermore, this work
for the classification of MRI Brain images called: supervised is based on T2 weighted images. The main contribution of
and unsupervised techniques. Supervised techniques include this work is as follows:
K Nearest Neighbors (KNN) and Support Vector Machine
(SVM) [11], [18], [22], [23] while unsupervised techniques 1) classification of images with an accuracy almost the
include Fuzzy C mean, and s-means [3], [23]. same or even slightly better than other classifiers and
Gupta et al. [24] suggested in their research work, a non- that too with a set of only nine parameters.
invasive system for the detection of brain glioma. The tex- 2) reduction the complexity of the proposed method com-
ture and morphological features with ensemble learning were pared with other techniques as it processes each image
used for detection purpose. Promising results were achieved against a limited set of features.
which are 97.37% on JMCD and 98.38% on BraTS. Arasi et
al. [25] proposed a clinical support system for improving the
accuracy of detection and classification of brain tumor from II. RELATED WORK
the BraTS dataset using images. The GLCM extraction tech- Zhang et al. in [1] proposed a new method for the classifica-
nique was used for collecting features of tumor region and tion of T2-weighted brain MRI images that consists of three
LOBSVM was used for classification purpose. It achieved an stages. In the first stage (feature extraction), it extracts 1024
average accuracy of 97.69%. Ullah et al. [26] proposed an features from each image by using DWT. These features are
enhanced technique for classification of brain MRI images reduced to 19 features, in stage 2 using PCA. The reduced
into normal and abnormal images using color features and set of 19 features is, then, feed to an ANN classifier in
Artificial Neural Network (ANN). It achieved an accuracy third stage, for the classification. It achieved good results in
of 100% and 90% during training and testing phases, corre- terms of accuracy. Rajini et al. in [23] proposed an auto-
spondingly. Jeyong et al. [27] used machine learning method mated approach to classify brain MRI images into normal
on DSC-MR images which are based on delta-radiomic fea- and abnormal images, in a two stage process. The first stage
tures. The proposed algorithm was used for classification of extracts features using DWT, which are, then, reduced to an
B. FEATURES EXTRACTION
To achieve higher level of accuracy in the classification stage,
it is essential to select an optimal set of features in the feature
extraction stage. DWT is one the most powerful mathematical
tool, which uses dyadic scales and positions, and it imple-
ments wavelet transform [22], [28]. To extract features from
MRI brain images, DWT technique is used, in this work.
DWT not only offers knowledge about time but also the
frequency domain. Basic introduction of DWT is presented
next.
Let suppose the square-integral function will be x(t) the
wavelet transform which is continuous of x(t) relative to the
given wavelet 9c,d (t) is defined in Equation. 1.
R∞
W 9(c,d) = −∞ x(t) × 9c,d (t) dx (1)
where,
√
9c,d (t) = 1/ c9(t − c/d) (2)
M1,1 = 1/N N
P
j=1 Ij (5)
√ PN 2
M1,2 = 2 j=1 (tj - M1,1 ) (6)
FIGURE 4. Diagram of DWT in 2D.
PN 3
M1,3 = 1/N j=1 (Ij - M1,1 ) (7)
PN
M2,1 = 1/N j=1 Ij (8)
√ PN 2
M2,2 = 2 j=1 (tj - M2,1 ) (9)
PN
M2,3 = 1/N j=1 (Ij - M2,1 )3 (10)
PN
M3,1 = 1/N j=1 Ij (11)
√ PN 2
M3,2 = 2 j=1 (tj - M3,1 ) (12)
PN 3
M3,3 = 1/N j=1 (Ij - M3,1 ) (13)
terminologies such as assignment operator and functions such TABLE 1. Details of MRI images.
as Median_Filter (K) and RGB(), where the former apply
median filter on images while the latter convert an MRI brain
image from gray scale to a colored (RGB) image. The proce-
dures Decomposed_3L () and Approx_3L() use haar wavelet
for the decomposition and approximation of images to three
(3) levels, respectively. Channel (1), Channel (2), Channel (3)
subroutines are used to extract the Red, Green, Blue channels
of the converted color (RGB) images. The procedures named:
Mean_Image (), Stand_Dev_Image (), and Skewness_Image
() are used to compute the Mean, Standard Deviation and
Skewness of the colored images.
execution time at minimum. It would be interesting to com- [16] A. Korai and M. A. Unar, ‘‘Classification of MRI Images Using Neural
pare the results of the proposed technique with the methods Network,’’ Quaid-E-Awam Univ. Res. J. Eng., Sci. Technol., Nawabshah,
vol. 18, no. 1, pp. 66–71, 2020.
based on deep learning. It would be further interesting to [17] A. Ortiz, J. M. Górriz, J. Ramírez, D. Salas-González, and
check the impact of statistical features other than those used J. M. Llamas-Elvira, ‘‘Two fully-unsupervised methods for MR brain
in this work. image segmentation using SOM-based strategies,’’ Appl. Soft Comput.,
vol. 13, no. 5, pp. 2668–2682, May 2013.
[18] Y. Zhang and L. Wu, ‘‘An MR brain images classifier via principal com-
ACKNOWLEDGMENT ponent analysis and kernel support vector machine,’’ Prog. Electromagn.
Res., vol. 130, pp. 369–388, 2012.
This work was supported in part by the Basic Science [19] E.-S.-A. El-Dahshan, T. Hosny, and A.-B.-M. Salem, ‘‘Hybrid intelligent
Research Program through the National Research Founda- techniques for MRI brain images classification,’’ Digit. Signal Process.,
tion of Korea (NRF) funded by the Ministry of Education vol. 20, no. 2, pp. 433–441, Mar. 2010.
[20] A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis,
under Grant NRF-2019R1A2C1006159, and in part by the vol. 62, no. 3. Hoboken, NJ, USA: Wiley, 2010, pp. 412–416.
Ministry of Science and ICT (MSIT), South Korea, under [21] M. Li and B. Yuan, ‘‘2D-LDA: A statistical linear discriminant analysis
the Information Technology Research Center (ITRC) support for image matrix,’’ Pattern Recognit. Lett., vol. 26, no. 5, pp. 527–532,
Apr. 2005.
program, supervised by the Institute for Information and [22] W. H. Ibrahim, A. A. A. Osman, and Y. I. Mohamed, ‘‘MRI brain image
Communications Technology Promotion (IITP), under Grant classification using neural networks,’’ in Proc. Int. Conf. Comput., Electr.
IITP-2020-2016-0-00313. Electron. Eng. (ICCEEE), Aug. 2013, pp. 253–258.
[23] N. H. Rajini and R. Bhavani, ‘‘Classification of MRI brain images using k-
nearest neighbor and artificial neural network,’’ in Proc. Int. Conf. Recent
REFERENCES Trends Inf. Technol. (ICRTIT), Jun. 2011, pp. 563–568.
[24] N. Gupta, P. Bhatele, and P. Khanna, ‘‘Glioma detection on brain
[1] Y. Zhang, Z. Dong, L. Wu, and S. Wang, ‘‘A hybrid method for MRI brain
MRIs using texture and morphological features with ensemble learning,’’
image classification,’’ Expert Syst. Appl., vol. 38, no. 8, pp. 10049–10053,
Biomed. Signal Process. Control, vol. 47, pp. 115–125, Jan. 2019.
Aug. 2011.
[25] P. R. E. Arasi and M. Suganthi, ‘‘A clinical support system for brain tumor
[2] Y. Zhang, Z. Dong, A. Liu, S. Wang, G. Ji, Z. Zhang, and J. Yang, classification using soft computing techniques,’’ J. Med. Syst., vol. 43,
‘‘Magnetic resonance brain image classification via stationary wavelet no. 5, p. 144, May 2019.
transform and generalized eigenvalue proximal support vector machine,’’ [26] Z. Ullah, S. H. Lee, and M. Fayaz, ‘‘Enhanced feature extraction tech-
J. Med. Imag. Health Informat., vol. 5, no. 7, pp. 1395–1403, Dec. 2015. nique for brain MRI classification based on Haar wavelet and statistical
[3] M. Maitra and A. Chatterjee, ‘‘A slantlet transform based intelligent sys- moments,’’ Int. J. Adv. Appl. Sci., vol. 6, no. 7, pp. 89–98, Jul. 2019.
tem for magnetic resonance brain image classification,’’ Biomed. Signal [27] J. Jeong, L. Wang, B. Ji, Y. Lei, A. Ali, T. Liu, W. J. Curran, H. Mao,
Process. Control, vol. 1, no. 4, pp. 299–306, Oct. 2006. and X. Yang, ‘‘Machine-learning based classification of glioblastoma
[4] L. M. Fletcher-Heath, L. O. Hall, D. B. Goldgof, and F. R. Murtagh, ‘‘Auto- using delta-radiomic features derived from dynamic susceptibility contrast
matic segmentation of non-enhancing brain tumors in magnetic resonance enhanced magnetic resonance images: Introduction,’’ Quant. Imag. Med.
images,’’ Artif. Intell. Med., vol. 21, nos. 1–3, pp. 43–63, Jan. 2001. Surg., vol. 9, no. 7, p. 1201, 2019.
[5] E.-S.-A. El-Dahshan, H. M. Mohsen, K. Revett, and A.-B.-M. Salem, [28] M. F. B. Othman, N. B. Abdullah, and N. F. B. Kamal, ‘‘MRI brain classi-
‘‘Computer-aided diagnosis of human brain tumor through MRI: A survey fication using support vector machine,’’ in Proc. 4th Int. Conf. Modeling,
and a new algorithm,’’ Expert Syst. Appl., vol. 41, no. 11, pp. 5526–5545, Simulation Appl. Optim., Apr. 2011, pp. 1–4.
Sep. 2014. [29] M. Saritha, K. Paul Joseph, and A. T. Mathew, ‘‘Classification of MRI
[6] R. C. Gonzalez and R. E. Woods, Digital Image Processing. Upper Saddle brain images using combined wavelet entropy based spider Web plots
River, NJ, USA: Prentice-Hall, 2002. and probabilistic neural network,’’ Pattern Recognit. Lett., vol. 34, no. 16,
[7] B. Shinde, D. Mhaske, and A. Dani, ‘‘Study of noise detection and noise pp. 2151–2156, Dec. 2013.
removal techniques in medical images,’’ Int. J. Image, Graph. Signal [30] S. Lahmiri and M. Boukadoum, ‘‘Brain MRI classification using an ensem-
Process., vol. 4, no. 2, p. 51, 2012. ble system and LH and HL wavelet sub-bands features,’’ in Proc. IEEE 3rd
[8] H. D. Cheng, J. Shan, W. Ju, Y. Guo, and L. Zhang, ‘‘Automated breast Int. Workshop Comput. Intell. Med. Imag., Apr. 2011, pp. 1–7.
cancer detection and classification using ultrasound images: A survey,’’ [31] H. B. Nandpuru, S. S. Salankar, and V. R. Bora, ‘‘MRI brain cancer
Pattern Recognit., vol. 43, no. 1, pp. 299–317, Jan. 2010. classification using support vector machine,’’ in Proc. IEEE Students’
[9] M. A. Hamid and N. A. Khan, ‘‘Investigation and classification of MRI Conf. Electr., Electron. Comput. Sci., Mar. 2014, pp. 1–6.
brain tumors using feature extraction technique,’’ J. Med. Biol. Eng., [32] H. Kalbkhani, A. Salimi, and M. G. Shayesteh, ‘‘Classification of brain
vol. 40, pp. 307–317, Mar. 2020. MRI using multi-cluster feature selection and KNN classifier,’’ in Proc.
23rd Iranian Conf. Electr. Eng., May 2015, pp. 93–98.
[10] C. Arizmendi, A. Vellido, and E. Romero, ‘‘Classification of human brain
[33] F. Wahid, R. Ghazali, M. Fayaz, and A. S. Shah, ‘‘Using probabilistic
tumours from MRS data using discrete wavelet transform and Bayesian
classification technique and statistical features for brain magnetic reso-
neural networks,’’ Expert Syst. Appl., vol. 39, no. 5, pp. 5223–5232,
nance imaging (MRI) classification: An application of AI technique in bio-
Apr. 2012.
science,’’ Int. J. Bio-Sci. Bio-Technol., vol. 8, no. 6, pp. 93–106, Dec. 2017.
[11] S. Chaplot, L. M. Patnaik, and N. R. Jagannathan, ‘‘Classification of [34] A. K. Johnson and J. A. Becker. (2020). The Whole Brain Atlas
magnetic resonance brain images using wavelets as input to support vector (Harvard Medical School). Accessed: Nov. 2020. [Online]. Available:
machine and neural network,’’ Biomed. Signal Process. Control, vol. 1, http://www.med.harvard.edu/AANLIB/home.html
no. 1, pp. 86–92, Jan. 2006.
[35] M. Maitra and A. Chatterjee, ‘‘Hybrid multiresolution slantlet transform
[12] P. Hiremath, S. Shivashankar, and J. Pujari, ‘‘Wavelet based features for and fuzzy c-means clustering approach for normal-pathological brain
color texture classification with application to CBIR,’’ Int. J. Comput. Sci. MR image segregation,’’ Med. Eng. Phys., vol. 30, no. 5, pp. 615–623,
Netw. Secur., vol. 6, no. 9A, pp. 124–133, 2006. Jun. 2008.
[13] M. H. Fazel Zarandi, M. Zarinbal, and M. Izadi, ‘‘Systematic image [36] A. Toprak and İ. Güler, ‘‘Suppression of impulse noise in medical images
processing for diagnosing brain tumors: A type-II fuzzy expert system with the use of fuzzy adaptive median filter,’’ J. Med. Syst., vol. 30, no. 6,
approach,’’ Appl. Soft Comput., vol. 11, no. 1, pp. 285–294, Jan. 2011. pp. 465–471, Nov. 2006.
[14] M. M. Badža and M. Č. Barjaktarović, ‘‘Classification of brain tumors from [37] T. G. Dietterich, ‘‘Ensemble methods in machine learning,’’ in Proc.
MRI images using a convolutional neural network,’’ Appl. Sci., vol. 10, Int. Workshop Multiple Classifier Syst. Berlin, Germany: Springer, 2000,
no. 6, p. 1999, Mar. 2020. pp. 1–15.
[15] A.-I. Barranco-Gutiérrez, ‘‘Machine learning for brain images classifi- [38] I. Barandiaran, ‘‘The random subspace method for constructing decision
cation of two language speakers,’’ Comput. Intell. Neurosci., vol. 2020, forests,’’ IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 8, pp. 1–22,
pp. 1–7, Jun. 2020. Aug. 1998.
[39] H. Wang and B. Fei, ‘‘A modified fuzzy C-means classification method SAID KHALID SHAH received the Ph.D. degree
using a multiscale diffusion filtering scheme,’’ Med. Image Anal., vol. 13, from the University of East Anglia, U.K. In 2004,
no. 2, pp. 193–202, Apr. 2009. he joined the University of Science and Technol-
ogy, Bannu, Pakistan, as a Lecturer, and promoted
as an Assistant Professor, in 2012. His research
MUHAMMAD ASSAM received the B.Sc. degree interest includes medical image processing and
in computer software engineering from the Uni- analysis, such as segmentation, visualization, and
versity of Engineering and Technology Peshawar, registration.
Pakistan, in 2011, and the M.Sc. degree in software
engineering from the University of Engineering
and Technology, Taxila, Pakistan, in 2018. He is
currently pursuing the Ph.D. degree in computer
science and technology with Zhejiang University,
China. Since November 2011, he has been working
as a Lecturer (on study leave) with the Department ARIF MEHMOOD received the Ph.D. degree
of Software Engineering, University of Science and Technology, Bannu, from the Department of Information and Com-
Pakistan. His research interests include brain machine interface, medical munication Engineering, Yeungnam University,
image processing, machine/deep learning, the Internet of Things(IoT), and South Korea, in November 2017. Since Novem-
computer vision. ber 2017, he has been working as an Assistant
Professor with the Department of Computer Sci-
ence and Information Technology, IUB, Pakistan.
HIRA KANWAL received the master’s degree in His recent research interest includes data min-
computer software engineering from the National ing, mainly working on AI and deep learning
University of Science and Technology, Pakistan. based text mining and data science management
She is currently working as an Associate Lecturer technologies.
with The Islamia University of Bahawalpur. Her
recent research interests include machine learn-
ing, recommender systems, data science, and data
mining.