Using Skeleton Model To Recognize Human Gait Gender
Using Skeleton Model To Recognize Human Gait Gender
Using Skeleton Model To Recognize Human Gait Gender
Corresponding Author:
Omar Ibrahim Alsaif
Department of Computer Systems Technologies, Northern Technical University
Mosul, Iraq
Email: Omar.Ibrahim [email protected]
1. INTRODUCTION
Now, growing interest in identifying individuals effective to prevent terrorist attacks led to proposed
biometrics techniques. These techniques have appeared to identify and verify individuals such that concern:
face, palm print, fingerprint, iris, deoxyribo nucleic acid (DNA), walking, or a mixture of these characteristics
[1], [2]. It is worth mentioning, people can be classified using most biometrics, like gender classification by
analysing voice, face, and gait [3]–[7]. Generally, gender classification plays an important and big role in many
fields of life. Gait recognition is defined as an ability that existing for most people. When a computer can
recognize gender, it will increase work robustness, such as, gender classification which can analyses clients for
administrators, employ people with proper works, and so on [4]. Unlike current recognition methods, like
facial, iris, and fingerprint recognition are physical information that requires characteristics or traits for people,
therefore there challenging to distinguish individuals use remote methods. Nevertheless, walking as a feature
of people does not have these limitations. In recent times, gait is a good biometric feature. As many researchers
have increasingly interested in this topic. So, walking has become a serious issue in advanced computer
technologies [8]–[10]. Additionally, gait classifications have many effective parameters such as age,
pregnancy, and sick. Human gender gait recognition has become an important topic for researchers [11], [12].
In 2001 Tanawongsuwan and Bobick studied learning to walk via the bottom parts of the human body [13].
Some researchers provided a clear process for estimating the place of compensation in flat form between signs.
The given displacements that researchers used to calculate common angle pathways aimed at compensating for
systematic time differences. This study recognition was applied in databases of 18 people who performed
further than 150 places of walking by the adjacent neighbor procedure and Euclidean space as assessment
procedures [13]. In 2009 Ming et al. discussed the descriptor-based silhouette and explained the area of the
border was suggested in a way that describes the shape of the walk [14]. The wavelet transformation was
applied on the boundary area and extracted the parallel descriptors concurrently. Xiao et al. [15], proposed a
strategy in 2010 based on the use of skeletons to determine walking. This skeletal structure allows us to express
every gait. Consequently, a recognition rate of 96.21% was reached. In the same year, Li and Yang, [16]
introduced a recognition system based on the legs and ankles. These two types of optimal characteristics were
addressed by using the feature incorporation strategies, where the test outputs in the gait database were showed
reasonable results [16]. In April 2013 Arai and Andrie described a method for extract features from the skeleton
human body using support vector machine (SVM) that estimates average foot angle, where reached
classification accuracy is about 85.33% [5]. In 2020, suggested analysis in the time domain of many features
using classifier [17], [18].
2. PROPOSED METHODOLOGY
Basically, this paper has proposed a method for gender classification based on the skeleton model. It
depends on trusty Chinese Academy of Sciences (CASIA) database gait, class C, with kinds of walking views
of images and many changes for silhouette pictures [19]. Figure 1 explain the framework of the proposed
method that used in this paper.
In the proposed method skeleton model have been used on reliable silhouette image CASIA database that
depends on the following steps:
a. Applied several morphological operations.
b. Create three lines to get a triangle.
c. Determine gait cycle.
d. Distinguished between two legs.
e. Estimated points between two legs of the body.
2.1. Pre-processing
The proposed human gait model is a specific feature of the proposed model using many operations.
At first, silhouette images have been converted to a binary image. Then applied morphological operations for
the creation of a skeleton. By using close operation (dilation, erosion), and removes (prunes) all branches
shorter that specified length [20].
Using skeleton model to recognize human gait gender (Omar Ibrahim Alsaif)
976 ISSN: 2252-8938
⃑⃑
𝑎⃑⃑.𝑏
cos(θ)= |𝑎|.|𝑏| (2)
⃑⃑
𝑎⃑⃑.𝑏
θ = cos −1 (|𝑎|.|𝑏|) (3)
principal component analysis (PCA's) purpose is to minimize the data's dimensionality while keeping as feasible
in the original huge data. It's a technique for discovering patterns in data and explaining them in a way that
emphasizes their resemblances and differences in fact, PCA is extremely closely related to means Figure 5.
Φi = xi-x̅ (5)
A confusion matrix can be used to evaluate models for binary (male and female) classification in
overall. In the confusion matrix, the percentage value of accuracy, sensitivity, specificity, and precision must
be considered. With true positive (TP), true negative (TN), false positive (FP), and false negative (FN), the
calculation in the confusion matrix is (8)-(10).
TP+TN
Accuracy = (8)
TP+FP+TN+FN
TP
Precision = (9)
TP+FP
TP
Sensitivity = (10)
FN+TP
Using skeleton model to recognize human gait gender (Omar Ibrahim Alsaif)
978 ISSN: 2252-8938
where:
PDF is probability density function
V is input feature vectors,
𝜇 is mean of features.
𝜎 is the standard deviation.
Figure 7. The histogram comparison between two classifier and all measures
The recognition for human gender has used two techniques neural network (NN, and Gaussian Bayes). The
analysis of classify gender into one of two groups (male, female). It has reached amazing result in NN Table 1
for the measures.
Figure 8. Represent CASIA Class C images all movement (a) Normal walking, (b) slow walking, (c) fast
walking and (d) walk with carried bag
(a) (b) =
(c) (d)
Figure 10. Neural network confusion matrix for gender classification; (a) training confusion matrix, (b)
validation confusion matrix, (c) test confusion matrix, and (d) explain a good summery for confusion matrix
Using skeleton model to recognize human gait gender (Omar Ibrahim Alsaif)
980 ISSN: 2252-8938
This classifier has been evaluated by using the confusion matrix according to Figures 11 and 12, were
the percentage of accuracy being (75%). Rock curve (ROC) as shown, depicting the performance of a
classification model. Table 2 involve of a 2×2 Confusion Matrix combinations of expected and real values. It
is usefully and importantly to use the ratios: Precision, sensitivity, specificity and accuracy.
True positive rate (TPR),
𝛴 𝑇𝑟𝑢𝑒 𝑝𝑜𝑠𝑖𝑡𝑖𝑣𝑒 𝑇𝑃
= = (12)
𝛴 𝐶𝑜𝑛𝑑𝑖𝑡𝑖𝑜𝑛 𝑃𝑜𝑠𝑖𝑡𝑖𝑣𝑒 𝑇𝑃+𝐹𝑁
Table 2. The four results can be found in 2×2 confusion matrix [36]–[43]
Total population Predicted condition positive Predicted condition negative
True
Condition positive True positive TP False positive FP (Type I error)
Condition
Condition negative False negative FN (Type II error) True negative TN
The confusion matrix as Figure 12 and Roc. curve as shown in a graph depicting the performance of
a classification model is Figure 13 which indicates the performance measurement for Gaussian Naive Bayes
confusion matrix. Table 2 involves a 2×2 confusion matrix combination of expected and real values. It is useful
and important to use the ratios: precision, sensitivity, specificity, and accuracy.
The rock of curve (ROC) is designed with TPR as y-axis against the FPR and x-axis represent
threshold value, according to (12) and (13). ROC explains the capacity of presentation for grouping difficulties
at several thresholds (1,0) is represented (male, female) respectively as mentioned before. Figure 13 is the
optimal case, at a point when two arches don't intersect, the model has an ideal of distinguishable. It is quite
capable of recognizing positive and negative classes. Figure 14 shows the overlapping between the two classes,
it presents mistakes. At the point when the area under the curve (AUC) is 0.7, it implies that there is a 70%
possibility that the model will be isolated between positive and negative classes. Figure 15 shows the most
extremely terrible states, at the point when AUC reach to 0.5, so the model has no ability to separate between
positive and negative classes.
4. CONCLUSION
Gender classification based on the gait features are very important subject. The proposed method
satisfies a proficient result under the effects of many conditions such as carrying bag, slow gait, fast gait, and
normal gait. By applying a few morphological operations and skeletons in 20 videos that opened as frames in
each one, the reliable database CASIA class C have been got angles between two legs. The gaits for each video
have been discreated to seventy-five frames for each 20-person (10 male and 10 female) that have values of
(1,0) respectively, so the result will be 1500 frame, and applying PCA on these angles, it is given ideal linear
dimensionality reduction. Successful two classifier gaussian bayes, ANN is accuracies 75%, 95.5% were
achieved respectively. The latest results in ANN for gender classification in human gait is more remarkable
and superior. ANN have a very good result more than gaussian bayes by an amount of (20%).
REFERENCES
[1] D. Xu, S. Yan, D. Tao, S. Lin, and H.-J. Zhang, “Marginal fisher analysis and its variants for human gait recognition and content-
based image retrieval,” IEEE Transactions on Image Processing, vol. 16, no. 11, pp. 2811–2821, Nov. 2007,
Using skeleton model to recognize human gait gender (Omar Ibrahim Alsaif)
982 ISSN: 2252-8938
doi: 10.1109/TIP.2007.906769.
[2] S. Handri, S. Nomura, and K. Nakamura, “Determination of age and gender based on features of human motion using adaboost
algorithms,” International Journal of Social Robotics, vol. 3, no. 3, pp. 233–241, Aug. 2011, doi: 10.1007/s12369-010-0089-0.
[3] M. Piccardi, “Background subtraction techniques: a review,” in 2004 IEEE International Conference on Systems, Man and
Cybernetics (IEEE Cat. No.04CH37583), 2004, vol. 4, pp. 3099–3104, doi: 10.1109/ICSMC.2004.1400815.
[4] S. Yu, T. Tan, K. Huang, K. Jia, and X. Wu, “A study on gait-based gender classification,” IEEE Transactions on Image Processing,
vol. 18, no. 8, pp. 1905–1910, Aug. 2009, doi: 10.1109/TIP.2009.2020535.
[5] K. Arai and R. Andrie, “Gender classification with human gait based on skeleton model,” in 2013 10th International Conference
on Information Technology: New Generations, Apr. 2013, pp. 113–118, doi: 10.1109/ITNG.2013.134.
[6] H. Harb and L. Chen, “Gender identification using a general audio classifier,” in 2003 International Conference on Multimedia and
Expo. ICME ’03. Proceedings (Cat. No.03TH8698), 2003, pp. II----733, doi: 10.1109/ICME.2003.1221721.
[7] L. Lam, S.-W. Lee, and C. Y. Suen, “Thinning methodologies-a comprehensive survey,” IEEE Transactions on Pattern Analysis
and Machine Intelligence, vol. 14, no. 9, pp. 869–885, 1992, doi: 10.1109/34.161346.
[8] M. D. J. Nordin and A. Saadoon, “A survey of gait recognition based on skeleton model for human identification,” Research Journal
of Applied Sciences, Engineering and Technology, vol. 12, no. 7, pp. 756–763, Apr. 2016, doi: 10.19026/rjaset.12.2751.
[9] M. S. Nixon and J. N. Carter, “Automatic recognition by gait,” Proceedings of the IEEE, vol. 94, no. 11, pp. 2013–2024, Nov. 2006,
doi: 10.1109/JPROC.2006.886018.
[10] A. H. Maray, S. Q. Hasan, and N. L. Mohammed, “Design and implementation of low-cost vein-viewer detection using near infrared
imaging,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 29, no. 2, pp. 1039–1046, 2022,
doi: 10.11591/ijeecs.v29.i2.pp1039-1046.
[11] Z. Yang, M. Li, and H. Ai, “An experimental study on automatic face gender classification,” in 18th International Conference on
Pattern Recognition (ICPR’06), 2006, pp. 1099–1102, doi: 10.1109/ICPR.2006.247.
[12] I. A. Saleh, O. I. Alsaif, S. A. Muhamed, and E. I. Essa, “Task scheduling for cloud computing based on firefly algorithm,” Journal
of Physics: Conference Series, vol. 1294, no. 4, p. 42004, Sep. 2019, doi: 10.1088/1742-6596/1294/4/042004.
[13] R. Tanawongsuwan and A. Bobick, “Gait recognition from time-normalized joint-angle trajectories in the walking plane,” in
Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, vol. 2,
pp. II-726-II–731, doi: 10.1109/CVPR.2001.991036.
[14] D. Ming, C. Zhang, Y. Bai, B. Wan, Y. Hu, and K. D. K. Luk, “Gait recognition based on multiple views fusion of wavelet descriptor
and human skeleton model,” in 2009 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and
Measurements Systems, May 2009, pp. 246–249, doi: 10.1109/VECIMS.2009.5068902.
[15] F. Xiao, P. Hua, L. Jin, and Z. Bin, “Human gait recognition based on skeletons,” in ICEIT 2010 - 2010 International Conference
on Educational and Information Technology, Proceedings, 2010, vol. 2, pp. V2--83, doi: 10.1109/ICEIT.2010.5607519.
[16] Y.-B. Li and Q. Yang, “Gait extraction and recognition based on lower leg and ankle,” in 2010 International Conference on
Intelligent Computation Technology and Automation, May 2010, vol. 2, pp. 379–382, doi: 10.1109/ICICTA.2010.714.
[17] N. L. Mohammed, M. S. Aziz, and O. I. AlSaif, “Design and implementation of robot control system for multistory buildings,”
Telkomnika (Telecommunication Computing Electronics and Control), vol. 18, no. 5. pp. 2682–2689, 2020,
doi: 10.12928/TELKOMNIKA.v18i5.15338.
[18] S. A. Baker and A. S. Nori, “Internet of things security: a survey,” in Communications in Computer and Information Science, 2021,
pp. 95–117.
[19] V. Sarangi, A. Pelah, W. E. Hahn, and E. Barenholtz, “Neural and neuromimetic perception: a comparative study of gender
classification from human gait,” Journal of Perceptual Imaging, vol. 3, no. 1, pp. 10402–10411, Jan. 2020,
doi: 10.2352/J.Percept.Imaging.2020.3.1.010402.
[20] K. Arai and R. Andrie, “Gait recognition method based on wavelet transformation and its evaluation with Chinese Academy of
Sciences (CASIA) gait database as a human gait recognition dataset,” in 2012 Ninth International Conference on Information
Technology - New Generations, Apr. 2012, pp. 656–661, doi: 10.1109/ITNG.2012.164.
[21] T. Mathworks, MATLAB 2019b - MathWorks. 2019.
[22] Prathap C and S. Sakkara, “Gait recognition using skeleton data,” in 2015 International Conference on Advances in Computing,
Communications and Informatics (ICACCI), Aug. 2015, pp. 2302–2306, doi: 10.1109/ICACCI.2015.7275961.
[23] W. Kim, Y. Kim, and K. Y. Lee, “Human gait recognition based on integrated gait features using kinect depth cameras,” in 2020
IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC), Jul. 2020, pp. 328–333,
doi: 10.1109/COMPSAC48688.2020.0-225.
[24] B. Kwon and S. Lee, “Joint swing energy for skeleton-based gender classification,” IEEE Access, vol. 9, pp. 28334–28348, 2021,
doi: 10.1109/ACCESS.2021.3058745.
[25] S. J. Colley, Vector calculus. 2011.
[26] K. Yata and M. Aoshima, “Effective PCA for high-dimension, low-sample-size data with noise reduction via geometric
representations,” Journal of Multivariate Analysis, vol. 105, no. 1, pp. 193–215, Feb. 2012, doi: 10.1016/j.jmva.2011.09.002.
[27] E. Postma, “Review of dynamic vision: from images to face recognition,” Cognitive Systems Research, vol. 3, no. 4, pp. 579–581,
Dec. 2002, doi: 10.1016/S1389-0417(02)00038-4.
[28] S. Q. Alhashmi, K. H. Thanoon, and O. I. Alsaif, “A proposed face recognition based on hybrid algorithm for features extraction,”
in 2020 6th International Engineering Conference “Sustainable Technology and Development" (IEC), Feb. 2020, pp. 232–236,
doi: 10.1109/IEC49899.2020.9122911.
[29] A. T. M. Siregar, T. Siswantining, A. Bustamam, and D. Sarwinda, “Comparison of supervised models in hepatocellular carcinoma
tumor classification based on expression data using principal component analysis (PCA),” in AIP Conference Proceedings, 2020,
p. 30002, doi: 10.1063/5.0023931.
[30] T. Omrani, A. Dallali, B. C. Rhaimi, and J. Fattahi, “Fusion of ANN and SVM classifiers for network attack detection,” in 2017
18th International Conference on Sciences and Techniques of Automatic Control and Computer Engineering (STA), Dec. 2017,
pp. 374–377, doi: 10.1109/STA.2017.8314974.
[31] R. Kaviarasi and R. Gandhi Raj, “Accuracy enhanced lung cancer prognosis for improving patient survivability using proposed
Gaussian classifier system,” Journal of Medical Systems, vol. 43, no. 7, p. 201, Jul. 2019, doi: 10.1007/s10916-019-1297-2.
[32] A. A. Rafique, A. Jalal, and A. Ahmed, “Scene understanding and recognition: statistical segmented model using geometrical
features and gaussian naïve bayes,” in 2019 International Conference on Applied and Engineering Mathematics (ICAEM), Aug.
2019, pp. 225–230, doi: 10.1109/ICAEM.2019.8853721.
[33] K. H. Thanoon, S. Q. Hasan, and O. I. Alsaif, “Biometric information based on distribution of arabic letters according to their
outlet,” International Journal of Computing and Digital Systems, vol. 9, no. 5, pp. 981–991, Sep. 2020, doi: 10.12785/ijcds/090518.
[34] I. A. Saleh, W. A. Alawsi, O. I. Alsaif, and K. Alsaif, “A prediction of grain yield based on hybrid intelligent algorithm,” Journal
of Physics: Conference Series, vol. 1591, no. 1, p. 12027, Jul. 2020, doi: 10.1088/1742-6596/1591/1/012027.
[35] M. A. Yahya et al., “Noise cancellation for HIPERLAN/2 with open loop transmit diversity technique,” Inventions, vol. 4, no. 3,
p. 46, Aug. 2019, doi: 10.3390/inventions4030046.
[36] I. A. Saleh, O. I. Alsaif, and M. A. Yahya, “Optimal distributed decision in wireless sensor network using gray wolf optimization,”
IAES International Journal of Artificial Intelligence (IJ-AI), vol. 9, no. 4, p. 646, Dec. 2020, doi: 10.11591/ijai.v9.i4.pp646-654.
[37] O. S. Hasan and I. A. Saleh, “Development of heart attack prediction model based on ensemble learning,” Eastern-European Journal
of Enterprise Technologies, vol. 4, no. 2(112), pp. 26–34, Aug. 2021, doi: 10.15587/1729-4061.2021.238528.
[38] A. H. Maray, O. I. Alsaif, and K. H. Tanoon, “Design and implementation of low-cost medical auditory system of distortion
otoacoustic using microcontroller,” Journal of Engineering Science and Technology, vol. 17, no. 2, pp. 1068–1077, 2022.
[39] A. K. Ismael and A. M. Khidhir, “Evaluation of transfer learning with CNN to classify the Jaw Tumors,” IOP Conference Series:
Materials Science and Engineering, vol. 928, no. 3, p. 32072, Nov. 2020, doi: 10.1088/1757-899X/928/3/032072.
[40] B. S. Mohamad-Ali and A. H. Maree, “Low cost medical data acquisition system using AVR-MCU and PC,” Journal of Theoretical
and Applied Information Technology, vol. 42, no. 2, pp. 217–220, 2012.
[41] V. Bijalwan, V. B. Semwal, and V. Gupta, “Wearable sensor-based pattern mining for human activity recognition: deep learning
approach,” Industrial Robot: the international journal of robotics research and application, vol. 49, no. 1, pp. 21–33, Jan. 2022,
doi: 10.1108/IR-09-2020-0187.
[42] E. J. Harris, I.-H. Khoo, and E. Demircan, “A survey of human gait-based artificial intelligence applications,” Frontiers in Robotics
and AI, vol. 8, Jan. 2022, doi: 10.3389/frobt.2021.749274.
[43] R. R. O. Al-Nima, S. Q. Hasan, and S. Esmail, “Exploiting the deep learning with fingerphotos to recognize people,” International
Journal of Advance Science and Technology, vol. 29, no. 7, pp. 13035–13046, 2020.
BIOGRAPHY OF AUTHOR
Using skeleton model to recognize human gait gender (Omar Ibrahim Alsaif)