49-Article Text-153-3-10-20200225
49-Article Text-153-3-10-20200225
49-Article Text-153-3-10-20200225
Black screen
tools were the anthropometric and radiographic types. Rearfoot
angle (RFA), Medial Longitudinal Arch Angle (MLAA),
navicular drop (ND), footprint (arch index) and malleolar
valgus index are included in anthropometric measurements [8], Stand
[11]. platform
Research on foot pronation has been carried out by previous Lighting camera
system
researchers such as Langley et al. [9], Bailey et al. [12], and
James et al. [13]. In general, their research was conducted by Fig. 1. Illustration of the system arrangement of taking pictures/ images.
marking the tibia and calcaneus lines of the subject's feet using
markers, then measuring the angle between the midline of the 2) Experiment
tibia and calcaneus using a goniometer. Another pronation foot In this study, after the photo session was completed, the
study was done by Lin et al. [14][15] using image processing to digital images were processed using a developed graphical user
determine the angle between the tibia and calcaneus midline, interface (GUI) based on Matlab software. In this tool, each
but this study did not directly classify the results of the angular image was processed and measured using techniques of RFA,
measurements to determine the type of foot pronation. MLAA, and AHI. Then, the classification of the foot type was
For doctors or clinicians, the anthropometric measurements resulted for each technique.
were widely performed by direct measurement [7], [13], [16], B. The Diagram Block
[17] such as evaluating the curvature and harmony of the foot
[8] using a goniometer to measure RFA [9] or using a scanner The technique of digital image processing was performed by
device and other technologies [5], [15], [18] such as RFID several steps in this study as shown in Fig. 2. The acquired image
sensors and data visualization with computer modeling [12]. It was previously processed by converting the image format and
is rare to find studies that use image processing in measuring reducing the noise in order to obtain a better extraction result of
either angle or length of the measured foot variables. the feature.
Furthermore, for the necessity of large medical data, utilization Image Image Pre- Feature
of those devices, such as goniometer and arc will spend more Classification
acquisition processing extraction
time or need more people to perform the measurement.
Therefore, the purpose of this study is to provide and develop a Fig. 2. Block diagram of Digital Image Processing of anthropometric tests.
fast algorithm for measuring and classifying the foot posture
types based on anthropometric tests, namely RFA, MLAA and
AHI using a set of DIP technique.
Real RGB to grayscale Edge
Noise filter
Image conversion detection
II. MATERIALS AND METHODS
A. Experimental Setup Median filter Threshold Normalization
This study used ten participants with information on age,
body weight, height, and body mass index (19.3 1.76 years, Fig. 3. Block diagram of Image Pre-processing.
57.3 10.39 kg, 166.8 7.64 m, 20.50 2.78 kg/m2). All
photographs of the feet of participants were taken in a standard C. Image Pre-processing
studio setting. Image pre-processing is aimed to improve the image data by
suppressing unwanted distortions such as color transformation,
1) Materials and Tool
filtering, segmentation and scaling in order to prepare the image
A camera, Canon 200D with a 5.76 focus and a 25mm lens,
was used to take the images of the participant’s standing foot of to be used in the next process. This process (Fig. 3) was carried
both sides of the rear and inner foot for each leg. During the out in six sequences.
process of taking photographs, the participant stood on a i. Converting the RGB to grayscale image by eliminating the
platform block. An adequate lighting system was provided to hue and saturation information while retaining the
acquire a good contrast image between the object and the
luminance.
background (described in Fig. 1).
ii. Decreasing the noise effect using the smooth filter by D. Feature Extraction
replacing each pixel with the average of its 33 A process or method to reduce the dimensionality of initial
neighborhood. raw data, but still accurately and completely depicting the initial
iii. Undertaking edge detection to identify the edges in an data set, is called feature extraction. In this study, the practical
image using a Sobel edge detector. Thus, the resulting use of feature extraction was performed by image processing
image becomes clearer. using the algorithms to detect features such as points in a digital
iv. Doing the normalization process on the image by ranging image. Feature detection was used to calculate the RFA,
the image on a scale of 0 and 1. MLAA, and AHI, which will be explained separately as
v. Converting a grayscale image to binary image using the follows.
threshold method by replacing each pixel in the image 1) Rearfoot Angle (RFA)
with a value of 0 (for a typical black intensity) or 1 (for a RFA was measured as the acute angle between the projection
typical white intensity). The profiles of the foot image and of two lines, as shown in Fig. 4(a). The four marked points [21]
the background would be shown in white intensity and were the base of the calcaneus, the Achilles tendon attachment,
black intensity, respectively. the Achilles tendon center at the height of medial malleoli and
vi. Applying a non-linear filter, namely median filter, to the center of shank posterior, 15 cm above the Achilles tendon
remove the noise of the resulting error without reducing center. The calculation process of RFA was described in the
following steps.
the image sharpness by replacing the gray level of each
pixel by the median of the gray levels in the neighborhood i. It requires a binary image, then the user placed 4 points on
of the pixels [20]. each edge of calcaneus bone using marker tools of the
developed algorithm,
Sobel operator, written in Equation 1, used the derivative ii. The algorithm calculates and marks the coordinate center
approximation to find or detect the edge. This operator applied of each distance owned by each pair of marker points,
a pair of horizontal ( ) and vertical ( ) gradient matrices
iii. The algorithm calculates the gradient value using a
(commonly in a 33 dimension) at the weight of the central numerical gradient (Equation 4) to estimate the values of
pixels [21]. It works by calculating the gradient of the image the partial derivatives in each dimension using the known
intensity at each pixel within the image by calculating the function values from the step ii.
magnitude (Equation 2) and finding the direction of the largest
increase from light to dark and the rate of change in that ∇F = ̂+ ̂ (4)
direction (Equation 3).
+1 +2 +1 iv.The angle (in radian unit) is calculated and converted in
= 0 0 0 ∗ , degree.
−1 −2 −1
2) Medial Longitudinal Arch Angle (MLAA)
−1 0 +1 MLAA is the midpoint of the medial malleolus (MM), the most
= −2 0 +2 ∗ (1) prominent aspect of the navicular tuberosity (NT) and the most
−1 0 +1 medial prominence of the first metatarsal head (MH) [5] as
= + (2) shown in Fig. 5. The calculation process of MLAA is described
in the following steps.
Θ= (3)
i. It requires a grayscale image, then the user placed 3 points
The variable of is the original source image, is the gradient of MH, NT and MM using marker tools of Graphical User
Interface in MATLAB,
magnitude, and Θ is the gradient direction. Two kernels (3×3)
ii. The algorithm calculates the distances of MM-NT, NT-
of Sobel filter used for changes in the horizontal and vertical
MH, and MH-MM using Euclidean distance, the distance
direction were convolved with the original image to calculate
between two points in Euclidean space (relationship
the approximations of the derivatives. To compute and ,
between the angle and the distance). The angle at NT (in
the appropriate kernel (window) was moved over the input radian) was calculated using Equation 5, then converted in
image, then computing the value for one pixel, and shifting one degree. Descriptive classification of foot posture for RFA
pixel to the right. Once the end of the row was reached, moved and MLAA calculation are presented in Table I.
down to the beginning of the next row. The results represented
an edge by showing how abruptly or smoothly the image
changes at each pixel and how the edge was likely to be cos = (5)
oriented. A gradient value of 0 indicated the vertical edge that
3) Arch Height Index (AHI)
was much darker on the left side.
AHI, a clinical measure to assess the static foot posture and arc angle and length based on RFA, MLAA and AHI tests. Fig. 7(b)
height [22] is a ratio of the dorsum height at 50%-foot length to shows an image pre-processing using the developed algorithm.
the truncated foot length [23][24]. The calculation process of
1) Anthro-Posture v1.0 software
AHI is described in the following steps.
An algorithm was created in MATLAB to determine the foot
i. It requires a binary image, then the user places 4 points posture from RFA and/ or MLAA tests. AHI was used as
using marker tools to calculate the AHI_total and additional information to support the results of determining the
AHI_instep (on dorsum, base, the most posterior point of classification of foot posture. The developed algorithm, which
the calcaneus and the first metatarsophalangeal joint or the is named Anthro-Posture v1.0 software, was built using a
front end of the foot) Graphical User Interface (GUI) and designed with the principle
ii. The algorithm determines the coordinate center of the total of user-friendly. Fig. 8 shows the main menu of the software
foot length and calculates the AHI_total (Equation 6) and where the user can choose one of the tests by clicking the
AHI_instep (Equation 7). selected button.
AHI = (6) 2) Validity Test
The angle and the length, the measurement of the variables
AHI = (7) of RFA, MLAA, and AHI, were validated by the specialists and
a certain comparison method. The specialists, doctors of the
E. Classification medical rehabilitation in the Department of Medical
The types of foot postures (supination, neutral, or Rehabilitation in Hasan Sadikin Hospital (RSHS) Bandung
supination) were determined by the DIP results of RFA or validated the result of length and angle measurement in this
MLAA rules, as presented in Table I. study using a ruler and arc as shown in Table II. The error
means of length and angle from those comparisons were 6.22%
TABLE I. CLASSIFICATION OF FOOT POSTURE (SUPINATION, NEUTRAL, and 0.26%, respectively.
PRONATION).
Another validation technique was comparing the angle
Type of Type of foot posture result of DIP with Kinovea software. This software, a valid and
tests Supination Neutral Pronation reliable tool [25, 26], is one of the test methods to accurately
RFA [24] RFA ≥ 5° 4° valgus to RFA ≥ 5°
measure the angle range. Table III shows the comparison results
varus 4° varus valgus
MLAA [27] > 150° 130° to 150° MLAA < 130°
of Konivea and Anthro-Posture v1.0 software. The differences
in angle measurements were caused by the resolution of
Kinovea (the resolution is only 1 degree). Hence, it could be
supination neutral pronation considered that its error means is 1.74%.
(a) (b)
Tibia
MM
Talus
3
Calcaneus c
b
Instep height
NT
(a) a 1
(b) MH
2
Instep (truncated) foot length
4
Angle measurement in
Tested angle (o)
Konivea software
in Anthro-
Angle Error (°)
Posture v.1
Description result
Rear foot RGB to grayscale software
Real Image
conversion
Noise filter Edge detection
(°)
Median filter Threshold Normalization
19.76o 20 o 0.24°
Inner-side foot
Fig. 7. (a)Photographs of the rear and inner side of the standing foot, (b)
Results of each step of image pre-processing. 27.82o 27o 0.82°
<\code>
%Pre-processing
<code>
gambar=im2bw(gambar,0.0600);
%function filter binary gambar=doLPF(gambar);
end counter2=counter2+1;
end end
end
% filtering implement low pass filter
gambar=doLPF(gambar); % middle point
global Xstjleg;
%Convert image to binary and LPF global Ystjleg;
axes(handles.display_image);
Xstjleg=times(plus(xSTJ1,xSTJ2),1/2); hold on;
Ystjleg=times(plus(ySTJ1,ySTJ2),1/2); axis on;
global XMH;
plot(Xstjleg,Ystjleg, 'b.', 'MarkerSize', 15, 'LineWidth', 1); global YMH;
plot1VerCor=[xSTJ1 ySTJ1];
plot2VerCor=[xSTJ2 ySTJ2];
Listing Program 4. Program to measure AHI test.
%Calculating Height of Foot %Find Euclidean distance of start point and end point
<code> VerDist=[plot1VerCor;plot2VerCor];
% --- Executes on button press in VerDist. VerDistPix=pdist(VerDist,'euclidean');
function VerDist_Callback(hObject, eventdata, handles)
% hObject handle to VerDist (see GCBO) %Calibrating distance
global VerDistCm;
Yhor=times(plus(yleg1,yleg2),1/2);
b = VerDistPix * 0.026458333; plot(Xhor,Yhor, 'b.', 'MarkerSize', 15,'LineWidth', 1 );
VerDistCm = b-2.29938;
plot1HorCor=[xleg1 yleg1];
set(handles.VerDistCm,'string',num2str(VerDistCm)) plot2HorCor=[xleg2 yleg2];
counter2=counter2+1; xins1(1,counter1)=x;
end yins1(1,counter1)=y;
end counter1=counter1+1;
% middle point
global Xhor; elseif mod(c,2)==0
global Yhor; plot(x,y, 'r.', 'MarkerSize', 15, 'LineWidth', 1);
Xhor=times(plus(xleg1,xleg2),1/2); xins2(1,counter2)=x;
yins2(1,counter2)=y;
Rear Foot Angle (RFA) Measurement
counter2=counter2+1;
end
end
% middle point
global XIns;
global YIns;
XIns=times(plus(xins1,xins2),1/2);
YIns=times(plus(yins1,yins2),1/2); Select File
%Calibrating distance
global InsDistCm;
a=InsDistPix*0.026458333;
InsDistCm = a-2.90794;
set(handles.InsDistCm,'string',num2str(InsDistCm))
TABLE IV. THE CLASSIFICATION RESULT OF RFA. Based on the RFA test, of all participants, 50% had a neutral
Rearfoot angle (o) Classification right foot and 60% had a neutral left foot. According to the
Subject-n finding result of RFA using the goniometer device [5], the
Right Left Right Left
1 1.65 2.91 n n method consistency was lower compared to MLAA and other
2 6.00 1.36 p p tools.
3 2.81 4.66 n n The MLAA test in this study resulted in more participants
4 15.43 8.05 p p having a neutral foot. Hence, the result difference of the
5 9.05 6.11 p p classification from both tools was around 20-30%.
6 3.93 10.07 n p Furthermore, one could interpret that of 50% participants
7 5.41 3.20 p n having a pronated right foot with RFA, 40% of them have a
8 3.73 2.38 n n neutral right foot with MLAA. In the other side for the left feet,
9 13.34 16.13 p p of 40% of participants having a pronated left foot with RFA,
75% of them have a neutral left foot with MLAA. These results
TABLE V. THE CLASSIFICATION RESULT OF MLAA. reinforced the findings of the previous research [5] which stated
that MLAA was the strongest uniplanar tool due to its higher
MLAA (o) Classification reliability, good agreement on steps for foot classification and
Subject-n
Right Left Right Left wider foot classification limits.
1 140.77 134.17 n n For AHI test, it is often used as supporting data for further
2 128.75 131.89 p n observation. One is categorized in the high-arched group when
3 150.04 150.01 n n the instep arch height index is at least 0.388 and in the low-
4 125.59 131.82 p n arched group when AHI equal or less than 0.262 [29]. From all
5 145.27 149.81 n n participants, it is only 30% of them included in the lower-arched
6 157.07 151.86 p p group. Associated with MLAA, from the lower-arched foot
7 137.36 150.03 n n participants, 66% of them have pronated feet. Meanwhile
8 146.11 152.35 n n associated with RFA, 100% of participants have pronated feet.
9 142.63 143.70 n n All these AHI results were quite relevant because based on the
10 139.23 141.02 n n finding study [22], a low-arched may result in a pronated foot,
but not all pronated feet have a low-arched type.
TABLE VI. THE CALCULATED AHI_TOTAL AND AHI_INSTEP OF THE INNER- The test results of RFA, MLAA, and AHI have been
SIDE FOOT.
validated by the specialists and other comparison tools using a
Right foot (cm) Left foot (cm) ruler, arc and Konivea software in order to improve the accuracy.
Subject The error means of length and angle in this software were 6.22%
AHI_ AHI_ Arch AHI_ AHI_ Arch
-n and (0.26-1.74) %, respectively.
total instep group total instep group
1 0.18 0.27 n 0.21 0.27 n Determination of the points of tibial and calcaneus in this
2 0.15 0.22 l 0.18 0.22 l first algorithm was still carried out manually, the same as that
3 0.23 0.32 n 0.24 0.34 n done by the doctors in their manual measurement using
markers, goniometers and arc [9], [13]. But in the case of DIP,
4 0.18 0.25 l 0.24 0.26 l
this manual step was a limitation that should be eliminated in a
5 0.17 0.24 l 0.17 0.24 l
future developing algorithm. However, compared to other DIP
6 0.23 0.34 n 0.22 0.32 n research conducted by Lin et. Al [14], this Anthro-Posture v1.0
7 0.21 0.29 n 0.19 0.28 n software was not only capable of measuring the angle and
8 0.21 0.29 n 0.24 0.36 n length of images but also providing the classification results of
9 0.24 0.33 n 0.22 0.30 n the foot posture.
10 0.19 0.28 n 0.19 0.27 n
V. CONCLUSION
index used the instep foot length instead of total foot length [28].
The comparison result between the instep height and the instep The anthropometric techniques are commonly used in the
foot length is displayed respectively in Fig. 11, while the classification of foot types, but the lack of carrying out the
calculated AHI of all participants is presented in Table VI (arch assessment with these uniplanar tools should be improved in
group: n for normal, l for lower). many ways. This study has demonstrated the development
algorithm in MATLAB to measure the foot posture, which is
IV. DISCUSSION named Anthro-Posture v1.0 software. The advantages of this
The Anthro-Posture v1.0 software has been created, technique are providing statistical medical data in a shorter time
validated and tested completely in this study. The classification and minimizing the human error in measurement. In the future,
results of all anthropometric tests could be learned more to this study can be improved to be used by doctors in obtaining
compare them to other works. large amounts of data for research needed.