A Note On Forecast Error
A Note On Forecast Error
In class we have tried understanding various types of forecasting errors and the purpose
that one type of error calculation serves over the other. In this note, I am trying to present
a summary of our discussion and an interpretation of tracking signal. The note will walk
you through how these calculations have been reported in literature, in general and also
try to highlight the exceptions. Let’s understand them one by one:
Types of error:
Considering this, may cancel out the negative errors against the positive errors and the
net error may not be correct interpretation, and hence we go for next type of forecast.
∑"
!#$ |#! |
MAD for n periods of demand data, MADn=
$
The absolute value takes care of the issue faced by error but fails to convey the direction
of the error.
∑"
!#$(#! )
%
Mean Squared Error for n periods, MSEn = $
However, if the error values are large, this magnifies the error part and becomes
cumbersome to handle.
|'! |
∑"
!#$ )!
Mean Absolute Percentage Error for n Periods, MAPEn = $
This allows us to view the error in absolute terms with respect to the actual demand
value.
1
5. Tracking Signal:
All the error calculations that we have seen so far fail to tell the direction of forecast error.
To overcome this, this metric is used:
'()*
Tracking Signal= +,-
The direction of Tracking signal will purely depend on the ± 𝐵𝑖𝑎𝑠 value as MAD has a non-
negative value.
The catch here lies with the choice of error definition. Let’s go back to the error formula.
Case 1:
If , et = (Actual Demand-Forecast Demand) = (At-Ft )
And if At<Ft ,
we are over forecasting and the value of over forecasted value is represented by “-”
Also, if At>Ft ,
we are under forecasting and the value of under forecasted value is represented by “+”
Case 2:
However, if et = (Forecast Demand-Actual Demand) = (Ft-At )
And if At<Ft ,
we are over forecasting and the value of over forecasted value is represented by “+”
Also, if At>Ft ,
we are under forecasting and the value of under forecasted value is represented by “-”
And same is reflected on the final TS interpretation. So, the under or over forecast
interpretation lies with the choice of error formula.
As per most standard practice, we opt for case 1 and in that case “-” refers to over
forecast and “+“ to under forecast. So, don’t get confused if the signs of TS are changed
based on the choice of the error calculation. In class we used case 2, and hence the TS
interpretation was just the reverse.
For range of TS value within which the forecast is within control and other numerical
calculations, please refer to Page 395-397, Russel & Taylor , Eighth Edition