Forecasting - Wikipedia
Forecasting - Wikipedia
Forecasting is the process of making predictions based on past and present data. Later
these can be compared (resolved) against what happens. For example, a company might
estimate their revenue in the next year, then compare it against the actual results.
Prediction is a similar, but more general term. Forecasting might refer to specific formal
statistical methods employing time series, cross-sectional or longitudinal data, or
alternatively to less formal judgmental methods or the process of prediction and
resolution itself. Usage can differ between areas of application: for example, in hydrology
the terms "forecast" and "forecasting" are sometimes reserved for estimates of values at
certain specific future times, while the term "prediction" is used for more general estimates,
such as the number of times floods will occur over a long period.
Risk and uncertainty are central to forecasting and prediction; it is generally considered
good practice to indicate the degree of uncertainty attaching to forecasts. In any case,
the data must be up to date in order for the forecast to be as accurate as possible. In
some cases the data used to predict the variable of interest is itself forecast.[1]
Forecasting software packages have become available in recent years; the subject has
deserved scholarly reviews.[2][3]
Applications
Forecasting has applications in a wide range of fields where estimates of future conditions
are useful. Depending on the field, accuracy varies significantly. If the factors that relate
to what is being forecast are known and well understood and there is a significant amount
of data that can be used, it is likely the final value will be close to the forecast. If this is
not the case or if the actual outcome is affected by the forecasts, the reliability of the
forecasts can be significantly lower.[4]
Climate change and increasing energy prices have led to the use of Egain Forecasting for
buildings. This attempts to reduce the energy needed to heat the building, thus reducing the
emission of greenhouse gases. Forecasting is used in customer demand planning in everyday
business for manufacturing and distribution companies.
While the veracity of predictions for actual stock returns are disputed through reference
to the Efficient-market hypothesis, forecasting of broad economic trends is common. Such
analysis is provided by both non-profit groups as well as by for-profit private
institutions.
Forecasting has also been used to predict the development of conflict situations.[7]
Forecasters perform research that uses empirical results to gauge the effectiveness of
certain forecasting models.[8] However research has shown that there is little difference
between the accuracy of the forecasts of experts knowledgeable in the conflict situation
and those by individuals who knew much less.[9]
Similarly, experts in some studies argue that role thinking does not contribute to the
accuracy of the forecast.[10] The discipline of demand planning, also sometimes referred to
as supply chain forecasting, embraces both statistical forecasting and a consensus process.
An important, albeit often ignored aspect of forecasting, is the relationship it holds with
planning. Forecasting can be described as predicting what the future will look like,
whereas planning predicts what the future should look like.[11][12] There is no single right
forecasting method to use. Selection of a method should be based on your objectives and
your conditions (data etc.).[13] A good place to find a method, is by visiting a selection tree.
An example of a selection tree can be found here.[14] Forecasting has application in many
situations:
Supply chain management - Forecasting can be used in supply chain management to ensure
that the right product is at the right place at the right time. Accurate forecasting will
help retailers reduce excess inventory and thus increase profit margin. Studies have
shown that extrapolations are the least accurate, while company earnings forecasts
are the most reliable.[15] Accurate forecasting will also help them meet consumer
demand.
Economic forecasting
Earthquake prediction
Egain forecasting
Finance against risk of default via credit ratings and credit scores
Political forecasting
Product forecasting
Sales forecasting
Technology forecasting
Telecommunications forecasting
In several cases, the forecast is either more or less than a prediction of the future.
Betting on sports or politics is another form of forecasting. Rather than being used as
advice, bettors are paid based on if they predicted correctly. While decisions might be made
based on these bets (forecasts), the main motivation is generally financial.
Quantitative forecasting models are used to forecast future data as a function of past
data. They are appropriate to use when past numerical data is available and when it is
reasonable to assume that some of the patterns in the data are expected to continue into
the future. These methods are usually applied to short- or intermediate-range decisions.
Examples of quantitative forecasting methods are last period demand, simple and weighted
N-Period moving averages, simple exponential smoothing, poisson process model based
forecasting[16] and multiplicative seasonal indexes. Previous research shows that different
methods may lead to different level of forecasting accuracy. For example, GMDH neural
network was found to have better forecasting performance than the classical forecasting
algorithms such as Single Exponential Smooth, Double Exponential Smooth, ARIMA and back-
propagation neural network.[17]
Average approach E…
In this approach, the predictions of all future values are equal to the mean of the past
data. This approach can be used with any sort of data where past data is available. In time
series notation:
[18]
Although the time series notation has been used here, the average approach can also be
used for cross-sectional data (when we are predicting unobserved values; values that are
not included in the data set). Then, the prediction for unobserved values is the average of
the observed values.
Naïve approach E…
Naïve forecasts are the most cost-effective forecasting model, and provide a benchmark
against which more sophisticated models can be compared. This forecasting method is only
suitable for time series data.[18] Using the naïve approach, forecasts are produced that are
equal to the last observed value. This method works quite well for economic and financial
time series, which often have patterns that are difficult to reliably and accurately
predict.[18] If the time series is believed to have seasonality, the seasonal naïve approach
may be more appropriate where the forecasts are equal to the value from last season. In
time series notation:
Drift method E…
A variation on the naïve method is to allow the forecasts to increase or decrease over
time, where the amount of change over time (called the drift) is set to be the average
change seen in the historical data. So the forecast for time is given by
[18]
This is equivalent to drawing a line between the first and last observation, and
extrapolating it into the future.
The seasonal naïve method accounts for seasonality by setting each prediction to be equal
to the last observed value of the same season. For example, the prediction value for all
subsequent months of April will be equal to the previous value observed for April. The
forecast for time is[18]
The seasonal naïve method is particularly useful for data that has a very high level of
seasonality.
Moving average
Exponential smoothing
Autoregressive moving average (ARMA) (forecasts depend on past values of the variable
being forecast and on past prediction errors)
Linear prediction
Relational methods E…
Some forecasting methods try to identify the underlying factors that might influence the
variable that is being forecast. For example, including information about climate patterns
might improve the ability of a model to predict umbrella sales. Forecasting models often
take account of regular seasonal variations. In addition to climate, such variations can
also be due to holidays and customs: for example, one might predict that sales of college
football apparel will be higher during the football season than during the off season.[19]
Several informal methods used in causal forecasting do not rely solely on the output of
mathematical algorithms, but instead use the judgment of the forecaster. Some forecasts
take account of past relationships between variables: if one variable has, for example, been
approximately linearly related to another for a long period of time, it may be appropriate
to extrapolate such a relationship into the future, without necessarily understanding the
reasons for the relationship.
Regression analysis includes a large group of methods for predicting future values of a
variable using information about other variables. These methods include both parametric
(linear or non-linear) and non-parametric techniques.
Quantitative forecasting models are often judged against each other by comparing their
in-sample or out-of-sample mean square error, although some researchers have advised
against this.[21] Different forecasting approaches have different levels of accuracy. For
example, it was found in one context that GMDH has higher forecasting accuracy than
traditional ARIMA[22]
Judgmental methods E…
Judgmental forecasting methods incorporate intuitive judgement, opinions and subjective
probability estimates. Judgmental forecasting is used in cases where there is lack of
historical data or during completely new and unique market conditions.[23]
Composite forecasts
Cooke's method
Delphi method
Forecast by analogy
Scenario building
Statistical surveys
Technology forecasting
Data mining
Machine learning
Pattern recognition
Can be created with 3 points of a sequence and the "moment" or "index", this type of
extrapolation have 100 % accuracy in predictions in a big percentage of known series
database (OEIS). [24]
Other methods E…
Granger causality
Simulation
Prediction market
Forecasting accuracy
The forecast error (also known as a residual) is the difference between the actual value
and the forecast value for the corresponding period:
where E is the forecast error at period t, Y is the actual value at period t, and F is the
forecast for period t.
A good forecasting method will yield residuals that are uncorrelated. If there are
correlations between residual values, then there is information left in the residuals which
should be used in computing forecasts. This can be accomplished by computing the expected
value of a residual as a function of the known past residuals, and adjusting the forecast
by the amount by which this expected value differs from zero.
A good forecasting method will also have zero mean. If the residuals have a mean other
than zero, then the forecasts are biased and can be improved by adjusting the forecasting
technique by an additive constant that equals the mean of the unadjusted residuals.
Scaled-dependent errors E…
The forecast error, E, is on the same scale as the data, as such, these accuracy measures
are scale-dependent and cannot be used to make comparisons between series on different
scales.
These are more frequently used to compare forecast performance between different data
sets because they are scale-independent. However, they have the disadvantage of being
extremely large or undefined if Y is close to or equal to zero.
Scaled errors E…
Hyndman and Koehler (2006) proposed using scaled errors as an alternative to percentage
errors.
Other measures E…
Business forecasters and practitioners sometimes use different terminology. They refer to
the PMAD as the MAPE, although they compute this as a volume weighted MAPE.[25] For more
information see Calculating demand forecast accuracy.
When comparing the accuracy of different forecasting methods on a specific data set, the
measures of aggregate error are compared with each other and the method that yields
the lowest error is preferred.
Cross-validation E…
Cross-validation is a more sophisticated version of training a test set.
1. Select observation i for the test set, and use the remaining observations in the training
set. Compute the error on the test observation.
2. Repeat the above step for i = 1,2,..., N where N is the total number of observations.
This makes efficient use of the available data, as only one observation is omitted at each
step
For time series data, the training set can only include observations prior to the test set.
Therefore, no future observations can be used in constructing the forecast. Suppose k
observations are needed to produce a reliable forecast; then the process works as
follows:
1. Starting with i=1, select the observation k + i for the test set, and use the
observations at times 1, 2, ..., k+i–1 to estimate the forecasting model. Compute the
error on the forecast for k+i.
2. Repeat the above step for i = 2,...,T–k where T is the total number of observations.
This procedure is sometimes known as a "rolling forecasting origin" because the "origin" (k+i
-1) at which the forecast is based rolls forward in time.[27] Further, two-step-ahead or in
general p-step-ahead forecasts can be computed by first forecasting the value immediately
after the training set, then using this value with the training set values to forecast two
periods ahead, etc.
See also
Consensus forecasts
Forecast error
Predictability
Seasonality E…
Seasonality is a characteristic of a time series in which the data experiences regular and
predictable changes which recur every calendar year. Any predictable change or pattern
in a time series that recurs or repeats over a one-year period can be said to be seasonal. It
is common in many situations – such as grocery store[28] or even in a Medical Examiner's
office[29]—that the demand depends on the day of the week. In such situations, the
forecasting procedure calculates the seasonal index of the “season” – seven seasons, one
for each day – which is the ratio of the average demand of that season (which is calculated
by Moving Average or Exponential Smoothing using historical data corresponding only to
that season) to the average demand across all seasons. An index higher than 1 indicates
that demand is higher than average; an index less than 1 indicates that the demand is less
than the average.
Cyclic behaviour E…
The cyclic behaviour of data takes place when there are regular fluctuations in the data
which usually last for an interval of at least two years, and when the length of the
current cycle cannot be predetermined. Cyclic behavior is not to be confused with
seasonal behavior. Seasonal fluctuations follow a consistent pattern each year so the
period is always known. As an example, during the Christmas period, inventories of stores
tend to increase in order to prepare for Christmas shoppers. As an example of cyclic
behaviour, the population of a particular natural ecosystem will exhibit cyclic behaviour
when the population decreases as its natural food source decreases, and once the
population is low, the food source will recover and the population will start to increase
again. Cyclic data cannot be accounted for using ordinary seasonal adjustment since it is
not of fixed period.
Limitations
Limitations pose barriers beyond which forecasting methods cannot reliably predict. There
are many events and values that cannot be forecast reliably. Events such as the roll of a
die or the results of the lottery cannot be forecast because they are random events and
there is no significant relationship in the data. When the factors that lead to what is being
forecast are not known or well understood such as in stock and foreign exchange markets
forecasts are often inaccurate or wrong as there is not enough data about everything
that affects these markets for the forecasts to be reliable, in addition the outcomes of
the forecasts of these markets change the behavior of those involved in the market
further reducing forecast accuracy.[4]
The concept of "self-destructing predictions" concerns the way in which some predictions
can undermine themselves by influencing social behavior.[30] This is because "predictors are
part of the social context about which they are trying to make a prediction and may
influence that context in the process".[30] For example, a forecast that a large percentage
of a population will become HIV infected based on existing trends may cause more people to
avoid risky behavior and thus reduce the HIV infection rate, invalidating the forecast
(which might have remained correct if it had not been publicly known). Or, a prediction that
cybersecurity will become a major issue may cause organizations to implement more
security cybersecurity measures, thus limiting the issue.
See also
Accelerating change
Cliodynamics
Earthquake prediction
Energy forecasting
Financial forecast
Forecasting bias
Futures studies
Futurology
Kondratiev wave
Least squares
Optimism bias
Planning
Prediction
Predictive analytics
Risk management
Scenario planning
Spending wave
Strategic foresight
Technology forecasting
Thucydides Trap
Time series
Weather forecasting
References
1. French, Jordan (2017). "The time traveller's CAPM". Investment Analysts Journal. 46 (2): 81–96.
doi:10.1080/10293523.2016.1255469 (https://doi.org/10.1080%2F10293523.2016.1255469) .
S2CID 157962452 (https://api.semanticscholar.org/CorpusID:157962452) .
2. Sanders, Nada R.; Manrodt, Karl B. (2003-10-01). "Forecasting Software in Practice: Use,
Satisfaction, and Performance" (https://pubsonline.informs.org/doi/abs/10.1287/inte.33.5.90.1925
1) . INFORMS Journal on Applied Analytics. 33 (5): 90–93. doi:10.1287/inte.33.5.90.19251 (https://do
i.org/10.1287%2Finte.33.5.90.19251) . ISSN 2644-0865 (https://www.worldcat.org/issn/2644-08
65) .
3. Fildes, Robert; Schaer, Oliver; Svetunkov, Ivan; Yusupova, Alisa (2020-08-04). "Survey: What's new
in forecasting software?" (https://doi.org/10.1287/orms.2020.04.05) . Operations Research
Management Science Today. 47 (4). ISSN 1085-1038 (https://www.worldcat.org/issn/1085-1038) .
5. Helen Allen; Mark P. Taylor (1990). "Charts, Noise and Fundamentals in the London Foreign
Exchange Market". The Economic Journal. 100 (400): 49–59. doi:10.2307/2234183 (https://doi.org/1
0.2307%2F2234183) . JSTOR 2234183 (https://www.jstor.org/stable/2234183) .
7. T. Chadefaux (2014). "Early warning signals for war in the news". Journal of Peace Research,
51(1), 5-18
8. J. Scott Armstrong; Kesten C. Green; Andreas Graefe (2010). "Answers to Frequently Asked
Questions" (https://web.archive.org/web/20120711003404/http://qbox.wharton.upenn.edu/documen
ts/mktg/research/FAQ.pdf) (PDF). Archived from the original (http://qbox.wharton.upenn.edu/doc
uments/mktg/research/FAQ.pdf) (PDF) on 2012-07-11. Retrieved 2012-01-23.
9. Kesten C. Greene; J. Scott Armstrong (2007). "The Ombudsman: Value of Expertise for Forecasting
Decisions in Conflicts" (https://web.archive.org/web/20100620223405/http://marketing.wharton.up
enn.edu/documents/research/Value%20of%20expertise.pdf) (PDF). Interfaces: 1–12. Archived
from the original (http://marketing.wharton.upenn.edu/documents/research/Value%20of%20expe
rtise.pdf) (PDF) on 2010-06-20. Retrieved 2011-12-29.
10. Kesten C. Green; J. Scott Armstrong (1975). "Role thinking: Standing in other people's shoes to
forecast decisions in conflicts" (http://www.forecastingprinciples.com/paperpdf/Escalation%20Bia
s.pdf) (PDF). Role Thinking: Standing in Other People's Shoes to Forecast Decisions in Conflicts.
39: 111–116.
11. J. Scott Armstrong; Kesten C. Green; Andreas Graefe (2010). "Answers to Frequently Asked
Questions" (https://web.archive.org/web/20120711003404/http://qbox.wharton.upenn.edu/documen
ts/mktg/research/FAQ.pdf) (PDF). Archived from the original (http://qbox.wharton.upenn.edu/doc
uments/mktg/research/FAQ.pdf) (PDF) on 2012-07-11. Retrieved 2012-01-23.
15. J. Scott Armstrong (1983). "Relative Accuracy of Judgmental and Extrapolative Methods in
Forecasting Annual Earnings" (http://www.forecastingprinciples.com/paperpdf/Monetary%20Incen
tives.pdf) (PDF). Journal of Forecasting. 2 (4): 437–447. doi:10.1002/for.3980020411 (https://doi.
org/10.1002%2Ffor.3980020411) . S2CID 16462529 (https://api.semanticscholar.org/CorpusID:164
62529) .
16. Mahmud, Tahmida; Hasan, Mahmudul; Chakraborty, Anirban; Roy-Chowdhury, Amit (19 August 2016).
A poisson process model for activity forecasting. 2016 IEEE International Conference on Image
Processing (ICIP). IEEE. doi:10.1109/ICIP.2016.7532978 (https://doi.org/10.1109%2FICIP.2016.753297
8) .
17. Li, Rita Yi Man; Fong, Simon; Chong, Kyle Weng Sang (2017). "Forecasting the REITs and stock indices:
Group Method of Data Handling Neural Network approach". Pacific Rim Property Research
Journal. 23 (2): 123–160. doi:10.1080/14445921.2016.1225149 (https://doi.org/10.1080%2F14445921.2
016.1225149) . S2CID 157150897 (https://api.semanticscholar.org/CorpusID:157150897) .
19. Steven Nahmias; Tava Lennon Olsen (15 January 2015). Production and Operations Analysis:
Seventh Edition (https://books.google.com/books?id=SIsoBgAAQBAJ&q=forecasting) . Waveland
Press. ISBN 978-1-4786-2824-8.
20. Ellis, Kimberly (2008). Production Planning and Inventory Control Virginia Tech. McGraw Hill.
ISBN 978-0-390-87106-0.
21. J. Scott Armstrong and Fred Collopy (1992). "Error Measures For Generalizing About Forecasting
Methods: Empirical Comparisons" (https://web.archive.org/web/20120206182744/http://marketing.w
harton.upenn.edu/ideas/pdf/armstrong2/armstrong-errormeasures-empirical.pdf) (PDF).
International Journal of Forecasting. 8: 69–80. CiteSeerX 10.1.1.423.508 (https://citeseerx.ist.psu.e
du/viewdoc/summary?doi=10.1.1.423.508) . doi:10.1016/0169-2070(92)90008-w (https://doi.org/10.1
016%2F0169-2070%2892%2990008-w) . Archived from the original (http://marketing.wharton.u
penn.edu/ideas/pdf/armstrong2/armstrong-errormeasures-empirical.pdf) (PDF) on 2012-02-06.
22. 16. Li, Rita Yi Man, Fong, S., Chong, W.S. (2017) Forecasting the REITs and stock indices: Group Method
of Data Handling Neural Network approach (http://www.tandfonline.com/eprint/pgjIcAMrJBP4Wc
HIZH7F/full) , Pacific Rim Property Research Journal, 23(2), 1-38
25. "Response to MAPE and MPE Calculations - Mark Chockalingam - Forecasting Blog" (http://www.fo
recastingblog.com/?p=134) . forecastingblog.com. 25 October 2010. Retrieved 16 March 2018.
28. Erhun, F.; Tayur, S. (2003). "Enterprise-Wide Optimization of Total Landed Cost at a Grocery
Retailer" (https://doi.org/10.1287%2Fopre.51.3.343.14953) . Operations Research. 51 (3): 343.
doi:10.1287/opre.51.3.343.14953 (https://doi.org/10.1287%2Fopre.51.3.343.14953) .
29. Omalu, B. I.; Shakir, A. M.; Lindner, J. L.; Tayur, S. R. (2007). "Forecasting as an Operations
Management Tool in a Medical Examiner's Office". Journal of Health Management. 9: 75–84.
doi:10.1177/097206340700900105 (https://doi.org/10.1177%2F097206340700900105) .
S2CID 73325253 (https://api.semanticscholar.org/CorpusID:73325253) .
30. Overland, Indra (2019-03-01). "The geopolitics of renewable energy: Debunking four emerging
myths" (https://doi.org/10.1016%2Fj.erss.2018.10.018) . Energy Research & Social Science. 49: 36–
40. doi:10.1016/j.erss.2018.10.018 (https://doi.org/10.1016%2Fj.erss.2018.10.018) . ISSN 2214-6296 (h
ttps://www.worldcat.org/issn/2214-6296) .
31. Cox, John D. (2002). Storm Watchers (https://archive.org/details/stormwatcherstur00cox_df1/pa
ge/222) . John Wiley & Sons, Inc. pp. 222–224 (https://archive.org/details/stormwatcherstur00co
x_df1/page/222) . ISBN 978-0-471-38108-2.
Ellis, Kimberly (2010). Production Planning and Inventory Control. McGraw-Hill. ISBN 978-
0-412-03471-8.
Geisser, Seymour (June 1993). Predictive Inference: An Introduction. Chapman & Hall, CRC
Press. ISBN 978-0-390-87106-0.
Hyndman, Rob J.; Koehler, Anne B. (October–December 2006). "Another look at measures of
forecast accuracy" (http://www.robjhyndman.com/papers/mase.pdf) (PDF). International
Journal of Forecasting. 22 (4): 679–688. CiteSeerX 10.1.1.154.9771 (https://citeseerx.ist.psu.e
du/viewdoc/summary?doi=10.1.1.154.9771) . doi:10.1016/j.ijforecast.2006.03.001 (https://doi.
org/10.1016%2Fj.ijforecast.2006.03.001) .
Makridakis, Spyros; Wheelwrigt, Steven; Hyndman, Rob J. (1998). Forecasting: Methods and
Applications. John Wiley & Sons. ISBN 978-0-471-53233-0.
Malakooti, Behnam (February 2014). Operations and Production Systems with Multiple
Objectives. John Wiley & Sons. ISBN 978-0-470-03732-4.
Kaligasidis, Angela Sasic; Taesler, Roger; Andersson, Cari; Nord, Margitta (August 2006).
"Upgraded weather forecast control of building heating systems". In Fazio, Paul (ed.).
Research in Building Physics and Building Engineering. Taylor & Francis, CRC Press. pp. 951–
958. ISBN 978-0-415-41675-7.
Kress, George J.; Snyder, John (May 1994). Forecasting and Market Analysis Techniques: A
Practical Approach. Quorum Books. ISBN 978-0-89930-835-7.
Turchin, Peter (2007). "Scientific Prediction in Historical Sociology: Ibn Khaldun meets Al
Saud". History & Mathematics: Historical Dynamics and Development of Complex Societies.
Moscow: KomKniga. pp. 9–38. ISBN 978-5-484-01002-8.
External links