Kolmogorov
Kolmogorov
dimensional probability distributions that can be used to compare a sample with a reference
probability distribution ( one sample K-S test), or to compare two samples (two sample K-S test). It is
named after Andrey Kolmogorov and Nikolai Smirnov. The Kolmogorov-Smirnov statistic quantifies a
distance between the empirical distribution function of the sample and the cumulative distribution
function of the reference distribution , or between the empirical distribution functions of two
samples
Kolmogorov-Smirnov test is a nonparametric goodness -of -fit and is used to determine whether two
distributions differ, or whether an underlying probability distribution differs from a hypothesized
distribution. It is used when we have two samples coming from two populations that can be
different. Unlike the Mann-Whitney test and the Wilcoxon test where the goal is to detect the
difference between two means or medians, the Kolmogorov-Smirnov test has the advantage of
considering the distribution functions collectively. The Kolmogorov-Smirnov test can also be used as
a goodness of fit test. In this case, we have only one random sample obtained from a population
where the distribution function is specific and known.
Facts:
The goodness-of-fit test for a sample was invented by Andrey Nikolayevich Kolmogorov (1933). The
Kolmogorov-Smirnov test for two samples was invented by Vladimir Ivanovich Smirov (1939).
The twos ample K-S test is one of the most useful and general nonparametric methods for
comparing two samples , as it is sensitive to differences in both location and shape of the empirical
cumulative distribution functions of two samples.
Advantages:
The test is distribution free. That means you don’t have to know the underlying population
distribution for your data before running this test.