Compute Empirical Cumulative Distribution Function in R
Last Updated :
23 Jul, 2025
The Empirical Cumulative Distribution Function (ECDF) is a non-parametric method for estimating the Cumulative Distribution Function (CDF) of a random variable. Unlike parametric methods, the ECDF makes no assumptions about the underlying probability distribution of the data.
It is defined as a step function that increases by \frac{1}{n}at each observed data point, where n is the total number of observations in the dataset.
The ECDF is a useful tool for visualizing the distribution of a dataset and can provide insights into the underlying distribution that would be difficult to obtain through traditional summary statistics.
Prerequisites
Before getting into the details of the Empirical Cumulative Distribution Function (ECDF), it’s important to understand a few foundational concepts related to probability distributions:
1. Probability Density Function (PDF)
- The probability density function (PDF) describes the probability distribution of a continuous random variable. It is defined as the derivative of the cumulative distribution function (CDF):
f(x) = \frac{d}{dx}F(x)
- Here, F(x) is the cumulative distribution function and f(x) represents the rate at which the probability accumulates with respect to x.
2. Probability Mass Function (PMF)
P(X = k)
- where X is a discrete random variable and k is a particular value in its range.
3. Cumulative Distribution Function (CDF)
F(x) = P(X \leq x)
- The CDF can be defined for both discrete and continuous variables and it is a non-decreasing function ranging from 0 to 1.
Mathematical Concept of ECDF
The ECDF is defined as follows:
- Let x_1, x_2, ..., x_n be a random sample of size n from a distribution with CDF F(x). The ECDF is given by:
\hat{F_n}(x) = \frac{1}{n} \sum_{i=1}^{n} I_{(-\infty, x]}(x_i\leq x)
\mathbf{I}_{(x_i \leq x)} = \begin{cases}1 & \text{if } x_i \leq x \\0 & \text{otherwise}\end{cases}.
Mean and Variance
- The ECDF can be used to estimate the mean and variance of a distribution.
- The mean of the distribution can be estimated as the area under the curve of the ECDF:
\hat{\mu}_n = \int_{-\infty}^{\infty} x \, d\hat{F}_n(x)
- The variance of the distribution can be estimated as:
\hat{\sigma}_n^2 = \int_{-\infty}^\infty (x - \hat{\mu}_n)^2 \, d\hat{F}_n(x)
- The ECDF can also be used to estimate confidence intervals for the CDF, which can be useful for hypothesis testing and parameter estimation.
Properties of ECDF
The ECDF has several useful properties:
- It is a non-parametric estimate of the CDF, meaning it can be applied to a wide variety of distributions without making assumptions about their shape or parameters.
- It is consistent, meaning that as the sample size increases, the ECDF converges to the true CDF.
- It is unbiased, meaning that on average, the ECDF estimates the true CDF.
- It is a step function, which makes it useful for visualizing the distribution of a dataset.
Now, let's move on to some examples of how to compute and plot the ECDF. Before starting this tutorial, you need to have a basic understanding of R language and its data structures. You should also have the latest version of R installed on your computer.
ECDF Computation and Plotting in R
To compute and plot the Empirical Cumulative Distribution Function (ECDF) in R , we generate sample data, compute ECDF using the ecdf()
function and plot the result.
R
install.packages("stats")
library(stats)
data <- rnorm(1000, mean = 50, sd = 10)
ecdf_func <- ecdf(data)
plot(ecdf_func,
xlab = "Data",
ylab = "Cumulative Probability",
main = "Empirical Cumulative Distribution Function")
Output:
Empirical Cumulative Distribution Function PlotExample 1: Computing and Plotting the ECDF for a Simple Dataset
Suppose we have a set of 10 data points: 1, 2, 3, 4, 4, 5, 6, 7, 8 and 9. We want to compute the ECDF of this data set.
Manually, we would first sort the data in ascending order: 1, 2, 3, 4, 4, 5, 6, 7, 8, 9. Then, for each value of x, we would count the number of observations that are less than or equal to x and divide by the total number of observations.
To compute the ECDF at x=5, we would count the number of observations that are less than or equal to 5, which is 6. Dividing by the total number of observations, we get \hat{F}(5) = \frac{6}{10} = 0.6. We would repeat this process for all values of x.
1. Sort the data
The first step is to sort the data in ascending order and calculate the number of data points:
R
data <- c(1, 2, 5, 4, 4, 3, 6, 7, 8, 9)
sorted <- sort(data, decreasing = FALSE)
n = length(sorted)
paste('Length :', n)
print(sorted)
Output:
'Length : 10'
[1] 1 2 3 4 4 5 6 7 8 9
2. Compute the ECDF using a Loop
To compute the ECDF, we need to loop over each data point in the sorted dataset and calculate the proportion of data points that are less than or equal to that point:
R
ecdf_func <- function(data) {
Length <- length(data)
sorted <- sort(data)
ecdf <- rep(0, Length)
for (i in 1:n) {
ecdf[i] <- sum(sorted <= data[i]) / Length
}
return(ecdf)
}
ecdf <- ecdf_func(data)
print(ecdf)
Output:
[1] 0.1 0.2 0.3 0.5 0.5 0.6 0.7 0.8 0.9 1.0
3. Compute ECDF using ecdf() function
In R, we can compute the ECDF using the built-in ecdf() function:
R
ecdf_fun <- ecdf(data)
ecdf_ <- ecdf_fun(data)
print(ecdf_)
Output:
[1] 0.1 0.2 0.6 0.5 0.5 0.3 0.7 0.8 0.9 1.0
4. Check whether both ecdf values are identical or not
R
Output:
TRUE
The two methods produce the same result, as can be seen by comparing the outputs of ecdf and ecdf_. The empirical cumulative distribution function assigns a probability of 0.1 to the smallest value in the data, a probability of 0.2 to the second smallest value and so on. The largest value in the data has a probability of 1.0.
6. Plot the ECDF
We can also plot the ECDF using the plot() function:
R
plot(data, ecdf_func(data), main="Custom Empirical Cumulative Distribution Plot", xlab="Data Points", ylab="ECDF Value")
Output
Custom Empirical Cumulative Distribution Function PlotExample 2: ECDF of Normally distributed data
Suppose we have a dataset of 100 observations that follows a normal distribution with a mean 0 and a standard deviation of 1. We want to compute the ECDF of this dataset and plot it.
1. Generate the data
We generate a dataset of 100 observations that follows a normal distribution with mean 0 and standard deviation 1. In R, we can use the rnorm() function to generate random normal data:
R
set.seed(123)
data <- rnorm(100, mean = 0, sd = 1)
Here, we set the random seed to ensure reproducibility and generate 100 random numbers from a normal distribution with a mean of 0 and a standard deviation of 1. The resulting data object is a vector of length 100.
2. Compute the ECDF values
For each value of x, we want to compute the estimated probability that a data point in the dataset is less than or equal to x. We can compute the ECDF values manually using a for loop or using ecdf() function.
R
ecdf_func <- function(data) {
Length <- length(data)
sorted <- sort(data)
ECDF <- rep(0, Length)
for (i in 1:Length) {
ECDF[i] <- sum(sorted <= data[i]) / Length
}
return(ECDF)
}
ecdf1 <- ecdf_func(data)
plot(data, ecdf1, xlab="Data", ylab="Cumulative Probability",
main="Empirical Cumulative Distribution Function")
Output:
Empirical Cumulative Distribution Function3. Check with ecdf() function identical or not
R
ecdf_fun <- ecdf(data)
ecdf <- ecdf_fun(data)
identical(ecdf1, ecdf)
Output:
TRUE
4. Compute the cumulative normal distribution with new data
First, we define a sequence of values for x. For each value of x, we want to compute the true probability that a standard normal random variable is less than or equal to x. This can be done using the standard normal CDF and use the pnorm() function to compute the true CDF values for each value of x. we use the same sample mean and standard deviation here also.
R
x <- seq(-4, 4, length.out = 100)
prob <- pnorm(x, mean = 0, sd = 1)
plot(prob, xlab="Data", ylab="Probability",
main="Cumulative Normal Distribution")
Output:
Cumulative Normal Distribution5. Compute ecdf for x using the function ecdf_fun() and Plot both cdf and ecdf on same plot
We can plot the true CDF values and ECDF values on the same plot to visualize how closely they match. Here, we use the plot() function to create a line plot with x-values from -4 to 4 and y-values corresponding to the true CDF values in blue and the ECDF values in red. We also add a legend to the plot to distinguish between the two lines.
R
ecdf = ecdf_fun(x)
plot(x, prob, type = "l", col = "blue", lwd = 2,
xlab = "x", ylab = "Cumulative probability",
main = "True CDF vs ECDF")
lines(x, ecdf, type = "l", col = "red", lwd = 2)
legend("bottomright", legend = c("True CDF", "ECDF"),
col = c("blue", "red"), lwd = 2)
Output:
True CDF vs ECDFWe first generate the normal data using the rnorm() function. Then, we compute the sample mean and standard deviation using the mean() and sd() functions. We then define a sequence of values for x and use the pnorm() function to compute the true CDF values for each value of x. We also compute the ECDF manually using a for loop and the sum() function. Finally, we plot both the true CDF.
Compute Empirical Cumulative Distribution Function in R
Similar Reads
R Tutorial | Learn R Programming Language R is an interpreted programming language widely used for statistical computing, data analysis and visualization. R language is open-source with large community support. R provides structured approach to data manipulation, along with decent libraries and packages like Dplyr, Ggplot2, shiny, Janitor a
4 min read
Introduction
R Programming Language - IntroductionR is a programming language and software environment that has become the first choice for statistical computing and data analysis. Developed in the early 1990s by Ross Ihaka and Robert Gentleman, R was built to simplify complex data manipulation and create clear, customizable visualizations. Over ti
4 min read
Interesting Facts about R Programming LanguageR is an open-source programming language that is widely used as a statistical software and data analysis tool. R generally comes with the Command-line interface. R is available across widely used platforms like Windows, Linux, and macOS. Also, the R programming language is the latest cutting-edge to
4 min read
R vs PythonR Programming Language and Python are both used extensively for Data Science. Both are very useful and open-source languages as well. For data analysis, statistical computing, and machine learning Both languages are strong tools with sizable communities and huge libraries for data science jobs. A th
5 min read
Environments in R ProgrammingThe environment is a virtual space that is triggered when an interpreter of a programming language is launched. Simply, the environment is a collection of all the objects, variables, and functions. Or, Environment can be assumed as a top-level object that contains the set of names/variables associat
3 min read
Introduction to R StudioR Studio is an integrated development environment(IDE) for R. IDE is a GUI, where we can write your quotes, see the results and also see the variables that are generated during the course of programming. R Studio is available as both Open source and Commercial software.R Studio is also available as
4 min read
How to Install R and R Studio?Installing R and RStudio is the first step to working with R for data analysis, statistical modeling, and visualizations. This article will guide you through the installation process on both Windows and Ubuntu operating systemsWhy use R Studio? RStudio is an open-source integrated development enviro
4 min read
Creation and Execution of R File in R StudioR Studio is an integrated development environment (IDE) for R. IDE is a GUI, where you can write your quotes, see the results and also see the variables that are generated during the course of programming. R is available as an Open Source software for Client as well as Server Versions. 1. Creating a
5 min read
Clear the Console and the Environment in R StudioR Studio is an integrated development environment(IDE) for R. IDE is a GUI, where you can write your quotes, see the results and also see the variables that are generated during the course of programming. Clearing the Console We Clear console in R and RStudio, In some cases when you run the codes us
2 min read
Hello World in R ProgrammingWhen we start to learn any programming languages we do follow a tradition to begin HelloWorld as our first basic program. Here we are going to learn that tradition. An interesting thing about R programming is that we can get our things done with very little code. Before we start to learn to code, le
2 min read
Fundamentals of R
Basic Syntax in R ProgrammingR is the most popular language used for Statistical Computing and Data Analysis with the support of over 10, 000+ free packages in CRAN repository. Like any other programming language, R has a specific syntax which is important to understand if you want to make use of its features. This article assu
3 min read
Comments in RIn R Programming Language, Comments are general English statements that are typically written in a program to describe what it does or what a piece of code is designed to perform. More precisely, information that should interest the coder and has nothing to do with the logic of the code. They are co
3 min read
R-OperatorsOperators are the symbols directing the compiler to perform various kinds of operations between the operands. Operators simulate the various mathematical, logical, and decision operations performed on a set of Complex Numbers, Integers, and Numericals as input operands. R supports majorly four kinds
5 min read
R-KeywordsR keywords are reserved words that have special meaning in the language. They help control program flow, define functions, and represent special values. We can check for which words are keywords by using the help(reserved) or ?reserved function.Rhelp(reserved) # or "?reserved"Output:Reserved Key Wor
2 min read
R-Data TypesData types in R define the kind of values that variables can hold. Choosing the right data type helps optimize memory usage and computation. Unlike some languages, R does not require explicit data type declarations while variables can change their type dynamically during execution.R Programming lang
5 min read
Variables
R Variables - Creating, Naming and Using Variables in RA variable is a memory location reserved for storing data, and the name assigned to it is used to access and manipulate the stored data. The variable name is an identifier for the allocated memory block, which can hold values of various data types during the programâs execution.In R, variables are d
5 min read
Scope of Variable in RIn R, variables are the containers for storing data values. They are reference, or pointers, to an object in memory which means that whenever a variable is assigned to an instance, it gets mapped to that instance. A variable in R can store a vector, a group of vectors or a combination of many R obje
5 min read
Dynamic Scoping in R ProgrammingR is an open-source programming language that is widely used as a statistical software and data analysis tool. R generally comes with the Command-line interface. R is available across widely used platforms like Windows, Linux, and macOS. Also, the R programming language is the latest cutting-edge to
5 min read
Lexical Scoping in R ProgrammingLexical scoping means R decides where to look for a variable based on where the function was written (defined), not where it is called.When a function runs and it sees a variable, R checks:Inside the function, is the variable there?If not, it looks in the environment where the function was created.T
4 min read
Input/Output
Control Flow
Control Statements in R ProgrammingControl statements are expressions used to control the execution and flow of the program based on the conditions provided in the statements. These structures are used to make a decision after assessing the variable. In this article, we'll discuss all the control statements with the examples. In R pr
4 min read
Decision Making in R Programming - if, if-else, if-else-if ladder, nested if-else, and switchDecision making in programming allows us to control the flow of execution based on specific conditions. In R, various decision-making structures help us execute statements conditionally. These include:if statementif-else statementif-else-if laddernested if-else statementswitch statement1. if Stateme
3 min read
Switch case in RSwitch case statements are a substitute for long if statements that compare a variable to several integral values. Switch case in R is a multiway branch statement. It allows a variable to be tested for equality against a list of values. Switch statement follows the approach of mapping and searching
2 min read
For loop in RFor loop in R Programming Language is useful to iterate over the elements of a list, data frame, vector, matrix, or any other object. It means the for loop can be used to execute a group of statements repeatedly depending upon the number of elements in the object. It is an entry-controlled loop, in
5 min read
R - while loopWhile loop in R programming language is used when the exact number of iterations of a loop is not known beforehand. It executes the same code again and again until a stop condition is met. While loop checks for the condition to be true or false n+1 times rather than n times. This is because the whil
5 min read
R - Repeat loopRepeat loop in R is used to iterate over a block of code multiple number of times. And also it executes the same code again and again until a break statement is found. Repeat loop, unlike other loops, doesn't use a condition to exit the loop instead it looks for a break statement that executes if a
2 min read
goto statement in R ProgrammingGoto statement in a general programming sense is a command that takes the code to the specified line or block of code provided to it. This is helpful when the need is to jump from one programming section to the other without the use of functions and without creating an abnormal shift. Unfortunately,
2 min read
Break and Next statements in RIn R Programming Language, we require a control structure to run a block of code multiple times. Loops come in the class of the most fundamental and strong programming concepts. A loop is a control statement that allows multiple executions of a statement or a set of statements. The word âloopingâ me
3 min read
Functions
Functions in R ProgrammingA function accepts input arguments and produces the output by executing valid R commands that are inside the function. Functions are useful when we want to perform a certain task multiple times.In R Programming Language when we are creating a function the function name and the file in which we are c
5 min read
Function Arguments in R ProgrammingArguments are the parameters provided to a function to perform operations in a programming language. In R programming, we can use as many arguments as we want and are separated by a comma. There is no limit on the number of arguments in a function in R. In this article, we'll discuss different ways
4 min read
Types of Functions in R ProgrammingA function is a set of statements orchestrated together to perform a specific operation. A function is an object so the interpreter is able to pass control to the function, along with arguments that may be necessary for the function to accomplish the actions. The function in turn performs the task a
6 min read
Recursive Functions in R ProgrammingRecursion, in the simplest terms, is a type of looping technique. It exploits the basic working of functions in R. Recursive Function in R: Recursion is when the function calls itself. This forms a loop, where every time the function is called, it calls itself again and again and this technique is
4 min read
Conversion Functions in R ProgrammingSometimes to analyze data using R, we need to convert data into another data type. As we know R has the following data types Numeric, Integer, Logical, Character, etc. similarly R has various conversion functions that are used to convert the data type. In R, Conversion Function are of two types: Con
4 min read
Data Structures
Data Structures in R ProgrammingA data structure is a particular way of organizing data in a computer so that it can be used effectively. The idea is to reduce the space and time complexities of different tasks. Data structures in R programming are tools for holding multiple values. Râs base data structures are often organized by
4 min read
R StringsStrings are a bunch of character variables. It is a one-dimensional array of characters. One or more characters enclosed in a pair of matching single or double quotes can be considered a string in R. It represents textual content and can contain numbers, spaces, and special characters. An empty stri
6 min read
R-VectorsR Vectors are the same as the arrays in R language which are used to hold multiple data values of the same type. One major key point is that in R Programming Language the indexing of the vector will start from '1' and not from '0'. We can create numeric vectors and character vectors as well. R - Vec
4 min read
R-ListsA list in R programming is a generic object consisting of an ordered collection of objects. Lists are one-dimensional, heterogeneous data structures. The list can be a list of vectors, a list of matrices, a list of characters, a list of functions, and so on. A list in R is created with the use of th
6 min read
R - ArrayArrays are important data storage structures defined by a fixed number of dimensions. Arrays are used for the allocation of space at contiguous memory locations.In R Programming Language Uni-dimensional arrays are called vectors with the length being their only dimension. Two-dimensional arrays are
7 min read
R-MatricesR-matrix is a two-dimensional arrangement of data in rows and columns. In a matrix, rows are the ones that run horizontally and columns are the ones that run vertically. In R programming, matrices are two-dimensional, homogeneous data structures. These are some examples of matrices:R - MatricesCreat
10 min read
R-FactorsFactors in R Programming Language are used to represent categorical data, such as "male" or "female" for gender. While they might seem similar to character vectors, factors are actually stored as integers with corresponding labels. Factors are useful when dealing with data that has a fixed set of po
4 min read
R-Data FramesR Programming Language is an open-source programming language that is widely used as a statistical software and data analysis tool. Data Frames in R Language are generic data objects of R that are used to store tabular data. Data frames can also be interpreted as matrices where each column of a matr
6 min read
Object Oriented Programming
R-Object Oriented ProgrammingIn R, Object-Oriented Programming (OOP) uses classes and objects to manage program complexity. R is a functional language that applies OOP concepts. Class is like a car's blueprint, detailing its model, engine and other features. Based on this blueprint, we select a car, which is the object. Each ca
7 min read
Classes in R ProgrammingClasses and Objects are core concepts in Object-Oriented Programming (OOP), modeled after real-world entities. In R, everything is treated as an object. An object is a data structure with defined attributes and methods. A class is a blueprint that defines a set of properties and methods shared by al
3 min read
R-ObjectsIn R programming, objects are the fundamental data structures used to store and manipulate data. Objects in R can hold different types of data, such as numbers, characters, lists, or even more complex structures like data frames and matrices.An object in R is important an instance of a class and can
3 min read
Encapsulation in R ProgrammingEncapsulation is the practice of bundling data (attributes) and the methods that manipulate the data into a single unit (class). It also hides the internal state of an object from external interference and unauthorized access. Only specific methods are allowed to interact with the object's state, en
3 min read
Polymorphism in R ProgrammingR language implements parametric polymorphism, which means that methods in R refer to functions, not classes. Parametric polymorphism primarily lets us define a generic method or function for types of objects we havenât yet defined and may never do. This means that one can use the same name for seve
6 min read
R - InheritanceInheritance is one of the concept in object oriented programming by which new classes can derived from existing or base classes helping in re-usability of code. Derived classes can be the same as a base class or can have extended features which creates a hierarchical structure of classes in the prog
7 min read
Abstraction in R ProgrammingAbstraction refers to the process of simplifying complex systems by concealing their internal workings and only exposing the relevant details to the user. It helps in reducing complexity and allows the programmer to work with high-level concepts without worrying about the implementation.In R, abstra
3 min read
Looping over Objects in R ProgrammingOne of the biggest issues with the âforâ loop is its memory consumption and its slowness in executing a repetitive task. When it comes to dealing with a large data set and iterating over it, a for loop is not advised. In this article we will discuss How to loop over a list in R Programming Language
5 min read
S3 class in R ProgrammingAll things in the R language are considered objects. Objects have attributes and the most common attribute related to an object is class. The command class is used to define a class of an object or learn about the classes of an object. Class is a vector and this property allows two things:  Objects
8 min read
Explicit Coercion in R ProgrammingCoercing of an object from one type of class to another is known as explicit coercion. It is achieved through some functions which are similar to the base functions. But they differ from base functions as they are not generic and hence do not call S3 class methods for conversion. Difference between
3 min read
Error Handling