Graphics, Tables and Basic

Statistics
Lecture Objectives :
 Review approaches to visually displaying Data.
 Graphics that display key statistical features of measurements from a
sample.
 Define the distribution of a set of data.
 Review common basic statistics.
• Extremes (Minimum and Maximum)
• Central Tendency ( Mean, Median)
• Spread (Range, Variance, Standard Deviation)
 Review not so common basic statistics.
• Extremes (upper and lower quartiles)
• Central Tendency (Mode, Winsorized Mean)
• Spread (Interquartile Range)
 Graphics

The visual portrayal of quantitative information

Are used to: Graphical Display
• Display the actual data table Objectives
• Display quantities derived from the
• Tabulation
data
• Description
• Show what has been learned
• Illustration
about the data from other analyses
• Exploration
• Allow one to see what may be
occurring in the data over and
above what has already been
described

“A picture is worth a
thousand words…”
 Objectives
As you create graphics keep the following in mind.

 Avoid distortion of the true story.

 Induce the viewer to think about the substance,
not the graph.
 Reveal the data at several layers of detail.
 Encourage the eye to compare different
pieces.
 Support the statistical and verbal descriptions
of the data.
 Nutrient Profiles for Selected Candy
Chocolate Manufacturers Association
National Confectioners Association Standard data format
7900 Westpark Blvd. Suite A 320, McLean, Virginia 22102
URL: http://www.candyusa.org/nutfact.html

Qualitative characteristic Quantitative characteristics

Example Data

STA6166-2-5
Candy data as Excel spreadsheet
 Af
te
rD
in
ne

0
50
100
150
200
250
rM
C in
an t
d y
C C
he or
w n
in
G g
um Gu
m m
y
Column chart

Li Be
co ar
ric s
M e Tw
ilk is
Ch ts
M o co
ilk la
C ...
ho
M co
la
ilk
C ...
ho
co

What are the problems with this graph?

la
Pe ...
ct
in
Calories in Common Candies

Sl
ic
So es
ur
Ba
lls

Ta
ff y
Display the data table
 C
he
w

50
100
150
200
250

0
in
g
G
Bu um
t te
rs
co
tc
h

the data.
Lo
l li
po
So p
ur
B
St al
ar ls
l ig
Se ht
m M
iS in
w ts
ee
tC T of
ho fe
co e
la
te
G C
hi
um ps
m
y
Li Be
co ar
Alternate Display

ric s
eT
w
is
Pe ts
ct
in
Af Sl
te ic
rD es
in
ne
rM
C in
an t
dy
C
or
n
M C
i lk a ra
C m
ho el
co Je s
la ll y
te
C B ea
ov ns
er
M ed
R
i lk
C ai
si
ho ns
Calories in Common Candies

co
la
te Ta
M ffy
al
te
dM
i lk
Pe Ba
an l ls
D
M a rk
ut
Br
i lk C itt
C ho le
ho co
co la
la te
te Ba
M A r
lm
i lk M on
C i lkC d
ho Ba
co ho
la co r
te la
Sorting and expanding the scale of the graph allows all

C t e
ov B
er ar
labels to be seen as well as displaying a characteristic of

ed
Pe
an
ut
s
 Vertical Display of Data
Calories in Common Candies

MilkChocolate Bar

DarkChocolateBar

MilkChocolateMaltedMilkBalls

MilkChocolateCoveredRaisins

Caramels

AfterDinnerMint

LicoriceTwists

SemiSweetChocolateChips

StarlightMints

Lollipop

Chewing Gum

0 50 100 150 200 250

In this case, a vertical display allows better comparison of

calorie amounts.
 Pie Charts

Pie Chart of SatFatC

NoSatFat (13, 59.1%)

Pie Chart of protein

3 ( 3, 13.6%)
1 ( 3, 13.6%)

6 ( 1, 4.5%)

4 ( 1, 4.5%)
SatFat ( 9, 40.9%)

0 (14, 63.6%)

A pie chart is good for making relative comparisons among

pieces of a whole.
 Statistical Uses of Graphics
Describe Distributions of Measurements Compare Distributions
• Box & Whisker plot (Boxplot) • Multiple Box & Whisker plots
• Histogram

Associations and Bivariate Distributions

• Scatter plot
• Symbolic scatter plot
Multidimensional Data Displays
• All pairwise scatter plot
• Rotating scatter plot
Graphical Methods in Support of Statistical Inference
• Regression lines Most of these
• Residual plots will be
• Quantile-quantile plots demonstrated
• Cumulative distribution function plots at some point
• Confidence and prediction interval plots in the course.
• Partial leverage plots
• Smoothed curves
 Basic Statistics
Before we get more into statistical uses of graphics, we
need to define some basic statistics. These statistics are
typically referred to as “descriptive statistics”, although
as we will see, they are much more than that. These
basic statistics address specific aspects of the
distribution of the data.

• What is the range of the data?

• When we sort the data, what number might we see
in the “middle” of the range of values?
• What number tells us over what sub range do we
find the bulk of the data ?

We will use the calorie data to illustrate.

 Extremes
First, if we sort the data we can immediately identify the
extremes.
Extremes
• Minimum(calories) = 10
• Maximum(calories) = 210

The minimum and maximum are “statistics”.

Reminder: A statistic is a function of the data. In this

case, the function is very simple.

10 60 60 60 60 60 70 130 140 140 160 160 160 160 160 160 180 180 200 210 210 210
 Range

Range: the difference between the largest and

smallest measurements of a variable.

Extremes
•Minimum(calories) = 10 Range = 210-10 = 200
•Maximum(calories) = 210

Tells us something about the spread of the data.

The middle of the range is a measure of the “center” of

the data.
Midrange = minimum + (Range/2)
=10 + 200/2
=110
Is it a “good” measure of the center of the data?
 Measures of Central Tendency
Estimate the value that is in the center of the
“distribution” of the data .
Median = middle value in the sorted list of n numbers: at position (n+1)/2
= unique value at (n+1)/2 if n is an odd number or
= average of the values at n/2 and n/2+1 if n is even
= (160 + 160)/2 = 160

Mean = sum of all values divided by number of values (average)

= (10 + 60 + 60 + 60 + … + 210 + 210)/22
= 133.6

Trimmed mean = mean of data where some fraction of the smallest and
largest data values are not considered. Usually the
smallest 5% and largest 5% values (rounded to nearest
integer) of data are removed for this computation.
= 136.0 (with 10% trimmed, 5% each tail).

Again – these are statistics (functions of the data)

 Mathematical Notation
We will need some mathematical notation if we are to
make any progress in understanding statistics. In
particular, since all statistics are functions of the data,
we should be able to represent these statistics
symbolically as equations using mathematical notation.
Let Y be the symbolic name of a random variable (e.g. a placeholder
for the true name of a variable – weight, gender, time, etc.) Let yi
symbolically represent the i-th value of variable Y, observed in the
sample. Let the symbol, S, represent the mathematical equation for
summation. Then the sample mean can be expressed as:
Number of observations
Symbolic “name” n
for sample mean
y i
y1  y2   yn
y i 1

n n
 Quartiles
Suppose we divide the sorted data into four equal parts. The values which
separate the four parts are known as the quartiles. The first or lower quartile
Q1, is the 25th percentile of the sorted data, the second quartile, Q2, is the
median and the third or upper quartile, Q3, is the 75th percentile of the data.
Because the sample size integer, n+1, does not always divide easily by 4, we do
some estimating of these quartiles by linear interpolation between values.

Here n=22, (n+1)/4=23/4=5.75, hence Q1 is three quarters between the 5th and 6th
observations in the sorted list. The 5th value is 60 and the 6th
value is 60, thus

60 + .75(60-60)=60.

For Q2, (n+1)/2 = 23/2 = 11.5, e.g. half way between the 11th and 12th obs.
Q2 = 160 + .5(160-160) = 160.

For Q3, 3(n+1)/4 = 3(23)/4 = 69/4 = 17.25, e.g a quarter of the way between the 17th
and 18th observations.
Q3 = 180 + .25(180-180) = 180

10 60 60 60 60 60 70 130 140 140 160 160 160 160 160 160 180 180 200 210 210 210
 Percentiles
100pth Percentile: that value in a sorted list of the data that
has approx p100% of the measurements below it
and approx (1-p)100% above it. (The p quantile.)
Distribution
function 0<p<1

Examples:
Q1 = 25th percentile
Q2 = 50th percentile
Q3 = 75th percentile

• Ott & Longnecker suggest finding a general 100pth percentile via a

complicated graphical method (pp. 87-90).
• We will relegate these elaborate calculations to software packages…
• We will however return to this later when we discuss QQ-Plots.
 Simplified Quartiles
A simpler way to find Q1 & Q3 is as follows:
1. Order the data from the lowest to the highest value, and find the
median.
2. Divide the ordered data into the lower half and the upper half, using
the median as the dividing value. (Always exclude the median itself
from each half.)
3. Q1 is just the median of the lower half.
4. Q3 is just the median of the upper half.

Ex: For the candy data we still get Q1=60 and Q3=180.

Ex: {3, 4, 7, 8, 9, 11, 12, 15, 18}.

We get Q1=(4+7)/2=5.5 and Q3=(12+15)/2=13.5.
 Measures of Variability
 Range
 Interquartile Range
 Variance
 Standard Deviation

Interquartile Range (IQR): Difference between the third

quartile (Q3) and the first quartile (Q1).

Quartiles:
Q1 = 25th = 60
Q2 = 50th = median = 160
Q3 = 75th = 180

IQR = Q3-Q1 = 180 - 60 = 120

 Variance and Standard Deviation

Variance: The sum of squared deviations Sample Mean

of measurements from their n

mean divided by n-1. y i

y i 1

n n

 iy  y 2

s2  i 1
n 1

Standard Deviation: The square

root of the variance. s  s2

Rough approximation for large n:

These measure the spread
srange/4.
of the data.
 Using Excel Data Analysis Tool
Under the “Tools” menu in
Excel there is a tool called
“Data Analysis”. This tool
is not normally loaded
when the Excel default
installation is used so you
may have to load it
yourself. This will require
the Excel CD. Use the
Tools > Add Ins option,
select the Data Analysis
tool and add it to your
menu.
Excel Data Analysis Tool
Select the Data Analysis Tool
Select Descriptive Statistics
The menu below appears.
Enter the Input Range and
check the output options
desired.
Excel Descriptive Statistics Output

You should be able to easily

identify the basic statistics we
have described so far.

Note: the variance is not in this

list. This is typical of statistics
packages. Since the variance is
simply the square of the
Standard Deviation, it is often
considered redundant.

Learn to use the Excel Help

files. Type “Statistic” in the
Excel Help Keyword dialog for
a list of helps available.
 Importing a text
data file in standard
format into Minitab

Pull down
menus

Session
worksheet
with script
commands

Spreadsheet
like data area
 Computing Descriptive
Stats

Descriptive Statistics

Variable N Mean Median TrMean StDev SEMean

calories 22 133.6 160.0 136.0 60.5 12.9

Variable Min Max Q1 Q3

calories 10.0 210.0 60.0 180.0
 Frequency Table
A tabular representation of a set of data.
A frequency table also describes the distribution of the
data and facilitates the estimation of probabilities.

The “Histogram” dialog in the Excel Data Mode = most

Analysis Tool can be used to create this table. abundant
But it is not straightforward.
 Stem and Leaf Plot

Rough grouping or “binning” of the data.

Histogram of calories N = 22
• A printer graph of the Midpoint Count
20 1 *
frequency table. 40 0
• Easy to do by hand. 60 5 *****
• Quick visualization of 80
100
1 *
0
the data. 120 0
140 3 ***
160 6 ******
180 2 **
200 1 *
220 3 ***
 Box Plot for Calories

A visualization of most of the basic statistics.

Maximum

Interquartile 200 75th percentile (Q3)

range Median (Q2)
calories

100

25th percentile (Q1)

0

Minimum

Box Plot
(SAS Proc Insight)

Is there an Excel Tool? No.

 Percentiles
100pth Percentile: that value in a sorted list of the data that
has approx p100% of the measurements below it
and approx (1-p)100% above it. (The p quantile.)
Smoothed
histogram 0<p<1

Examples:
Q1 = 25th percentile
Q2 = 50th percentile
Q3 = 75th percentile

A distribution is said to be symmetric if the distance from the median to the

100pth percentile is the same as the distance from the median to the
100(1-p)th percentile. Otherwise the distribution is said to be skewed.
In the case above, the distribution is skewed to the right since the right tail is
longer than the left tail.
 Frequency Histogram
A graphical presentation of the frequency table where the relative
areas of the bars are in proportion to the frequencies.

This is a frequency histogram

Frequency 9

6
F re q u e n c y

0 50 100 150 200

calories

Bin width
 Density Histogram

A density histogram (or simply a histogram) is

constructed just like a frequency histogram, but now the
total area of the bars sums to one. This is accomplished
by rescaling the vertical axis. Instead of frequencies, the
vertical axis records the rescaled value of the density.

Histograms have
important ties to
probability.

Sum of shaded area is equal to one.

 Number of Bins for Smoothed histogram or density curve.
Histograms

Six bins Five bins

How we view the

“distribution” of a dataset
can depend on how
much data we have and
how it is binned.
Eleven bins
 Scatterplot
Graphics to examine relationships

200 Is the relationship linear

or non-linear?
c alor ies

100

Beware, changing the relative

0

0 5 10 15
lengths of the axes can
totfat
change how the relationship is
perceived.

200
calories

100

0 5 10 15

totfat
 Matrix Plot

View multiple variables at one time.

Brushing the plot Three-D
to identify Views
interesting points.
Chernoff Faces

Displaying
multiple variables
symbolically.