A Quantitative Study of Quantile Based Direct
A Quantitative Study of Quantile Based Direct
137–166
Abstract. Eliciting priors from expert opinion enjoys more efficiency and re-
liability by avoiding the statistician’s potential subjectivity. Since elicitation on
the predictive prior probability space requires too-simple priors and may be bur-
dened with additional uncertainties arising from the response model, quantitative
elicitation of flexible priors on the direct prior probability space deserves much
attention. Motivated by precisely acquiring the shape information for the gen-
eral location-scale-shape family beyond the limited and simple location-scale fam-
ily, we investigate multiple numerical procedures for a broad class of priors, as
well as interactive graphical protocols for more complicated priors. We highlight
the quantile based approaches from several aspects, where Taylor’s expansion is
demonstrated to be an efficient approximate alternative to work on the regions
in which the shape parameter is highly sensitive. By observing inherent associa-
tions between the scale and shape parameters, we put more weight on practical
solutions under a proper sensitivity index (SI) rather than presumability. Our
proposed methodology is demonstrated through skew-normal and Gamma hyper-
parameter elicitation where the shape parameter is numerically solved in a stable
way. The performance comparisons among different elicitation approaches are also
provided.
Keywords: location parameter, prior elicitation, quantile, scale parameter, shape
parameter, skewness, Taylor’s expansion
1 Introduction
Bayesian analysis is markedly recognized by the subjective probability belief, or quan-
titative a priori description of unknown parameter θ. Without external support statis-
ticians can only implement the whole computational process at his/her own will, say
conjugate priors, Jeffreys’ priors and others. On the other hand, expert opinion may
be helpful when we investigate new, rare, complex or poorly understood phenomena.
Multivariate-normal related prior elicitation on the predictive prior space by requesting
response summaries from experts was developed by Kadane, et al (1980), Garthwaite
and Dickey (1988), Al-Awadhi and Garthwaite (1998) among others. However, those
algorithms were limited to simple normal linear or AR(1) time series models. On the
other hand, direct non-informative prior elicitation was discussed through piecewise
conjugate priors (Meeden, 1992), entropy based priors (Jaynes, 1968, 1983), mixture
of natural conjugate priors (Dalal and Hall, 1983) and others. Quantile based univari-
∗ Department
of Statistics, University of Connecticut, Storrs, CT, http://www.stat.uconn.edu/~dey
∗ Department of Statistics, West Virginia University, Morgantown, WV,
mailto:[email protected]
ate prior elicitation for simple cases, say symmetric ones, was studied by Peterson and
Miller (1964), Garthwaite and Dickey (1985), O’Hagan (1998) among others. A recent
comprehensive review on probability elicitation was written by Garthwaite, Kadane and
O’Hagan (2005). Berger (1985, Chapter 3) also discussed subjective prior determination
on the direct prior space by showing that a lack of sufficient tail information in con-
tinuous parameter space causes much difficulty for most of the approaches in practice,
including the “histogram” approach, the “relative likelihood” approach, the entropy
based method, and even the most used “matching a given functional form” method
which often needs prior moments and others. Berger (1985, Chapter 3) envisioned that
a quantile based approach poses as a better method since estimation of probabilities of
regions are more attractive than working on moments. However, two situations deserve
caution in application of quantile approaches: disagreement among multiple quantiles
and incidental matching by multiple functional forms (Berger, 1985, Chapter 3). The
key point to ease these concerns is to efficiently and precisely recover flexible parametric
priors in a quantitative way other than those weak symmetric ones in order to imple-
ment the “sketching” principle (Berger, 1985, Chapter 3) for the downstream graphical
verification. In this paper, we propose efficient quantile based approaches for direct
prior elicitation with quantitative examples, and study a broad class of parametric pri-
ors with a focus on asymmetric cases, which have yet received little attention.
The paper is organized as follows: Section 2 develops approximate and exact quantile
based numerical elicitation algorithms for general symmetric and skewed priors; Section
3 introduces Taylor’s expansion as an efficient tool for joint scale-shape parameter elic-
itation in sensitive regions and makes comparison among multiple expansion options
with skew-normal and Gamma distributions as examples; Section 4 provides interactive
graphical display procedures, especially for more complicated Student’s t related prior
elicitation; and Section 5 concludes the paper with future directions.
IQR
µ̂N = q0.50 and σ̂N = respectively. (1)
Zq
Dey and Liu 139
Note that, normal distribution is symmetric and shape parameter free. If both the ex-
perimenter and the expert agree on the symmetry, then only two quantiles are necessary.
2
a folded normal random variable, e.g., the positive part of N (0, σZ ) random variable,
is a normal random variable with mean µ and variance σ , and Z + is independent of .
2
The pdf of X is
f (x|c, µ, σZ , σ ) = √ 2
2 +σ 2
φ( √ 2x−µ
2 +σ 2
)Φ( cσ
σ
Z √ (x−µ)
2 2
),
c2 σ Z c σZ c σZ +σ2
p
where σ (= c2 σZ 2 + σ 2 ) is the scale parameter, λ=( cσZ ) is the skewness (shape) pa-
σ
rameter, and µ is the location parameter. The derivation is given in Sahu, Dey and
Branco (2003). When c = 0, we have an ordinary normal distribution. Under reparam-
eterization Y = X−µσ , we get the simplified density function of f (y|λ) = 2φ(y)Φ(λy)q
which is the skew-normal density function given by Azzalini (1985), with E(Y ) = π2 δ
q
and D(Y ) = 1 − π2 δ 2 , where δ = √1+λλ
2
. In the general case, E(X) = µ + σ 2
π δ and
D(X) = σ 2 (1 − π2 δ 2 ).
R Qq (λ)
Theorem 1 Assume −∞ 2φ(x)Φ(λx)dx = q; where, q th quantile Qq (λ) is de-
termined by λ, the skewness parameter. Then (i) Qq (−λ) = −Q1−q (λ); (ii) ∀λ ∈
φ(λQq (λ))
(−∞, 0], q ∈ [0, 1], Q0q (λ) = (1+λ2 )Φ(λQ q (λ))
.
The proof is given in the appendix. We can see that, ∀λ ∈ (−∞, 0], Q0.50 (−λ) =
−Q0.50 (λ) and Q00.50 (−λ) = Q00.50 (λ); the median of cZ + + is not equal to the median
of cZ + plus the median of , since Qq (λ) is not a linear function of λ. The boundary
condition q determines the individual solution from the nonlinear ordinary differential
φ(λQq (λ))
equation Q0q (λ) = (1+λ2 )Φ(λQ q (λ))
. Conditional on the skewness (shape) parameter λ, we
use the notation IQRR(λ) to represent the inter-quartile range ratio of (q0.75,λ − q0.50,λ )
to (q0.50,λ − q0.25,λ ), a monotonic function of λ (Section 2.2). Presumably, the skewness
(shape) parameter λ can be obtained by checking the look-up table of the ratio of
IQRR(λ) to λ. However, the top-right panel of Figure 1 shows that, a small change of
the IQRR(λ) leads to a large change of hyperparameter λ when λ is close to zero, say
|λ| < 1, which is not our expectation. Thus “IQRR(λ) vs. λ” is not a good elicitation
method for λ. To formalize this scenario, we define the sensitivity index (SI) as
for which we expect a moderate magnitude (∼1). For example, in the top-right panel
of Figure 1, the elicitation input is IQRR and the hyperparameter is λ. The guideline
is to work on “elicitation input vs. hyperparameter” curves with moderate derivative
or sensitivity index (SI), say around 1. We first consider the regions in which the
shape parameter is not sensitive (|λ| > 1) by the following one-way procedure, and the
sensitive regions will be discussed on in Section 3. The rationale for choosing 1 as the
λ critical value will be described later in Remark 1.
Dey and Liu 141
(x−µ)2
Γ( ν+1 (x−µ)2 − ν+1 ν+ η2 +c2
2 )
)− 2 ηc √(x−µ)
2 1
f (x|c, µ, η, ν) = √ 1 (1 + ν(η 2 +c2 ) )
2 T
1,ν+1 [( ν+1 ],
c2 +η 2 Γ( ν2 )(νπ) 2 2
η +c 2
p
where σ (= c2 + η 2 ) is the scale parameter, λ (= ηc ) is the skewness (shape) parameter,
µ is the location parameter, and ν is the degrees of freedom. The derivation is given
in Sahu, Dey and Branco (2003). When c = 0, we have an ordinary Student’s t-
distribution. Under reparameterization of Y = X−µ σ , we get the simplified density
function of
Γ( ν+1
2 ) y 2 − ν+1 ν+y 2 − 1
f (y|λ, µ, σ, ν) = 2 1 (1 + ν )
2 T
1,ν+1 [( ν+1 ) 2 λy].
Γ( ν2 )(νπ) 2
A different attribute for skew Student’s t-distribution is that, the nominal location-scale-
shape family is conditional on the degrees of freedom ν by observing that ν cannot be
combined with λ to form a composite shape parameter. From Figure 2, we note that, the
inter-quartile information of skew Student’s t-distribution highly depends on the degrees
of freedom ν; when ν reaches a value to approach the limiting normal distribution, the
sensitivity index (SI) in the top-right panel gets substantially larger than 1, as skew-
normal does (Figure 1). Conditioning on ν, the elicitation procedure is the same as that
in Section 2.4 when λ is not close to 0, say |λ| > 1, and the sensitive regions will be
discussed on in Section 3.
2
α
σ exp(− α2 ) exp(−α x−δ x−δ
σ )Φ( σ ).
The mean is δ + σ( α1 − α), where σ (=η) is the scale parameter, α (= λη ) is the shape
2
parameter and δ (=µ + ηλ ) is the location parameter. The proof is a matter of in-
tegration. The superficial skewness is produced by the normal part, other than the
exponential part. As α approaches zero, the normal-exponential density becomes a flat
degenerate density; as α exceeds two, the density becomes an approximate normal den-
sity (Figure 3), where leftward displacement induced by the combination of shape and
scale parameters is observed. Although the curves are quite steep in the IQR vs. α
plot, reasonable sensitivity index (SI) is reached after taking 5th root (bottom-middle
and bottom-right, Figure 4). The parameter elicitation procedure at α > 0.15, where
the IQRR is substantially away from the limit 1.7107 as α departs from 0, is similar
to skew-normal case (Section 2.4). We observe that, the skewness parameter elicitation
is sensitive for skew-normal and normal-exponential priors when the true value is close
to zero, while it is less sensitive for skew Student’s t case under small degrees of freedom.
(1)
Fλ,µ,σ (q0.75 ) ≈ Fλ,µ,σ (g(?)) + fλ,µ,σ (g(?))(q0.75 − g(?)) + 12 fλ,µ,σ (g(?))(q0.75 − g(?))2 · · ·
(1) .
Fλ,µ,σ (q0.25 ) ≈ Fλ,µ,σ (g(?)) + fλ,µ,σ (g(?))(q0.25 − g(?)) + 21 fλ,µ,σ (g(?))(q0.25 − g(?))2 · · ·
(2)
P∞ 1 (k)
∆= k=1 k+1 fλ,0,1 (g(λ))[(q0.75,λ − g(λ))k+1 − (q0.25,λ − g(λ))k+1 ].
Then
−2∆
(i) the relative error of the scale parameter elicitation by 2IQRfλ,0,1 (g(λ)) is 1−2∆ ,
a function only associated with the shape parameter λ;
1
(ii) ∆ = 2 − fλ,0,1 (g(λ))IQR(λ), where IQR(λ) is the standardized IQR under Fλ,0,1 .
The proof is given in the appendix. For g(λ) = mode function M (λ), mean function
E(λ) or median function q0.50 (λ), we have the following observations:
1
2 −∆
Corollary 1 IQR(λ) = fλ,0,1 (g(λ)) .
P∞ q
1 (k)
limλ→0 k=1 k+1 fλ,0,1 (g(λ))[(q0.75,λ − g(λ))k+1 − (q0.25,λ − g(λ))k+1 ] = 21 (1 − 2
π Zq ).
We point out that (2) seems to work for many flexible location-scale-shape classes
(details later, in Propositions 3, 4). Suppose f is the probability density function of
general Student’s t-distribution with ν degrees of freedom (shape parameter) and inter-
144 Quantile based direct prior elicitation
quantile range IQR, then we get the following approximation (after neglecting the error)
p 1 Γ( ν+1
2 ) (q0.50 − µ)2 − ν+1
=√ ν (1 + ) 2 , (3)
IQR νπσ Γ( 2 ) νσ 2
where µ is the location parameter and σ is the scale parameter. Then µ̂ = q0.50 is the
estimate of the prior mean (location parameter), and the approximate estimate of σ can
be obtained as
IQR Γ( ν+1
2 )
σ̂ = √ . (4)
p νπ Γ( ν2 )
other values will lead to the normal distribution. Theoretically, If we assume symmetry
a priori, then eliciting degrees of freedom ν and the scale parameter σ concurrently
is not possible, since these two parameters are mutually determined within a certain
domain for σ (Figure 7).
IQR
q0.50 σ − lnσ = ln( ). (5)
p
IQR IQR
p= √ , thus σ̂ = √ . (6)
q0.50 2πσ q0.50 2πp
The exact σ elicitation under log-transformation is Z∆q , where ∆ is ln( qq0.75 ), and (6) be-
q 0.25
comes π2 (e∆ − e−∆ ). The ratio of the approximate and exact scale elicitation is thus
q 2
approximately π2 Zq (1 + ∆6 ) with quadratic increment of ∆. The weakness of Taylor’s
expansion may be due to the fact that, log-normal distribution is not a location-scale
family member.
IQR
For the skew-normal case (Section 2.4), the exact scale elicitation is IQR(λ) , where
IQR(λ) is the IQR for the standard skew-normal distribution with location parameter
0, scale parameter 1 and skewness (shape) parameter λ.
q
2
. If we apply Taylor’s expansion at the location parameter µ, then σ̂ = π IQR,
thus location based expansion makes use of no skewness
q information. The ratio
2
of the approximate to the exact scale elicitation is π IQR(λ).
q
. If we apply Taylor’s expansion at mean Eλ = π2 √1+λ λ
2
, then σ̂ is [2φ(Eλ )Φ(λEλ )]
IQR/p, where p=0.50 and Eλ is the mean of the standardized skew-normal distri-
bution with location parameter 0, scale parameter 1 and skewness parameter λ.
The ratio of the approximate to the exact scale elicitation is IQR(λ)[2φ(E λ )Φ(λEλ )]/p.
146 Quantile based direct prior elicitation
Remark 1 The scale parameter σ elicitation based on (2) expanded at the location
parameter µ leads to identical results under naive normal or skew-normal distributions.
If we ignore the skewness completely by assuming naive normal, then the elicited scale
IQR
parameter σ is Zq accordingly. All of these options are compared by a “whiskers” plot
(Figure 8). Except for the native normal based approximation, all skew-normal based
approximations are visually undistinguishable as horizontal segments expanding from
∼-1 to ∼1, which is exactly where λ is highly sensitive to the IQRR(λ) (the top-right
panel of Figure 1), also represented by a horizontal segment expanding from ∼-1 to ∼1.
Thus the sensitive region and the critical value of λ are to be identified visually. Over-
all, the performance ordering may be Taylor’s expansion at: median, mean, mode, and
location. We envision that this observation also works for skew Student’s t conditional
on the degrees of freedom ν. Thus quantile (probability) based prior elicitation could
increase the potential flexibility and efficiency.
IQR
For the normal-exponential case (Section 2.6), the exact scale elicitation is IQR(α) ,
where α is the shape parameter, and IQR(α) is the IQR for the standard normal-
exponential distribution with location parameter 0 and scale parameter 1. Again,
p=0.50.
2
α
. If we apply Taylor’s expansion at the location parameter δ, then σ̂= 2p exp(− α2 )IQR,
in contrast to skew-normal case, location based expansion incorporates the shape
α2
information. The ratio of the approximate to the exact scale elicitation is 2p
α exp( 2 )
IQR(α).
2
. If we apply Taylor’s expansion at mean Eα =σ( α1 − α), then σ̂ = αp exp( α2 −
1)Φ( α1 − α)IQR. The ratio of the approximate to the exact scale elicitation is
α α2 1
p exp( 2 − 1)Φ( α − α)IQR(α).
. If we apply Taylor’s expansion at mode Mα which does not have an explicit for-
2
mula, then σ̂ = αp exp[−( α2 + αMα )]Φ(Mα )IQR. The ratio of the approximate to
Dey and Liu 147
2
α
the exact scale elicitation is p exp[−( α2 + αMα )]Φ(Mα )IQR(α).
2
. If we apply Taylor’s expansion at median q0.50,α , then σ̂ is αp exp[−( α2 + αq0.50,α )]
Φ(q0.50,α )IQR. The ratio of the approximate to the exact scale elicitation is
α α2
p exp[−( 2 + αq0.50,α )]Φ(q0.50,α )IQR(α).
Remark 2 The comparisons are given by a “whiskers” plot (Figure 9), where the
location or median based approximation performs more stably and retains more pro-
portional high-fidelity (≈1.09) than others at small α. Note that the location based
approximation takes into account the shape information, which is a different attribute
from skew-normal and skew Student’s t. The performance ordering may be Taylor’s ex-
pansion at: median, location, mean and mode at small α; at large α, the location based
approximation cannot be used since the shape and scale parameters jointly induces
large location displacement, and all other approximations have visually undistinguish-
able performances.
1. Start with current λ, apply the first order Taylor’s expansion at median q0.50,λ with
location parameter 0 and scale parameter 1. Then σ̂ is IQR[2φ(q0.50,λ )Φ(λq0.50,λ )]/p,
the elicited scale parameter is √ σ̂2 , and the standardized (q0.75,λ -q0.50,λ ) is (q0.75 -
π Zq
2. The skewness parameter λ can be obtained by (q0.75,λ −q0.50,λ ) vs. λ plot (bottom-
left, Figure 1) under moderate sensitivity index (∼1). Note that, one-to-two
matching around small λ is not an issue, since the sign of λ is correctly kept.
4. The location parameter µ is simply q0.25 −σq0.25,λ , q0.50 −σq0.50,λ or q0.75 −σq0.75,λ .
q
1. Start with current λ, apply the first order Taylor’s expansion at mean Eλ = π2 √1+λ λ
2
with location parameter 0 and scale parameter 1. Then σ̂ is IQR[2φ(Eλ )Φ(λEλ )]/p,
the elicited scale parameter is √ σ̂2 , and the standardized (q0.75,λ -q0.50,λ ) is (q0.75 -
π Zq
2. The skewness parameter λ can be obtained by (q0.75,λ −q0.50,λ ) vs. λ plot (bottom-
left, Figure 1) under moderate sensitivity index (∼1). Note that, one-to-two
matching around small λ is not an issue, since the sign of λ is correctly kept.
4. The location parameter µ is simply q0.25 −σq0.25,λ , q0.50 −σq0.50,λ or q0.75 −σq0.75,λ .
q
1. Start with current λ, apply the first order Taylor’s expansion at mode Mλ = π2 √1+λ λ
2
with location parameter 0 and scale parameter 1. Then σ̂ is IQR[2φ(Eλ )Φ(λEλ )]/p,
the elicited scale parameter is √ σ̂2 , and the standardized (q0.75,λ -q0.50,λ ) is (q0.75 -
π Zq
2. The skewness parameter λ can be obtained by (q0.75,λ −q0.50,λ ) vs. λ plot (bottom-
left, Figure 1) under moderate sensitivity index (∼1). Note that, one-to-two
matching around small λ is not an issue, since the sign of λ is correctly kept.
4. The location parameter µ is simply q0.25 −σq0.25,λ , q0.50 −σq0.50,λ or q0.75 −σq0.75,λ .
1. Start with current λ, (q0.75,λ − q0.25,λ ) vs. λ plot (Figure 1) with moderate sensi-
tivity index (∼1). The elicited σ is (q0.75 − q0.25 )/(q0.75,λ − q0.25,λ ).
2. The skewness parameter λ can be obtained by (q0.75,λ −q0.50,λ ) vs. λ plot (bottom-
left, Figure 1) under moderate sensitivity index (∼1).
4. The location parameter µ is simply q0.25 −σq0.25,λ , q0.50 −σq0.50,λ or q0.75 −σq0.75,λ .
Dey and Liu 149
Remark 3 We create the (q0.25,λ , q0.50,λ , q0.75,λ ) vs. λ look-up table (the top-left
panel of Figure 1), where the λ step is 0.01, the iteration involves obtaining the optimal
λ given (q0.75,λ − q0.50,λ ) and the optimal (q0.75,λ − q0.25,λ ) given λ, till convergence.
The one-way elicitation of λ followed by σ (Section 2.4) is replaced by a two-way joint
λ and σ elicitation. The elicitation comparison is given in Table 1, and Figures 11
through 14, where ratios are calculated at all declared 50% quantiles (from 0.01 to 0.20
with step 0.01). The IQR, mean and median based Taylor’s expansion iterations are
consistent, while mode based Taylor’s expansion iteration is likely to be less satisfactory.
Compared to the IQR based iteration, we recommend the explicit mean based Taylor’s
expansion in view of numerical stability. In the top-right panel of Figure 1, when the
IQRR varies within a very short range around 1.0, the λ ranges among [-1,1], leading
to a sensitivity index with a huge magnitude. Under iterative elicitation procedures,
highly sensitive regions are avoided, and the applied regions in the IQR(λ) vs. λ plots
(the bottom-left and bottom-right panels of Figure
q 1) show a workable sensitivity
q index
3
(∼1). By observing that, the standard mean π2 √1+λ λ
2
has a derivative π2 (1 + λ2 )− 2
(∼1 at small λ) and conclusion (ii) in Theorem 2, we conclude that, iteration by Taylor’s
expansion at mean will work well under moderate sensitivity index. Generally, ∂shape
parameter/∂standardized IQR needs to be moderate in order to apply the iterative
algorithms, similar procedures will apply to the normal-exponential prior and skew
Student’s t prior conditional on the degrees of freedom ν. Because the standard IQRs are
tabulated by numerical integration which is subject to accuracy evaluation for irregular
skewed classes, we prefer an explicit expression involved in the algorithm, such as mean
based Taylor’s expansion. One piece of evidence is seen in Table 1, where there is a
switching between two elicited λ’s at q0.50 =0.07 and q0.50 =0.08.
1. Start with current α, (q0.75,α − q0.50,α ) vs. α plot (Figure 5) with sensitivity index
∼10, the elicited β is (q0.75 − q0.50 )/(q0.75,α − q0.50,α ).
2. The shape parameter α can be obtained by (q0.50,α − q0.25,α ) vs. α plot, where
(q0.50,α − q0.25,α )=(q0.50 − q0.25 )/β.
3. Repeat 1-2 until convergence (complete α and β).
4. The location parameter µ is simply q0.25 −βq0.25,α , q0.50 −βq0.50,α or q0.75 −βq0.75,α .
150 Quantile based direct prior elicitation
Remark 4 IMSL library is used to call the gamin function to return the standard
quantiles for arbitrary α (Table 2). We create the look-up table of (q0.25,α , q0.50,α ,
q0.75,α ) vs. α, where the α step is 0.001, the iteration alternates between finding the
optimal α given (q0.50,α − q0.25,α ) and finding the optimal (q0.75,α − q0.50,α ) given α
from the look-up table (the lower panels of Figure 5), till convergence. The one-way
elicitation of α followed by β (the top-right panel of Figure 5) is replaced by a two-way
joint elicitation of α and β. The comparison is given in Table 2. where the numerical
difference is substantially greater than 0.001 (α step). One-way elicitation introduced in
Section 2.4 only works well for those regions where the shape parameter is not sensitive,
only two-way iterating elicitation works on regions where the shape parameter is highly
sensitive, including the IQR based iteration and Taylor’s expansion based iterations.
Unfortunately, we also observe those regions where both elicitations encounter high
sensitivity index (SI), such as the tail regions (λ approaches 10) in the lower panels of
Figure 1.
A. We consider ν = 1, 5, 10, 15, 30, . . . to apply the general procedure in Section 2.5,
with an exact or an approximate scale elicitation, to select the most agreeable ν
for skewed Student’s t prior by repeatedly drawing distribution shapes.
B. We start with a tentative ν out of (1, 5, 10, 15, 30,. . .) to obtain σ̂ in an exact
way, then immediately update the degrees of freedom for Student’s t-distribution
by reverse of (4) and show the distribution shape to the expert in order to make
an exploratory effort to reach an agreement on ν.
Other Cases
C. The expert provides his/her opinion in the form of a graph, then we estimate
q0.25 , q0.50 and q0.75 directly from the graph. If the graph is close to symmetric
normal we use (1); if it is close to log-normal with a positive domain, we apply
Proposition 1; if it is close to symmetric heavier tail, we go to option [B].
IQR 1 Γ( ν12+1 )
µ̂ = q0.50 and σ̂ = √ . (7)
p πν2 Γ( ν21 )
Note that the only difference between (4) and (7) is the presence of ν2 in the denomi-
nator, a very minor change in the code.
5 Concluding Remarks
We demonstrate that, for those univariate skewed priors belonging to location-scale-
shape families, the elicitation procedure on the non-sensitive regions is: shape param-
eter followed by the scale and location parameters. Moreover, we take the initiatives
to quantitatively study technical details for flexible direct prior elicitation, which will
streamline the induced interactive graphical procedures. The quantile based Taylor’s ex-
pansion approximation was interestingly found to enjoy sufficient efficiency to pinpoint
the scale parameter on shape-parameter sensitive regions, when the shape information is
incorporated for approximation. The exact procedure is in the sense of numerical com-
putation, and the iterative elicitation is numerically tested to be satisfactorily stable
and efficient. Prior elicitation from multiple expert opinions could be done by averaging
these summaries (Kadane, et al, 1980) or applying linear regression to take into account
multiple experts (Gill and Walker, 2005). Throughout we assumed that experts provide
a unimodal distribution, which is realistic in practice. However, if the experts believe
that the distribution could be multimodal then we have to consider discrete mixtures of
unimodal distributions. If the prior predictive space is necessary and a well-established
response model is available, then expert opinions on the response distribution may be
more practical. But we can envision that the calculation load will be much more in-
tensive under skewed priors. How to develop efficient prior elicitation algorithm under
that circumstance is another area of research.
152 Quantile based direct prior elicitation
R Qq (λ) R +∞
Proof of part 1. From 2 −∞ φ(x)Φ(λx)dx = q, we have 2 Qq (λ) φ(x)Φ(λx)dx =
R Qq (λ)
1 − q and 2 +∞ −φ(−x)Φ(λx)dx = 1 − q. Substituting y = −x, it follows that
R −Qq (λ)
2 −∞ φ(y)Φ(−λy)dy = 1 − q, which proves part 1.
Proof of part 2.
R Qq (λ+∆λ )
2φ(x)Φ((λ + ∆λ )x)dx
R−∞
Qq (λ) R Q (λ+∆ )
= 2φ(x)Φ((λ + ∆λ )x)dx + Qqq(λ) λ 2φ(x)Φ((λ + ∆λ )x)dx
R−∞
Qq (λ)
= −∞ 2φ(x)Φ((λ + ∆λ )x)dx (8)
+(Qq (λ + ∆λ ) − Qq (λ))2φ(pQq (λ) + (1 − p)Qq (λ + ∆λ ))
×Φ((λ + ∆λ )(pQq (λ) + (1 − p)Qq (λ + ∆λ ))), (∃p ∈ [0, 1])
R Qq (λ)
= −∞
2φ(x)Φ(λx)dx = q.
Thus,
R Qq (λ)
Letting ∆λ approach 0, we get −∞ 2xφ(x)φ(λx)dx +Q0q (λ)2φ(Qq (λ))Φ(λQq (λ)) =
0. The final result follows after some simplifications. Our result shows that Qq (λ) is
differentiable. The proof ends.
Proof of Theorem 2
Consequently,
Dey and Liu 153
1 1
P∞ 1 (k)
2 = σ fλ,0,1 (g(λ))IQR + k=1 k+1 fλ,0,1 (g(λ))[(q0.75,λ − g(λ))2 − (q0.25,λ − g(λ))2 ].
P∞ 1 (k) 2 2
Denote ∆= k=1 k+1 fλ,0,1 (g(λ))[(q0.75,λ − g(λ)) − (q0.25,λ − g(λ)) ], the relative error
(k) (k) (k)
f (g(λ)) f (g(λ)) fλ,0,1 (g(λ)) −2∆
for scale parameter elicitation is ( λ,0,1 0.50 − λ,0,1
0.50−∆ )/( 0.50−∆ ) = 1−2∆ .
The
second statement in Theorem 2 comes from the following fact: the true scale parameter
IQR
σ is equal to IQR(λ) by direct numerical calculation from the look-up table IQR(λ) vs.
IQRfλ,0,1 (g(λ))
λ, or 0.50−∆ by keeping the first term from the fully Taylor’s expansion. The
proof ends.
154 Quantile based direct prior elicitation
q0.50 λ σ µ
IQR median mean mode IQR median mean mode IQR median mean mode
0.01 -0.23 -0.23 -0.23 -0.23 15.06 15.07 15.07 15.07 2.69 2.69 2.69 2.69
0.02 -0.37 -0.32 -0.32 -0.32 15.42 15.29 15.29 15.29 4.26 3.70 3.70 3.70
0.03 -0.41 -0.41 -0.41 -0.41 15.56 15.56 15.56 15.56 4.69 4.69 4.69 4.69
0.04 -0.53 -0.54 -0.54 -0.54 15.99 16.04 16.04 16.04 5.93 6.04 6.04 6.04
0.05 -0.54 -0.55 -0.55 -0.55 16.03 16.08 16.08 16.08 6.04 6.15 6.15 6.15
0.06 -0.64 -0.56 -0.56 -0.56 16.44 16.12 16.12 16.12 7.00 6.24 6.23 6.24
0.07 -0.70 -0.67 -0.69 -0.67 16.70 16.58 16.66 16.58 7.56 7.30 7.47 7.30
0.08 -0.68 -0.68 -0.68 -0.71 16.62 16.62 16.62 16.76 7.39 7.39 7.39 7.67
0.09 -0.71 -0.72 -0.72 -0.72 16.74 16.80 16.80 16.80 7.65 7.75 7.74 7.75
0.10 -0.77 -0.82 -0.77 -0.85 17.01 17.25 17.02 17.40 8.17 8.62 8.18 8.88
0.11 -0.82 -0.85 -0.85 -0.86 17.23 17.39 17.38 17.44 8.60 8.87 8.86 8.95
0.12 -0.85 -0.86 -0.86 -0.89 17.37 17.43 17.42 17.58 8.85 8.94 8.93 9.21
0.13 -0.88 -0.89 -0.89 -0.92 17.50 17.57 17.56 17.72 9.08 9.19 9.18 9.43
0.14 -0.89 -0.92 -0.91 -0.95 17.55 17.71 17.65 17.86 9.17 9.41 9.33 9.67
0.15 -0.94 -0.95 -0.92 -1.01 17.78 17.85 17.69 18.14 9.55 9.65 9.40 10.12
0.16 -0.95 -1.01 -0.95 -1.03 17.83 18.12 17.83 18.23 9.64 10.10 9.63 10.26
0.17 -1.01 -1.03 -1.01 -1.04 18.09 18.21 18.09 18.28 10.07 10.24 10.07 10.33
0.18 -1.01 -1.04 -1.01 -1.11 18.09 18.25 18.09 18.60 10.07 10.30 10.07 10.82
0.19 -1.04 -1.09 -1.04 -1.24 18.24 18.48 18.22 19.18 10.29 10.65 10.27 11.66
0.20 -1.09 -1.11 -1.04 -1.26 18.46 18.57 18.22 19.27 10.62 10.78 10.27 11.80
Figure 2: Relationship between quantiles and skewness parameter λ for skew Student’s
q0.75,λ −q0.50,λ
t distribution. (Top-left: (q0.75,λ , q0.50,λ , q0.25,λ ) vs. λ; top-right: ( q0.50,λ −q0.25,λ ) vs. λ;
bottom-left: (q0.75,λ − q0.50,λ ) vs. λ; bottom-right: (q0.75,λ − q0.25,λ ) vs. λ)
Dey and Liu 157
0.010
0.08
α=0.1
0.008
α=0.01
0.06
0.006
0.04
f(x)
f(x)
0.004
0.02
0.002
0.000
0.00
x x
0.4
0.00 0.05 0.10 0.15 0.20 0.25 0.30
α=1 α=10
0.3
0.2
f(x)
f(x)
0.1
0.0
x x
Figure 3: Relationship between density function and shape parameter α for normal-
exponential distribution.
158 Quantile based direct prior elicitation
2.0
(q(0.75,α)−q(0.50,α)):((q(0.50,α)−q(0.25,α))
50
1.8
q(0.25,α), q(0.50,α), q(0.75,α)
40
1.6
30
1.4
20
1.2
10
1.0
0
0 10 20 30 40 50 0 10 20 30 40 50
α α
5
5
4
4
q(0.75, α)−q(0.50,α)
q(0.50, α)−q(0.25,α)
3
3
2
2
1
1
0
0 10 20 30 40 50 0 10 20 30 40 50
α α
Figure 5: Relationship between quantiles and shape parameter α for Gamma distribu-
tion. (Top-left: (q0.75,α , q0.50,α , q0.25,α ) vs. α; top-right: (q0.75,α − q0.50,α )/(q0.50,α −
q0.25,α ) vs. α; bottom-left: (q0.75,α − q0.50,α ) vs. α; bottom-right: (q0.50,α − q0.25,α ) vs.
α)
160 Quantile based direct prior elicitation
Figure 8: Scale parameter elicitation comparison for skew-normal. (Left and middle:
approximate σ/exact σ vs. λ, Right: mean, mode and median vs. λ.)
Figure 10: Generalized Student’s t probability density function with different degrees
of freedom.
1.20
1.05
1.10
1.15
1.04
1.10
1.03
1.05
1.05
1.02
ratio
ratio
ratio
1.00
1.01
1.00
0.95
1.00
0.95
0.99
0.90
0.90
0.98
λ σ µ
Figure 11: Skew-normal prior elicitation comparison (relative to IQR based iteration
algorithm) among Taylor’s expansions at median, mean and mode: the left panel is for
λ, the middle panel is for σ, the right panel is for µ; from left to right in each panel,
the ratios are for median, mean and mode
Dey and Liu 163
1.04
1.15
1.15
1.03
1.10
1.10
1.02
1.05
1.01
1.05
ratio
ratio
ratio
1.00
1.00
1.00
0.99
0.95
0.95
0.98
λ σ µ
Figure 12: Skew-normal prior elicitation comparison (relative to median based iteration
algorithm) among IQR based iteration, Taylor’s expansions at mean and mode: the left
panel is for λ, the middle panel is for σ, the right panel is for µ; from left to right in
each panel, the ratios are for IQR, mean and mode
1.06
1.15
1.20
1.05
1.15
1.04
1.10
1.03
1.10
ratio
ratio
ratio
1.05
1.02
1.05
1.01
1.00
1.00
1.00
0.99
λ σ µ
Figure 13: Skew-normal prior elicitation comparison (relative to mean based iteration
algorithm) among IQR based iteration, Taylor’s expansions at median and mode: the
left panel is for λ, the middle panel is for σ, the right panel is for µ; from left to right
in each panel, the ratios are for IQR, median and mode
164 Quantile based direct prior elicitation
1.02
1.15
1.15
1.10
1.10
1.00
1.05
1.05
1.00
ratio
ratio
ratio
0.98
1.00
0.95
0.95
0.90
0.96
0.90
0.85
λ σ µ
Figure 14: Skew-normal prior elicitation comparison (relative to mode based iteration
algorithm) among IQR based iteration, Taylor’s expansions at median and mean: the
left panel is for λ, the middle panel is for σ, the right panel is for µ; from left to right
in each panel, the ratios are for IQR, median and mean
Dey and Liu 165
References
Aigner, D. J., Lovell, C. K., and Schmidt, P. (1977). “Formulation and estimation
of stochastic frontier production function model.” Journal of Econometrics, 6(1):
21–37.
Al-Awadhi, S. A. and Garthwaite, P. H. (1998). “An elicitation method for multivariate
normal distributions.” Communications in Statistics: Theory and Methods, 27(5):
1123–1142.
Azzalini, A. (1985). “A class of distributions which includes the normal ones.” Scandi-
navian Journal of Statistics, 12(2): 171–178.
Berger, J. O. (1985). Statistical Decision Theory and Bayesian Analysis. New York:
Springer-Verlag, 2 edition.
Dalal, S. R. and Hall, W. J. (1983). “Approximating priors by mixtures of natural
conjugate priors.” Journal of the Royal Statistical Society - Series B, 45(2): 278–
286.
Garthwaite, P. H. (1989). “Fractile assessment for a linear regression model: an exper-
imental study.” Organizational Behavior and Human Decision Processes, 43: 188–
206.
Garthwaite, P. H. and Dickey, J. M. (1985). “Double- and single-bisection methods for
subjective probability assessment in a location-scale family.” Special Bayesian issue
of J. Econometrics, 29: 149–163.
— (1988). “Quantifying expert opinion in linear regression problems.” Journal of the
Royal Statistical Society - Series B, 50(3): 462–474.
Garthwaite, P. H., Kadane, J. B., and O’Hagan, A. (2005). “Statistical methods for
elicitating probability distributions.” Journal of the American Statistical Association,
100(470): 680–701.
Gill, J. and Walker, L. D. (2005). “Elicited priors for Bayesian model specifications in
political science research.” The Journal of Politics, 67(3): 841–872.
Jaynes, E. T. (1968). “Prior probabilities.” IEEE Transactions on Systems Science and
Cybernetics, SSC-4: 227–241.
Kadane, J. B., Dickey, J. M., Winkler, R. L., Smith, W. S., and Peters, S. C. (1980).
“Interactive elicitation of opinion for a normal linear model.” Journal of the American
Statistical Association, 75(372): 845–854.
Meeden, G. (1992). “An elicitation procedure using piecewise conjugate priors.” In
Goel, P. K. and Iyengar, N. S. (eds.), Bayesian analysis in statistics and econometrics.
Springer-Verlag.
O’Hagan, A. (1998). “Eliciting expert beliefs in substantial practical applications.” The
Statistician, 47: 21–35.
166 Quantile based direct prior elicitation
Peterson, C. R. and Miller, A. (1964). “Mode, median and mean as optimal strategies.”
Journal of Experimental Psychology, 68: 363–367.
Sahu, S., Dey, D. K., and Branco, M. (2003). “A new class of multivariate skew distri-
butions with application to Bayesian regression models.” The Canadian Journal of
Statistics, 31: 129–150.
Acknowledgments
The authors are grateful to Joseph Kadane for his insightful suggestions which have lead to
significant improvement of the presentation, we also thank the editor and two referees for their
constructive comments, Anthony Billings for his dedicated proof reading of the manuscript and
Jun Tan for helping us with graphical outputs.