Community Analysis Methods and Program Performance-Accessible PDF
Community Analysis Methods and Program Performance-Accessible PDF
Community analysis techniques have been proposed as ways that public libraries can
assess the information needs of their communities. Despite the need for community
assessment or analysis, very little research has been done to compare the various
techniques used by public libraries for gathering information about the service
population. Using the libraries participating in the Building Common Ground initiative,
this study attempted to see if there is a correlation between techniques used and the
performance of subsequent programming. While failing to meet standards of statistical
significance, the quantitative and qualitative data gathered through the study suggests that
certain techniques, as well as the use of several techniques together, are associated with
increased program performance.
Headings:
Information needs
by
Forest B. Doyle
Approved by
_______________________________________
Dr. Ronald Bergquist
1
Table of Contents
Introduction ................................................................................................................... 2
Methodology ................................................................................................................13
Results ..........................................................................................................................16
Discussion ....................................................................................................................22
Limitations ...................................................................................................................24
Conclusion....................................................................................................................26
Acknowledgements .......................................................................................................27
Works Cited..................................................................................................................28
2
Introduction
It has long been the mission of public libraries to serve the information needs of
the public. The identification of these information needs is a critical step in providing the
appropriate resources for meeting those same needs. Community analysis techniques
have been proposed as ways that public libraries can assess the information needs of their
communities. Despite the need for community assessment or analysis, very little research
has been done to compare the various techniques used by public libraries for gathering
information about the service population. The majority of current literature on gathering
Comparing the various techniques used for community analysis has practical applications
librarians will have a better idea about which techniques to utilize in their own
cooperation with the Fetzer Institute, initiated a project called Building Common Ground.
From the project website, the stated goal of the initiative was ―to engage the public in
Ground, 2010) Thirty public libraries were selected to participate in the grant. Although
the Public Programs Office required participants to include certain elements in their
individual programs, the libraries were given the freedom to select a topic upon which all
program events would be based. ―Participating libraries will identify local issues that
and use those issues as the impetus for assembling multi-format program series‖
(Building Common Ground, 2010). This program presented an opportunity to see how
libraries gather information on their communities and the effect the various community
Literature Review
define the concept, emphasize its importance to the profession, and describe the various
community analysis from its beginnings in the late 19th century until the early 1970‘s. He
cites William Foster and Mary Cutler as pioneers in the practice, and quotes Mary Cutler
as providing the fundamental justification for community analysis. Evans (1976) quotes
Cutler as saying that ―The librarian should be a careful student of his own town…that he
may catch the spirit of civic life and relate the library to the whole as the organs to the
body‖ (p.444).
Evans writes that the earliest attempts at community information gathering were
informal and highly subjective, gathering data through interviewing random community
members about their lives. The use of surveys was first proposed in 1919 by Charles
Williamson as a way to formalize the assessment procedure, but failed to provide a clear
outline of how such surveys would be conducted. Subsequent studies improved upon
creating surveys (Wheeler, 1924; McCullough, 1924). The survey conducted by Ethel
demographic data. Evans cites studies from Wilmington, Delaware, and Milwaukee as
examples (Evans, 1976). In the modern day, the practice of using statistics and
analyses. Along with this use, however, has come recognition that this purely quantitative
source of information is limited in its value for making decisions about library services.
This limitation is mentioned indirectly in articles by Charles Evans and Douglas Zweizig.
In their 1982 article ―The Community Analysis Process,‖ Roger Greer and Martha Hale
address the limitations of statistical data directly and propose a method that incorporates
multiple techniques and sources of community information. This method, known as the
community information: demographic data, social groups and related activities, existing
agencies and their offerings, and the life-styles of those in the community. The collection
handbooks and guides. The Guide to Library User Needs Assessment for Integrated
in 2001, provides a concise description of the types of information that can be gathered in
analysis and the techniques which can be used to obtain this information. It distinguishes
6
employing the techniques of survey, focus group, and interview) and secondary data,
which give indirect information about the community through demographic data and
circulation statistics (―User Needs,‖ 2001). The manual explores each technique in depth
appearing in the Planning for Results series of titles from the ALA. These books locate
the assessment as part of the larger process of defining a vision for the community and
decide on service responses. In The New Planning for Results, author Sandra Nelson
provides a work form for recording community data. Much of this information is
describing local agencies, employers, and organizations (Nelson, 2001). This information
is ultimately combined with information about the library into a SWOT analysis. In the
newest manifestation of this work, entitled Strategic Planning for Results, Nelson still
includes the SWOT analysis, but neglects to include any techniques or methods by which
the community information should be gathered. One other relevant element to these
works is the use of key informants on the planning committees. These key informants are
selected to represent the different groups, called stakeholders, which are affected by
library decisions. These informants offer qualitative information about their represented
also include techniques for obtaining information about communities. These guides are
meant for the practitioner and provide concrete suggestions for how to gather
information. In an ALA publication entitled Adult Programs in the Library (2002), the
librarian‘s perform a community survey. The use of demographic data and surveying
Manual for Libraries (1997) identifies the community analysis as the critical first step of
developing programs:
and marketing data are all included as helpful sources. The manual also states that
―behaviorist‖ data can be obtained through the use of surveys. The manual appears to
stress looking at sources of secondary data instead of asking the community members
directly, although the use of surveys does speak to this latter idea (―Adult Programming,‖
reflect the ideas espoused in other literature. Much like strategic planning, community
Marketing for Nonprofit Organizations, author Philip Kotler defines marketing for the
nonprofit world:
8
Marketing is a kind of action plan for implementing the goals set forward by the
library in the planning process. The justification for community analysis techniques is
found in this simple connection between the goals and the subsequent actions of the
public library. Both need to reflect the needs of the community served by the library.
marketing audit. The marketing audit not only assesses the community and its needs, but
also examines the internal environment of the organization (Weingand, 1999, p. 41).
Weingand goes on to identify several factors to be examined when looking at the external
(Weingand, 1999, p. 45). These factors involve multiple types of information and require
Eileen Elliot de Saez, in her 2002 book Marketing Concepts for Libraries and
Information Services, makes the case that various types of assessment techniques must be
qualitative research are needed,‖ she writes, ―quantitative research seeks to measure
market behaviors while qualitative research seeks to explore those behaviors and
and individuals‖ (de Saez, 2002, p. 169). She goes on to list several methods for
9
gathering community information, and a few of these (surveys, focus groups, and
secondary data from other agencies) are similar to the methods outlined by the ALA
planning manuals.
The focus on the consumer is a central element of the literature in both planning
information plays a critical role in any planning or marketing process. Examining the
documents addressing the program planning process, has offered up multiple techniques
for the practitioner. The research gauging the effectiveness of the various techniques is
sparse. With the exception of works by Charles Evans, Douglas Zweizig, and most
recently Mandy Whipple, the literature lacks any real critique of community information
gathering techniques. The work of these three writers suggests that public librarians could
benefit from a comparison of the different techniques. Zweizig (1981) concluded that
demographic data is a poor predictor of whether or not people will use the library. He
suggests that demographic and other types of secondary data have limited value for needs
assessment and that more personal techniques producing qualitative information may
Breaking free of the assumption that attribute prediction will help in planning information
services will allow us to consider how we might better understand the situations of our
users, the kinds of information needs that relate with situation types, and the varying uses
of information for varying situations. (p. 202)
10
that demographic and census data are limited in their value for community needs
community members and observation of their everyday lives, could produce a greater
Whether or not one agrees with these two writers, their works do call into
question the efficacy of the multiple community analysis techniques currently described
their effect on program success would allow librarians to judge for themselves what
methods to use when developing their own programs. This is what this paper seeks to
address.
11
between the Public Programs Office of the American Library Association and the Fetzer
Institute, a non-profit organization with the mission of ―fostering awareness of the power
of love and forgiveness in the global community‖ (Fetzer, 2013). As stated on the
Building Common Ground initiative‘s website, the goal of the program is ―to engage the
achieved this by offering programming to the public which would promote such
The idea that libraries can promote civic engagement through programming is
founded on the belief in the community-building nature of the library‘s basic functions.
Former ALA President Nancy Kranich is perhaps the most vocal proponent of the
library‘s role in facilitating civic engagement programs. In her 2005 article entitled
cites the important role that libraries play in a democratic society. Kranich writes that
―libraries make knowledge, ideas, and information available to all citizens by serving as
the public source for the pursuit of independent thought, critical attitudes, and in-depth
information‖ (Kranich, 2005, p.94). She identifies several ways in which libraries
Also underlying the intent of the Building Common Ground initiative is the idea
that libraries create social capital. Popularized by Robert Putnam in his book Bowling
Alone, social capital is a concept that ―refers to the collective value of all ‗social
networks‘ and the inclinations that arise from these networks to do things for each other‖
(Putnam, 2000). Many authors in the LIS literature write about the ability of libraries to
contribute to social capital. An excellent review of this literature can be found in Stuart
Ferguson‘s 2012 article ―Are Public Libraries Developers of Social Capital?: A Review
Ever since the decline in civic engagement was thrust into the national spotlight
by Bowling Alone, there has been a growing interest in the role of libraries as developers
of social capital and promoters of civic engagement. It is in this context that the Building
Methodology
Using a case study approach, this study examined the effect of community
developed by thirty public libraries participating in the Building Common Ground grant
as a case study. The intent of the research was to determine if there is a correlation
There were two sources of information for this study. The first was a short web-
based survey distributed to the thirty different libraries. These surveys were completed by
a library staff member with responsibility for planning and executing the Building
Common Ground grant programs. Five closed-ended questions about the planning
techniques and the effects that these techniques had on the planning process. For the
purposes of this paper, ―community assessment‖ and ―community analysis‖ are used
a library obtains information about its service community. Six possible categories of
techniques were surveyed: interviews with community members, focus groups, library
surveys, demographic data from secondary sources (i.e. Census, marketing research,
etc.), personal knowledge of library staff, and other. As described in Babbie (2010),
closed-ended questions are used on the survey to promote uniformity and reduce
ambiguity. The category of other was included in the interest of making the survey
14
exhaustive and involved a space for the respondent to explain. Responding libraries were
asked to provide statistics detailing attendance at all adult programming events for the
year of 2012.
The survey was structured so that respondents answered either a ―yes‖ or ―no‖ to
each question. Answers were then coded so that ―no‖ answers were represented by a ―1‖
and ―yes‖ answers were represented by a ―2‖. This allowed the survey data to be
combined with the average event attendance change (derived from averaging attendance
figures for non-program related events and comparing this number to the average
attendance of program related events) into a dataset that could be analyzed using
Statistical Product and Service Solutions (SPSS) statistics program. This allowed the
researcher to look for correlations between the usages of techniques and the attendance
rates of programs.
The second source of information was the final reports submitted to the ALA‘s
Public Programming Office by the participating libraries. The elements of interest to this
study involve the libraries‘ responses to questions about outcomes. There are two
the responses were analyzed in order to discover major themes. These themes dealt with
the ways in which libraries reported the success or failure of their programs. Once these
themes were developed, the researcher went back and looked for the appearance of these
themes in each final report, recording whether a particular theme was or was not present.
Survey results were combined with information from the final reports to see if
there were any correlations between specific community assessment techniques and the
and qualitatively, by analyzing the outcomes reported by the libraries in the final reports.
The history of public library evaluation supports the use of attendance statistics
output measures such as attendance statistics have dominated the discourse on library
effectiveness. Durrance (2003) writes that ―Public libraries, state agencies, and the
federal government have come to rely on output measures for public libraries as
indicators of efficiency and use‖ (p. 545). Although acknowledging this value in output
measures, Durrance goes on to note the limitations of this approach. Specifically, she
states that output measures ―do not reflect the value gained by the user‖ (p. 545). To
address this issue, the Public Library Association suggests that libraries use outcome
approach to the planning and assessment of programs or services that are provided to
address particular user needs and designed to achieve change for the user‖ (p. 2).
16
Although this type of measurement is ultimately quantified, the basic data is inherently
qualitative. It is more effective than output measures in measuring actual effects that
programs have on users (Rubin, 2006). By including both measures in the research, a
Results
The survey created by the researcher had a response rate of 57%, with seventeen
multiple choice answers. The most common technique used by libraries is the utilization
of staff members‘ personal knowledge of the community, with all libraries reporting that
this played a role in the development of Building Common Ground programming. The
use of demographic information was the next most prevalent, with 81% of the libraries
using this method to gain information about their communities. The technique of
interviewing individual community members came in third with 59% of libraries using
this method. At 53% of libraries answering in the affirmative, the fourth most prevalent
was the technique of using information gleaned from previous community assessments or
other surveys of the community. The fifth and least used technique was the utilization of
focus groups, with only 47% of libraries responding that this technique was used when
other techniques not covered by the five multiple-choice questions. These answers varied
widely, but a few common techniques emerged from the data. Seven of the libraries used
organizations included government and nonprofit agencies, some of which were partners
with the libraries in the Building Common Ground initiative. Three libraries looked at the
18
12
10
8
6
4
2
0
Demoraphics Assessment Interview Focus Groups Staff Knowedge
Community Analysis Techniques
Figure 1.1
The next step of the analysis involved comparing average program attendance to
the average attendance at all adult programs in the year of 2012 for each library. At this
stage, a limitation of the methodology became clear when many libraries failed to provide
complete information in their final reports to the ALA. Furthermore, a few other libraries
have yet to submit final reports. Of the seventeen libraries that participated in the survey,
only eight provided complete information. While this number is much too low to even
approach statistical significance, the researcher ran t-tests to confirm this fact. None of
the five tests displayed numbers approaching statistical significance. Despite this fact, the
researcher performed a correlation on the data. Four of the five methods (demographics,
19
previous assessments, interviews, and focus groups) were tested. Of these four, only two
methods appeared to have any correlation to greater increases in program attendance. The
modest correlation between that method and program attendance. The technique of
producing a Pearson‘s r value of .501. The other two methods—the use of demographics
and focus groups, produced low Pearson‘s r value of .039 and .010, respectively.
The number of methods used by each library was calculated to see if a correlation
existed between the quantity of methods and program attendance. Figure 1.2 provides a
visual display of the data as mapped onto a chart. The correlation test between the
numbers of methods produced a Pearson‘s r value of .540. Once again, these results do
not approach statistical significance because the sample size was so small.
A qualitative analysis of final report data was performed and four general themes
common to most of the documents were discovered. These themes are: positive feedback,
programs. Positive feedback was represented by either the library stating that feedback
was positive overall or the inclusion of predominantly positive feedback in the final
reports. Repeatability refers to the desire on the part of a library or its program
not libraries met their anticipated attendance goals. Finally, the library‘s perception of the
programs simply refers to statements made by the reporting libraries about the overall
Figure 1.2
program attendees. The presence of the other three themes was not as homogenous in the
final reports. Regarding the theme of repeatability, only four of eight libraries explicitly
stated that programs will be repeated or that program attendees desire the programs to be
repeated. Six of eight libraries mentioned the theme of anticipated attendance, with five
out of those six responding that attendance at programs met or exceeded the libraries‘
eight libraries‘ final reports. Once again, it is not surprising that all of these responses
The presence of themes was cross-tabulated with the libraries‘ survey responses.
A few findings stood out from the rest. Firstly, four out of the five libraries that had used
21
demographic data responded that anticipated attendance levels were met. Three of the
four libraries that gathered information from previous community assessments also
reported meeting anticipated attendance levels. All three libraries that utilized interview
techniques reported that the attendance levels were met. The theme of repeatability did
not have any strong positive associations. In the cross-tabulation with the technique of
demographic data, five of seven libraries utilizing the technique failed to state a desire to
repeat the programs. For the technique of interview, three of four libraries that used the
technique did not state a desire to repeat programming. The other techniques that could
tabulated with the repeatability theme. Half of libraries using the technique reported no
desire to repeat programs, while half of the libraries reporting not using the technique
Discussion
This study set out to demonstrate that the use of community analysis techniques in
The small number of responding libraries makes the generalization of the findings
impossible. Within this specific situation, however, a few basic claims can be made
performance. These claims are that certain techniques do appear to be associated with
higher program performance and that the use of multiple techniques is also associated
these libraries were also able to meet their anticipated attendance rates. The reason for
this success can be found in the nature of community assessments. These documents are
data collection methods, including some of the other techniques in this study. Community
assessments are considered to be an integral part of the library planning process, as can
be seen by its presence in the ALA‘s Planning for Results series. The findings of this
23
study support adoption of this tool by the ALA and hints at the utility of these
theorists who encourage the use of more ethnographic methods. The interview format can
provide qualitative information, including data about how someone experiences the
world, what he/she identifies as needs, and what motivates a person to do or not do
something. This type of research can lead to programming that addresses the specific
The use of multiple techniques was also found to be correlated with increases in
program attendance. Attendance grew the largest in the libraries that used more methods.
An explanation for this could be that different methods measure different types of
information. As the number of methods increased, the libraries gathered multiple types of
information. This variety of data was then used to inform the selection of the local issues
Limitations
This research is limited in a few different ways. Firstly, the sample size was too
small. Of the thirty libraries that participated in the Building Common Ground initiative,
seventeen completed the survey released by the researcher. While this provided the
researcher with data describing the techniques utilized by the libraries, it did not provide
information sufficient for the desired analysis of the effect of those techniques on
program performance. This missing data was to be found in the final reports that the
libraries submitted to the ALA‘s Public Program Office. Unfortunately, several of the
libraries failed to provide complete information in the reports, and the researcher could
only include eight of the original thirty libraries in the analysis. This undercut the
A second limitation can be found in the type of information that was gathered.
The data in this study provided the researcher with information about what techniques
were used and how the programs produced by the libraries performed. The study was
meant to see if certain techniques were correlated with a certain level of performance.
While this may provide some indication of a relationship between the variables, the study
does not provide any indication of how the information gathered through these techniques
are used to develop programs. This type of information is a critical component of linking
community analysis techniques and program performance. A case study approach, which
25
information and planning programming around the information, might be the most
Conclusion
In order to effectively serve its patrons, a public library needs to have knowledge
of the community in which it exists. Community assessment has long been a topic of
library science literature. Over the years, multiple techniques and processes have been
literature on community analysis exists as practical manuals or guides for the professional
librarian and includes techniques that have been developed over the years. Lacking from
developed by the ALA‘s Public Program Office and the Fetzer Institute called upon
libraries to develop programming based around local issues in their communities. Using
the libraries participating in the Building Common Ground initiative, this study attempted
quantitative and qualitative data gathered through the study suggests that certain
techniques, as well as the use of several techniques together, are associated with
Acknowledgements
A few different people helped me in the development of this project. I would like
to thank my supervisor Dr. Ron Bergquist, who offered me guidance and support during
the writing of this paper. I would also like to thank Brian Russell at the ALA‘s Public
Program Office. He helped coordinate the release of the survey and communicated with
me throughout the data gathering process. Lastly, I would like to thank Mary Davis
Fournier, Program Director at the Public Program Office, for her willingness to assist me
with the data collection process, her advice in the development of the study, and for
valuable addition to any library, and the professional community is lucky to have her as
Works Cited
Association.
De Sáez, E. E. (2002). Marketing concepts for libraries and information services (2nd
Durrance, J. C., & Fisher, K. E. (2003). Determining How Libraries and Librarians Help.
Greer, R. C., & Hale, M. L. (1982). The Community Analysis Process. Public
Association.
Occurrent, 7(7).
Nelson, S. S. (2001). The New Planning for Results: A Streamlined Approach. Chicago:
Association.
Public Libraries. Public Librarianship: A Reader (pp. 189–205). Littleton, CO: Libraries
Unlimited.
Zweizig, D., & Dervin, B. (1982). Public Library Use, Users, Uses: Advances in