A RT I C L E

Maximizing transparency in a doctoral

thesis1: the complexities of writing
about the use of QSR*NVIVO within a
grounded theory study
J OY D. B R I N G E R
Sports Council for Wales
LY N N E H . J O H N S TO N
University of Gloucestershire
CELIA H. BRACKENRIDGE
Celia Brackenridge Ltd

Q
R

247

Qualitative Research
Copyright
SAGE Publications
(London,
Thousand Oaks, CA
and New Delhi)
vol. (): .

A B S T R A C T This article discusses the challenges of how to provide a

transparent account of the use of the software program QSR*NVIVO
(QSR, 2000) within a grounded theory framework (Glaser and
Strauss, 1967; Strauss and Corbin, 1998). Psychology students are
increasingly pursuing qualitative research projects to such an extent
that the UK Economic and Social Research Council (ESRC) advise
that students should have skill in the use of computer assisted
qualitative data analysis software (CAQDAS) (Economic and Social
Research Council, 2001). Unlike quantitative studies, rigid formulae
do not exist for writing-up qualitative projects for doctoral theses.
Most authors, however, agree that transparency is essential when
communicating the findings of qualitative research. Sparkes (2001)
recommends that evaluative criteria for qualitative research should
be commensurable with the aims, objectives, and epistemological
assumptions of the research project. Likewise, the use of CAQDAS
should vary according to the research methodology followed, and
thus researchers should include a discussion of how CAQDAS was
used. This article describes how the evolving process of coding data,
writing memos, categorizing, and theorizing were integrated into the
written thesis. The structure of the written document is described
including considerations about restructuring and the difficulties of
writing about an iterative process within a linear document.
KEYWORDS:

CAQDAS, computer, grounded theory, QSR* NVIVO,

structure, transparency, writing

In their recently revised guidelines for the training of graduate students, the
UK Economic and Social Research Council (ESRC) advised that students
should have skill in the use of qualitative data analysis software packages
(Economic and Social Research Council, 2001). The guidelines are aimed at a
DOI: .

248

Qualitative Research 4(2)

number of disciplines, including psychology. There is a range of computer

assisted qualitative data analysis packages on the market. This article, however, focuses specifically on NVIVO and is aimed at researchers new to either
qualitative research or Computer Assisted Qualitative Data Software Analysis
(CAQDAS). Illustrating the process of transparency is the main purpose of this
article (for research results please see Bringer et al., 2002a, 2002b), rather
than demonstrating how to code and develop theoretical ideas (which can be
found elsewhere, e.g. Bazeley and Richards, 2000; Bringer et al., 2003;
Strauss and Corbin, 1998).
Qualitative Research Solutions International (QSR) has developed two
product lines for qualitative data analysis. The original program, NUD*IST,
which stands for Non-numerical Unstructured Data, Indexing, Searching,
and Theorizing, was first created by Professors Lyn and Tom Richards in the
early 1980s when the former was looking for more efficient ways to manage
her data than the chaotic task of photocopying, cutting, highlighting, and
filing interviews and coding by hand. It is also difficult to conduct complex
searches of the data without the assistance of a computer. Tom Richards, a
computer scientist, solved her problem by creating NUD*IST, a program that
was easy to use and enabled users to organize data, add detailed memos to
documents or coding, run complex searches of the text and coding, and create
links between data. QSR NUD*IST VIVO (NVIVOs less commonly used full
name) was first produced in 1999 and was designed to provide the same
services as NUD*IST but in a much more refined way. It was named for in
vivo coding that is, naming a category directly from a participants own
words. The program facilitates naming in this way but does not require it.
With the development of CAQDAS has come debate about the appropriateness
of using computers to analyse qualitative data (see, for example, Catterall and
Maclaran, 1997; Dohan and Sanchez-Jankowski, 1998; Evans, 2000; Fielding
and Lee, 1991; Kelle, 1995; Kelle and Laurie, 1995; Richards, 1998; Richards
and Richards, 1995; Seidel and Kelle, 1995; Weitzman, 2000). The key issue
being debated is whether CAQDAS changes the way analysis is conducted and to
what extent it enhances or detracts from the quality of qualitative research. For
these reasons, it is imperative that authors explain their use of CAQDAS and
illustrate that it was used in accordance with the chosen methodology.
One critique of CAQDAS is that it has the potential to transform qualitative
research into a rigid, automated analysis of text that, in actuality, requires
human interpretation (Kelle, 1995). This fear has an historical grounding in
that the first computer programs for textual analysis, developed in the 1960s,
were designed for quantitative content analysis (Kelle, 1995). Some
researchers are, indeed, using modern CAQDAS to automatically code text for
quick frequency counts (e.g., Woodman and Hardy, 2001) and ignoring
pertinent interpretations of the rich data (see Richards, 1999, for a detailed
discussion of data richness). Quantifying data is an appropriate use of the
software; however, it becomes problematic when researchers misrepresent

Bringer et al.: Maximizing transparency in a doctoral thesis

their analysis (e.g., claiming qualitative analysis), do not state their epistemological and theoretical assumptions, or cite the particular computer
program in an attempt to validate their findings. The use of CAQDAS in such
circumstances can then lead to a negative reputation. Whilst the computer
may make it easier to conduct quantitative analysis of qualitative data, it is
important to note that this can also be done using manual methods. If
misrepresentation occurs, fault must lie with the researcher not CAQDAS. The
researcher must still interpret, conceptualize, examine relationships,
document decisions, and develop theory. The computer can assist in these
tasks but by no means does the computer analyse qualitative data.
Another concern of CAQDAS critics is that researchers may choose their
theoretical perspectives and analysis techniques based on the capabilities of
CAQDAS rather than adopting a theoretical perspective appropriate for
exploring the research question. Lonkila (1995) argues that programs such
as Atlas/ti or NUD*IST were designed to facilitate grounded theory analysis
(Glaser and Strauss, 1967; Strauss and Corbin, 1998) and have the potential
to encourage the growth of this methodology at the possible expense of other
equally viable options. To a certain extent the programming behind CAQDAS
does influence manuscript preparation, coding, retrieval, and the development of analysis (e.g. cyclical versus linear and static versus dynamic)
(Richards, 1999). In NVIVO there are many options for document
preparation (plain text, rich text with sections, audio clips, pictures), coding
(e.g. inductive or deductive, in vivo or researcher defined, manual or automated), retrieval (e.g. by node [category], by document, text searches, matrix
searches, refined by attributes), dynamic links to memos, documents, and
nodes, and visual representations (e.g. coding stripes, models). Arguably, the
choices available in NVIVO return the power of analysis to the researcher who
must choose wisely amongst a set of tools and is by no means required to use
them all. Equally so, CAQDAS, which appears to be suited for grounded theory,
will generally support other approaches as well.
An arguably greater influence on the way in which CAQDAS is used is the
way in which a program is taught. In both NUD*IST and NVIVO, the software
is distributed with demonstration tutorials. Each tutorial has its own
embedded epistemological and theoretical assumptions, yet they are not
stated explicitly. Further, there is a lack of discussion about the appropriateness of the methodological approach adopted and the rationale for the
methods of data collection and analysis. This is highly problematic if new
CAQDAS users are adopting a qualitative approach for the first time especially
if they lack theoretical training in qualitative approaches to research. This
may be particularly relevant within psychology in the UK given that
undergraduate programs are still dominated by the positivistic paradigm. A
false expectation of CAQDAS is that it will enhance rigour and make analysis
more systematic (Weitzman, 2000). These expectations are only met if the
researcher is experienced in qualitative research or is taught CAQDAS by a

249

250

Qualitative Research 4(2)

suitably practised qualitative researcher (Johnston, 2001). Methodological

conscientiousness must then be supported by appropriate knowledge and use
of the tools in CAQDAS that facilitate organization, consistency checks (is text
being coded consistently with the definition of the category), record keeping,
comparison of categories, and examination of relationships (Weitzman,
2000).
One distinct advantage of CAQDAS over manual methods is the ability to
organize data and its analysis efficiently. Security passwords can also be
programmed and multiple backups made to protect the data and analysis
from theft or loss. Making an entire backup of the hard copy used in manual
methods is possible but time-consuming. Clerical tasks such as photocopying
and labelling sections of text so they can be traced back to their original
documents are automated in CAQDAS. This provides quicker access for coding
and retrieving data and increases the capacity of data that can be handled
(Richards and Richards, 2000).
One caveat, however, is that the technology does not decrease the amount
of time needed to read, conceptualize, and analyse data. If researchers are
persuaded into thinking that CAQDAS will allow them to analyse more data,
they are likely to become overwhelmed by the sheer volume of information
that becomes available when using computer technology (Kelle and Laurie,
1995). One common fear is that the computer might distance the researcher
from the data too much (Weitzman, 2000). The opposite could, however, be
argued in that the automation of clerical tasks allows the researcher more
time to spend on analysis. Another advantage of CAQDAS is that it facilitates
complex Boolean (e.g. and, or, less, not) searches that would be extremely
complicated, if not impossible, using manual methods (Richards and
Richards, 2000). For example, one can search for text that is coded at
category A but not category B. As a powerful organization tool CAQDAS is
invaluable (Ct et al., 1993). Furthermore, the built-in tools for recording
decisions, conceptual and theoretical thinking, and links between memos,
documents, nodes, and models assist in the development of a dynamic audit
trail to meet the criterion of transparency.
In summary, what all of this suggests is that the computer can be used as a
tool to aid quality analysis. The decision of the ESRC to endorse training in
CAQDAS indicates that CAQDAS has been accepted as beneficial to qualitative
analysis (Richards and Richards, 2000). Ultimately, however, this is with the
caveat that the benefits of CAQDAS are dependent upon the skills of the
researcher, how the researcher chooses to use available tools, and how
CAQDAS is taught (Pat Bazeley and Lyn Richards, 2002, personal
communication).

Bringer et al.: Maximizing transparency in a doctoral thesis

Importance of transparency for qualitative research

Material presented in the remainder of this article is based on the first
authors doctoral work and how she attempted to provide a transparent
account of her use of NVIVO in the written thesis. The aim of the thesis was
to develop rather than to test theory. Therefore, it was important to provide
enough evidence for the examiners to evaluate the study with criteria
designed for evaluating qualitative research within the chosen methodology,
grounded theory (Glaser and Strauss, 1967; Strauss and Corbin, 1998).
Sparkes (2001) recommends that evaluative criteria for qualitative research
should be commensurable with the aims, objectives, and epistemological
assumptions of the research project. The criteria for evaluating the methodological approach adopted in the thesis (constructivist revision of grounded
theory) are described here. Glaser and Strauss (1967) discuss credibility,
plausibility, and trustworthiness throughout their seminal description of
developing a grounded theory. They argue that a grounded theory should be
assessed on the detailed description of the process of the theory generation,
not its verification. Grounded theory is generally intended for the development of a substantive theory, not a grand theory that one would expect to be
generalizable. The substantive theory should have enough detail and variance
built in so that it can be used to explain similar situations. Strauss and Corbin
(1998: 267) state that the real merit of a substantive theory lies in its ability
to speak specifically for the populations from which it was derived and to apply
back to them.
Wilson and Hutchinson (1996) outline a number of common methodological mistakes that researchers make when purporting to follow grounded
theory. These include premature closure (not moving beyond description into
making conceptual links between categories that then form the basis for
developing theory) (e.g. Ct et al., 1993; Johnston and Carroll, 1998;
Scanlan et al., 1989), being overly generic and reducing the phenomenon to
a few stages, imposing theoretical concepts on the data (e.g. Woodman and
Hardy, 2001), and using terminology that is incongruent with the epistemological roots of grounded theory. Researchers who avoid these common
methodological mistakes carefully describe (e.g. Eccles et al., 2002) and
provide examples of their analytical process (Ct et al., 1995) as well as their
research assumptions (e.g. Eccles et al. 2002). Glaser and Strauss recommend
the following criteria that will assist in recognizing when a project is ready for
closure:
When the researcher is convinced that his [sic] conceptual framework forms a
systematic theory, that it is a reasonably accurate statement of the matters
studied, that it is couched in a form possible for others to use in studying a
similar area, and that he can publish his results with confidence, then he is near
the end of his research. (1967: 2235)

Qualitative data analysis programs offer the revolutionary prospect of

251

252

Qualitative Research 4(2)

demonstrating methodological congruence because of a level of transparency

that is so labour intensive that it is rarely, if ever, seen in manual methods
(Morse and Richards, 2002). However, there is a lack of published literature
regarding the use of CAQDAS and the impact upon methodology, methods of
analysis and presentations of findings. As Richards (2002: 267) points out,
this is because qualitative researchers have traditionally not written up
projects with an emphasis of working with the data. The next section
describes some of the key elements considered when writing about the use of
NVIVO within a grounded theory study in an attempt to address the issues
around transparency raised by Richards (2002).

Writing to achieve transparency

When writing about the use of NVIVO, it is important to consider the
audience, the different tasks that the program was used for, and how to
structure the final written document. This section examines a number of
questions that may guide the student who is trying to decide what to include
in the final document. A technical section is included at the end to guide the
reader through creating and cropping screen prints (electronic pictures of the
computer screen) for placement in a Microsoft Word document.
AWA R E N E S S O F T H E AU D I E N C E

As is the case in writing any piece of work, it is important to consider the

audience. Are those who are likely to be reading the thesis knowledgeable
about the particular methodology and CAQDAS? Or is there such a wide range
of possible methodologies and approaches to CAQDAS that it is necessary to
explain in detail how they were used in the thesis? Are the examiners likely to
still be arguing against the use of CAQDAS altogether or do they support
CAQDAS and have an awareness of more recent debates about how it might
influence the choice of methodology and methods (Richards, 2002)?
For the current project, it was decided that a detailed account of grounded
theory and the researchers use of NVIVO was necessary. This decision was
justified by the lack of published grounded theory studies using NVIVO within
the students main discipline (psychology). Furthermore, NVIVO was
launched three years before the thesis defence, and thus it was unlikely that
the examiners would have extensive experience of examining a thesis that
had utilized the program. Finally, it is important for researchers to provide a
transparent account of the use of CAQDAS so that readers can decide if the
program was used in a way that was appropriate to the selected methodology.
S T RU C T U R E O F T H E T H E S I S

One of the more challenging dilemmas faced by the research team was how to
best integrate a detailed description of how NVIVO was used within the
iterative process of grounded theory into the linear confines of a written

Bringer et al.: Maximizing transparency in a doctoral thesis

thesis. Initially the use of NVIVO was written into its own analysis chapter
along with a discussion of CAQDAS. This chapter was to precede the results or
findings chapter. However, it was difficult to show the process of coding and
analysis without revealing too much of the research findings. There were also
two data collection stages (one based around focus groups and one on indepth interviews which occurred after the focus group data was analysed)
and two distinct findings. Therefore, the supervisors and student jointly
decided to reorganize how the discussion of NVIVO and grounded theory
would fit into the thesis.
The original analysis chapter was split and integrated into four different
chapters: the analysis section of the focus group methods chapter, the chapter
on emergent findings, the analysis section of the interview methods chapter,
and the chapter on theoretical development. Setting up a project, keeping a
research diary, organizing the literature review, creating documents, writing
memos, creating annotations, coding, searching, structuring categories,
storing demographic information, and modelling were the main points
discussed in the first methods chapter under the subheading of Analysis.
The second chapter on using NVIVO to assist with the analysis focused
more on how coding stripes and coding reports were used to facilitate axial
coding (exploring relationships between categories and the central theme),
and examining the data for conditions and consequences of the evolving
concepts. The emergent themes and theoretical development chapters
included more examples of coding and memos with data that supported the
emerging concepts. For example, screen prints of quotes within a certain
category were shown with coding stripes (a way of showing what other
categories the quote is categorized under). Within these chapters, the student
also included quotes and examples of questions she used to interrogate the
data as well as discussing the properties and dimensions of the emerging
concepts and how these were related to other developing concepts.
Throughout these chapters, the use of NVIVO was discussed in tandem
with how the tenets of grounded theory were executed. The final thesis
included four chapters that used screen prints and specific references to
NVIVO. These were included specifically to meet the aims of transparency in
helping the reader understand how the final model presented was developed
from the interview and focus group data.
T H E E L E C T RO N I C AU D I T T R A I L

The software program NVIVO was used from the start of the research project,
before the research design was developed, through to data collection, analysis,
and the writing of the final document. The complete project as viewed within
NVIVO provided an extensive audit trail of the students work over the three
years of the thesis. A detailed account of the analysis is found in the memos
attached to categories and interview and focus group documents. The overall
progress of the project can be traced through the main project journal. These

253

254

Qualitative Research 4(2)

memos contain questions that the student used to interrogate the data,
decisions about which categories to focus on, and explanations about how the
categories fit together in the developing model.
The purpose of keeping such an audit trail is twofold. In grounded theory,
keeping detailed memos is recommended as a method for conceptual
development (or more simply stated, it helps to push ones thinking forward)
(Glaser and Strauss, 1967; Strauss and Corbin, 1998). It forces the researcher
to develop abstract thoughts into more clearly thought-out ones. Secondly,
the audit trail is a record of the development of the project from start to finish
that other researchers can later follow to examine how the original
researchers came to their conclusions. This record also allows for secondary
analysis and longitudinal studies. The advantage of using the NVIVO project
as an audit trail is that it allows for numerous active links, for example, from
one memo to the next, or one category to a memo, or from the model to an
original quote. The same audit trail on paper would require references to each
quote, memo, category, or model and would require the researcher to
physically find each folder and access each relevant piece of paper (and
possibly other relevant links) before being able to read the desired material.
Within the NVIVO project, these links can be followed with just a click of a
mouse, and at a speed much closer to that with which the brain is likely to be
processing the information. For this thesis, however, the examiners would
only have the written copy of the thesis from which to judge the students
work and her conclusions. Thus, the difficult task for the student was how to
present evidence of the dynamic audit trail within the linear confines of a
300-page thesis.
The remainder of this article explains how the student attempted to present
her audit trail in a static format. This discussion is divided into the following
subsections: research journal, literature review, and coding. Each section will
explore some of the following questions that helped guide the student in
deciding what to include in the final thesis:

How can the student demonstrate that the concepts in the final thesis
were developed in a rigorous manner?
What is the purpose in illustrating a certain element of the audit trail?
Why is it important to illustrate this concept, quote, or model and not
another?
Which snap shots will best demonstrate the development of concepts
over time?

R E S E A RC H J O U R NA L

The central point of the audit trail was the students research journal where
personal thoughts, theoretical ideas, and any concerns relating to the
research project were recorded. Links were made to appropriate documents,
memos, categories, and models. The journal itself provided evidence of

Bringer et al.: Maximizing transparency in a doctoral thesis

academic rigour and thus deserved attention in the thesis. In addition, the
research journal was an important tool for reflection on the research process
including the reciprocal influence of the research on the researcher.
One advantage of keeping the journal in NVIVO, as opposed to in a Microsoft Word document or in a hardbound book, was that it allowed for links to
be created to relevant documents, nodes, or even external files such as web
pages or electronic photographs. Headers (titles) for each entry allowed for
easily searching the journal for a particular entry (see Figure 1, the document
explorer on the left side). A third advantage was the ability to code the
document. The student coded the journal for theoretical notes for further
examination, ideas to discuss with supervisors, and personal issues (see
Figure 1, the node explorer on the right side). This coding was used to send
questions directly to the research supervisors and to pull out sections for the
reflective chapter.
The student used a number of screen prints as figures in the thesis to
illustrate how NVIVO was used in the thesis. In the case of the research
journal the students aim was to demonstrate that she had consistently kept a
journal throughout the project and that the journal was coded in such a way
that facilitated searching for entries and topic areas. Therefore, she decided to
show a screen print with two windows open (as seen in Figure 1). The bottomlayer window displayed a partial list of documents and the date entries of the
selected document, Private Reflective Journal. The top-layer window
illustrated some of the coding categories used in the reflective journal.

FIGURE

1 Research journal viewed from the document and node explorer in NVIVO

In this study some bracketing occurs in the research journal and bracketing
material specific to the focus groups is located in separate memos (for
example, see Figure 2). The purpose of bracketing is to assist the researcher in
recognizing and acknowledging ones own assumptions that might influence
the data (Ahern, 1999). Continued reflexivity should assist the researcher in
recognizing bias during the research design, data collection, analysis, and

255

256

Qualitative Research 4(2)

reporting phases. Ahern (1999) recommended a number of areas to include

in bracketing, such as identifying power, access, personal value systems, role
conflicts, interests of the funding body, signs of non-neutrality, data
saturation, solutions to having access blocked, and reflection on decisions
about which quotes and literature to use in dissemination. The bracketing
memo in Figure 2 was included in the thesis to demonstrate that the student
recorded reflections on the proposed prompts for the focus groups. Presented
in this manner, the reader has a sense that the original document is being
viewed rather than a tidied up version prepared especially for the examiner.

FIGURE

2 Document browser view illustrating bracketing prior to a focus group

L I T E R AT U R E R E V I E W

In the thesis, the student included a discussion about how NVIVO was used to
organize the literature review. This section was included because there is a
debate within grounded theory about how to use prior knowledge in a
grounded theory study (e.g. Charmaz, 1995; Glaser, 1992; Strauss and
Corbin, 1990; Strauss and Corbin, 1998). Glaser for example argued that one
should set aside preconceived theories about the topic area and the analyst
should just not know as he approaches the data, so he does not even have to
waste time correcting his preconceptions (Glaser, 1992: 50). Whereas
Strauss and Corbin (1998) encouraged the use of discipline-based knowledge
as long as the knowledge fits the data and is not inappropriately applied to it.
The discussion of how the literature review was integrated into the research
process provided a transparent account that allowed the reader some
indication of how the students review of the literature may have influenced
the final analysis. The student felt that in this situation it was important to
include a screen print with the document dates visible so that the examiner
would have some idea of when particular literature was read. She also decided

Bringer et al.: Maximizing transparency in a doctoral thesis

FIGURE

3 Reading journal viewed from the node explorer in NVIVO

to make the coding categories visible to give an indication of how the literature was organized and how easy it was to retrieve notes on a desired article.
CODING

The student explained the basic concepts of coding from a grounded theory
perspective and then provided examples of the process of open coding and
axial coding, as well as getting closeness and distance from the data (see
Gilbert, 2002 for a recent debate on this issue in relation to CAQDAS). This
discussion included a section on rigour and the need to keep detailed notes
about category names and the analytical development of categories. A screen
print of the node property box showed the reader how the name, description,
creation and modification date of each category was displayed in NVIVO (see
Figure 4). The student also discussed her use of memos and included a table

F I G U R E 4 The node property box is designed

to facilitate good record keeping

257

258

Qualitative Research 4(2)

TA B L E

1 Memo types used in the thesis

Prefix

Type and number

Purpose

mCN

Code note memos

(n = 110)

Define the node and record

analytical thinking about
the node; include links to
other nodes and memos

mTH

Theoretical memos
(n = 5)

mOP

Operational memos
(n = 4)

(no prefix; electronic

drawings are stored in
NVIVOs modeller, hand
drawings are in a folder)
nCm

Diagrams
(n = 40)

Higher order memos for

evolving theory at a more
abstract level; summary
memos and thoughts about
selective sampling
Notes about procedures,
what questions to ask in the
next interview
Visual representations of
relationships among
categories

nVa

NVIVO memos
(n = 3)
Executive meetings
(n = 2)

mEM

News, contextual memos

(n = 15)

News articles (or memos on

reports) that influence, or
illustrate, the context of child
abuse and sexual harassment
Technical notes about using
NVIVO
Notes from meetings with
ASA officials to discuss thesis
results

displaying the different types of memos used, how many of each type of
memo was used and the purpose of each memo (see Table 1).
The development of coding and the category structure was illustrated
through a discussion about how many categories were created, and examples
of quotes that were coded at each category. A screen print of the modeller
illustrated how the student used this tool to organize the first 62 categories
that she created into a more coherent structure (see Figure 5). Analytical
closeness was demonstrated by quoting from a memo that recorded the
detailed type of questioning used to fracture a quote in search of a categorys
properties and dimensions (Strauss and Corbin, 1998).
The student also included examples of how audio clips, links to newspaper
articles, and internal annotations (electronic post-it notes) were used in
NVIVO to assist in maintaining the contextual richness of the data (e.g. Figure
6). Similarly, the use of demographic information was discussed in relation to
how it was used in the analysis and a screen print illustrated how the
demographic information was stored and how it could be used to generate
searches of the data. Following this, the student included a section on search

Bringer et al.: Maximizing transparency in a doctoral thesis

FIGURE

5 The NVIVO modeller was a useful tool in developing a structure for the emerging

themes

functions available in NVIVO and a justification was provided for the searches
conducted in this project. Because the program has so many available
functions, it is important for the student to be specific about which ones were
used in the analysis process so that the reader can ascertain whether or not it
was appropriate for the research question and chosen methodology (Gilbert,
2002).

FIGURE

richness

6 DataBites was one of several tools used to help the researcher preserve contextual

259

260

Qualitative Research 4(2)

Analytical distance was discussed in conjunction with axial coding and

screen prints were provided that illustrated the other categories at which a
quote was coded (e.g. Figure 7). Illustrating analytical distance could also
have been achieved by reporting on the number of documents coded and
what categories were and were not accounted for in each document.

FIGURE

7 Coding stripes illustrate in which other categories a particular quote is coded

Technical notes
H OW TO C R E AT E S C R E E N P R I N T S

The main method for illustrating the use of NVIVO in the thesis was by
including screen prints to provide snap shots of the analytical process within
NVIVO. To create a screen print, first decide what you want to take a picture
of on your computer screen. Once the desired section of a document, or
coding, or model is displayed on the screen, press the Print Screen key on your
keyboard. Although it may seem as though nothing has happened, the
computer has taken a static picture of the current screen, including all the
menu buttons at the top and bottom of your display. To see what picture you
have taken, open up a graphics program. The best type of program is one that
has a tool for cropping pictures. However, the basic Microsoft Paint program
that comes with most versions of Microsoft operating systems for IBMcompatible computers is sufficient. (From the Start menu, select Programs,
then Accessories, then Paint.) With the graphics program open, go to Edit and
select Paste. Your screen print will appear. It is likely that you will want to
remove parts of your picture (such as the buttons at the bottom of the screen)

Bringer et al.: Maximizing transparency in a doctoral thesis

that are not necessary to report. Take the selection tool (which looks like a
dotted rectangle) and draw a rectangle around your desired picture by
clicking on one corner and dragging the mouse to the diagonal corner. Once
the area you want is selected, right click inside the rectangle and choose Copy
To. This will allow you to save your selection as a bit map which can later be
inserted into a Microsoft Word document as a picture (see Figure 8). These
pictures are generally only viewable in Microsoft Word documents when the
page view is set to Online or Page Layout (Office 97) or Print Layout (Office
2000).

8 The selection tool is used in Paint to crop the snapshot taken with the Print
Screen key

FIGURE

K E E P I N G A RC H I V E S O F YO U R DATA

The purpose of including screen prints in the thesis was to augment the
written account of how the student came to her final conclusions. This
required screen prints to be taken at different points in the project
development. Throughout the project, the student did not try to predict which
screen prints would be most useful, rather she saved a static copy of her
NVIVO project at key points in the research journey. This was generally done
at least once a month and always after a major coding session or after she had
significantly changed the structure of the project. The name of the saved copy
included the date of the save so that it could be easily found later. Major
changes were also recorded in the research journal, thus making it easy for
the student to locate when a major change had occurred and which saved
copy of the project would be best for accessing a screen print.
Another method of tracking progress is to run reports and save these as text
files or rich text files, again integrating the date into the name of the report
file. NVIVO can generate a number of reports including document reports,
coding reports, and node (category) listings. These contributed well to the
audit trail by providing an account of what types of documents were available
at a given point in time, how much of each document had been coded, what

261

262

Qualitative Research 4(2)

categories actually contained coding, and how many categories had been
created. Any of these reports could provide the basis for a discussion in the
thesis about the development of the overall project.
Copies of models at a given point in time can be preserved by keeping a static
copy of the overall NVIVO project, or by saving a copy of the model in a
Microsoft Word document. If this second method is undertaken, in the NVIVO
modeller use the Model menu to select Export Model to Clipboard. This is
better than using screen print as it takes a picture of the entire model, rather
than just what can be seen on the screen. From within Microsoft Word, use
the Edit menu to select Paste Special and then choose the Picture (Enhanced
Metafile) option. Models in NVIVO are active items and reflect changes in the
overall project for example, if a category is deleted from the project, this will
be noted in the model. Therefore, it is important to keep some form of static
copies of models if they are to be used later as part of the audit trail.

Summary
Computer assisted data analysis software programs have the potential to
facilitate a more rigorous approach to qualitative data analysis. However, with
many different methodological frameworks available to researchers, some
might be tempted to use CAQDAS in place of a methodological framework to
claim that their research analysis was rigorous. It is, therefore, of utmost
importance that researchers provide a transparent account of their use of
CAQDAS and how this fits within their chosen methodology. This article set
out to give a rationale for why researchers should provide a transparent
account of how the chosen software program was used. Examples of how to
write about ones use of CAQDAS, and particularly NVIVO, within a grounded
theory framework were given. Samples of the types of figures the first author
used in her doctoral thesis were also provided along with a discussion about
the audience and the structure of the thesis.
One of the main arguments in this article is that transparency is necessary
for accountability, especially in a doctoral viva. Such transparency should
encourage the examiners to engage the student in an informed discussion
of the analytical process, much in the same way that examiners of
a quantitative-based project would seek assurance that the student
understood the statistical methods employed. In this students viva, the
examiners chose to focus on other theoretical aspects of the research instead.
Although the ESRC is encouraging students to learn how to use CAQDAS,
they have not yet offered standards on who should be supervising and
examining such work. One of the authors has recently examined doctoral
students who included an electronic copy of the NVIVO project along with the
written document. This allowed her to examine the work more thoroughly
and to ask questions about the congruence between the methodology, the
data analysis, and the findings.

Bringer et al.: Maximizing transparency in a doctoral thesis

NOTES

1.

In Britain the term thesis is used to refer to the doctoral publication, whereas in
North America it is called a dissertation.

AC K N OW L E D G E M E N T S

The authors would like to thank conference attendees who commented on an earlier
version of this article at the Qualitative Psychology Conference held at the University
of Leeds, UK (1011 April 2003). We are also grateful to the reviewers who provided
valuable feedback, the Amateur Swimming Association and the Institute of
Swimming Teachers and Coaches who funded the doctoral research, and the British
Association for Swimming Teachers and Coaches who provided logistical support.
REFERENCES

Ahern, K.J. (1999) Ten Tips for Reflexive Bracketing, Qualitative Health Research
9(3): 40711.
Bazeley, P. and Richards, L. (2000) The NVIVO qualitative project book. London: Sage
Publications.
Bringer, J.D., Brackenridge, C.H. and Johnston, L.H. (2002a) Defining
Appropriateness in CoachAthlete Sexual Relationships: The Voice of Coaches,
Journal of Sexual Aggression 8(2): 8398.
Bringer, J.D., Brackenridge, C.H. and Johnston, L.H. (2002b) Role Ambiguity Among
Swimming Coaches: The Impact of Child Protection Policies on Coaching
Practice, Conference Proceedings from the Annual Meeting of the Association for the
Advancement of Applied Sport Psychology, p.67. Tucson, AZ: RonJon Publishing.
Bringer, J.D., Johnston, L.H. and Brackenridge, C.H. (2003) Using NVIVO in a
Grounded Theory Project, Conference Proceedings from Strategies in Qualitative
Research: Methodological Issues and Practices in Using QSR NVIVO and NUD*IST.
Institute of Education, University of London,
http://www.ioe.ac.uk/conferences/nvivo/
Catterall, M. and Maclaran, P. (1997) Focus Group Data and Qualitative Analysis
Programs: Coding the Moving Picture As Well As the Snapshots, Sociological
Research Online 2, URL (consulted 29 March 2004):
http://www.socresonline.org.uk/socresonline/2/1/6.html
Charmaz, K. (1995) Grounded Theory, in J.A. Smith, R. Harr and L.V. Langenhove
(eds) Rethinking Methods in Psychology, pp. 2748. London: Sage Publications.
Ct, J., Salmela, J.H. and Russell, S.J. (1995) The Knowledge of High-performance
Gymnastic Coaches: Methodological Framework, The Sport Psychologist 9(1):
6575.
Ct, J., Salmela, J.H., Baria, A. and Russell, S.J. (1993) Organizing and Interpreting
Unstructured Qualitative Data, The Sport Psychologist 7(2): 12737.
Dohan, D. and Sanchez-Jankowski, M. (1998) Using Computers to Analyze
Ethnographic Field Data: Theoretical and Practical Considerations, Annual Review
of Sociology 24(4): 47798.
Eccles, D.W., Walsh, S.E. and Ingledew, D.K. (2002) A Grounded Theory of Expert
Cognition in Orienteering, Journal of Sport and Exercise Psychology 24(1): 6888.
Economic and Social Research Council (2001) Post Graduate Training Guidelines:
Section F11 Psychology and Cognitive Science, URL (consulted 4 April):
http://www.esrc.ac.uk/esrccontent/postgradfunding/ptgce01.asp#E4

263

264

Qualitative Research 4(2)

Evans, P. (2000) Boundary Oscillations: Epistemological and Genre Transformation
During the Method of Thesis Writing, International Journal of Social Research
Methodology 3(3): 26786.
Fielding, N.G. and Lee, R.M. (1991) Using Computers in Qualitative Research. London:
Sage Publications.
Gilbert, L. (2002) Going the Distance: Closeness in Qualitative Data Analysis
Software, International Journal of Social Research Methodology 5(3): 21528.
Glaser, B.G. (1992) Basics of Grounded Theory Analysis: Emergence vs Forcing. Mill
Valley, CA: Sociology Press.
Glaser, B.G. and Strauss, A.L. (1967) The Discovery of Grounded Theory: Strategies for
Qualitative Research. New York: Aldine de Gruyter.
Johnston, L.H. (2001) Reflections on Teaching Qualitative Software in the UK:
Methodological Vacuum and Software Skills?, paper presented at: Critical Issues in
Qualitative Research. Melbourne, Australia, 7 July.
Johnston, L.H. and Carroll, D. (1998) The Context of Emotional Responses to
Athletic Injury: A Qualitative Analysis, Journal of Sport Rehabilitation 7(3):
20620.
Kelle, U. (1995) Introduction: An Overview of Computer-aided Methods in
Qualitative Research, in U. Kelle, G. Prein and K. Bird (eds) Computer-aided
Qualitative Data Analysis: Theory, Methods, and Practice, pp. 117. London: Sage
Publications.
Kelle, U. and Laurie, H. (1995) Computer Use in Qualitative Research and Issues of
Validity, in U. Kelle, G. Prein and K. Bird (eds) Computer-aided Qualitative Data
Analysis: Theory, Methods, and Practice, pp. 1928. London: Sage Publications.
Lonkila, M. (1995) Grounded Theory as an Emerging Paradigm for Computerassisted Qualitative Data Analysis, in U. Kelle, G. Prein and K. Bird (eds)
Computer-aided Qualitative Data Analysis: Theory, Methods, and Practice, pp. 4151.
London: Sage Publications.
Morse, J. and Richards, L. (2002) Read Me First For a Users Guide to Qualitative
Methods. London: Sage Publications.
QSR (2000) QSR NUD*IST VIVO. Melbourne, Australia: QSR International Pty Ltd.
Richards, L. (1998) Closeness to Data: The Changing Goals of Qualitative Data
Handling, Qualitative Health Research 8(3): 31928.
Richards, L. (1999) Data Alive! The Thinking Behind NVIVO, Qualitative Health
Research 9(3): 41228.
Richards, L. (2002) Qualitative Computing: A Methods Revolution?, International
Journal of Social Research Methodology 5(3): 26376.
Richards, L. and Richards, T. (2000) Qualitative Computing and Qualitative Sociology:
The First Decade, URL (consulted 3 May): http://www.qsr.com.au
Richards, T. and Richards, L. (1995) Using Hierarchical Categories in Qualitative
Data Analysis, in U. Kelle, G. Prein and K. Bird (eds) Computer-aided Qualitative
Data Analysis: Theory, Methods, and Practice, pp. 8095. London: Sage
Publications.
Scanlan, T.K., Stein, G.L. and Ravizza, K. (1989) An In-depth Study of Former Elite
Figure Skaters: II. Sources of Enjoyment, Journal of Sport and Exercise Psychology
11(1): 6583.
Seidel, J. and Kelle, U. (1995) Different Functions of Coding in the Analysis of
Textual Data, in U. Kelle, G. Prein and K. Bird (eds) Computer-aided Qualitative
Data Analysis: Theory, Methods, and Practice, pp. 5261. London: Sage
Publications.

Bringer et al.: Maximizing transparency in a doctoral thesis

Sparkes, A.C. (2001) Myth 94: Qualitative Health Researchers Will Agree About
Validity, Qualitative Health Research 11(4): 53852.
Strauss, A.L. and Corbin, J. (1990) Basics of Qualitative Research: Grounded Theory
Procedures and Techniques. London: Sage Publications.
Strauss, A.L. and Corbin, J. (1998) Basics of Qualitative Research: Techniques and
Procedures for Developing Grounded Theory. London: Sage Publications.
Weitzman, E.A. (2000) Software and Qualitative Research, in N.K. Denzin and Y.S.
Lincoln (eds) Handbook of Qualitative Research, pp. 80320. London: Sage
Publications.
Wilson, H.S. and Hutchinson, S.A. (1996) Methodological Mistakes in Grounded
Theory, Nursing Research 45(2): 1224.
Woodman, T. and Hardy, L. (2001) A Case Study of Organizational Stress in Elite
Sport, Journal of Applied Sport Psychology 13(2): 20738.
J O Y D . B R I N G E R This article is based on Joy D. Bringers doctoral research into child
protection in sport, completed in 2002, at the University of Gloucestershire, UK. She is
accredited by the British Association of Sport and Exercise Sciences (BASES) for Sport
Psychology support and now practises applied Sport Psychology at the Sports Council
for Wales in the United Kingdom.
Address: Sports Council for Wales, Sophia Gardens, Cardiff CF11 9SW, Wales. [email:
[email protected]]
L Y N N E H . J O H N S T O N is a chartered psychologist (BPS) and a BASES-accredited sport
and exercise psychologist. Her main academic interests are in research methods and
applied areas of health and exercise psychology. Lynne has worked in research training
and consultancy since 1997 and has published internationally on research
methodology, rehabilitation, and adherence to prescribed exercise. She had provided
QSR software training throughout the UK to research teams, postgraduate students,
contract researchers and PhD supervisors; she has also trained academics and applied
researchers in Norway, Turkey, Canada and Australia.
Address: University of Gloucestershire, Leisure & Sport Research Unit, Oxstalls
Campus, Oxstalls Lane, Gloucester GL2 9HW, UK. [email: [email protected]]
H . B R A C K E N R I D G E is an independent researcher and honorary visiting
professor at the Centre for Applied Childhood Studies, University of Huddersfield, UK.
She was formerly professor of Sport and Leisure at the University of Gloucestershire.
Address: Celia Brackenridge Ltd., Coalheughead Cottage, Harburn, By West Calder,
West Lothian EH55 8RT, UK. [email: [email protected]]

CELIA

265