Successful It Systems Printable
Successful It Systems Printable
Successful It Systems Printable
Introduction
This free course, Successful IT Systems, looks at what makes an IT system successful.
Information technology (IT) systems are a critical part of our world, in business, public
sector and voluntary sector environments, and are often highly complex and
interconnected combinations of technology, organisations and people. Yet they frequently
fail, often spectacularly.
Examples of failed IT systems are everywhere. Banks are unable to release money to
their customers – because of failed IT systems. Aircrafts fall out of the sky or are routed in
wrong directions – because of failed IT systems. The UK National Health Service (NHS),
of the largest organisations in the world, was unable to change as planned – because of
failed IT systems. Many more examples, from the private, public and voluntary sectors,
may come to your mind.
But what exactly do we mean by success or failure in an IT system? This course mostly
focuses on success, and helps you understand what we mean by a successful IT system.
This OpenLearn course is an adapted extract from the Open University course
TM353 IT systems: planning for success.
Another question which will be explored in more detail later is what is meant by success
and failure. The answer may often depend on the stakeholders from whose perspective
the success or failure is being judged: a project manager may consider a system
successful if it comes to completion on time and in budget; a software developer may
consider it successful if it contains good-quality code that runs well; an end-user may
consider it successful if it helps them do their job effectively; and so on. We will consider
stakeholders and their role in determining IT success or failure later in this course.
You will learn much more about the nature of success and failure in IT systems later in this
course. For now, we will use the following definitions:
● a successful IT system is one that meets the needs (i.e. the goals or strategy) of an
organisation within which it is used, as well as relevant needs of other key
stakeholders related to, but external from, that organisation
● a failed IT system is one that does not meet the needs of an organisation within which
it is used and/or its other key stakeholders.
Success and failure of IT systems can be seen in many different settings. They occur in
private businesses, in the public sector and in the voluntary sector. They can be found in
very large or very small systems. The smallest implementation of an IT system in a
company can be very successful or very problematic; the largest implementation can
likewise go very well or very badly. Large public-sector failures get a lot of publicity
because they are spending public money and are subject to public audit; but private-
sector failures are perhaps equally common, even though they are not widely discussed.
If a private sector project is a success, it is widely written about in the computing press; if it
is a failure it is often forgotten.
You will now look at two short case studies: one of a successful and one of a failed IT
system. The successful project is from the private sector and the failed project is from the
public sector, but it could have equally been the other way around. After you read the
following case studies, you will be asked to reflect on what makes them a success or
failure, and then to look for examples of your own.
connects via the ODS and now head office can see how individual units are trading on an
almost minute-by-minute basis.
The project is a radical departure on the old system, whereby much of the company’s core
IT was hosted on either IBM e Server p Series (RS/6000) AIX Unix-based systems, or
System I (AS/400) mid-range servers, largely hosted in an IBM data centre. At head office,
the computer room buzzed with some 20 different servers to handle email, file and print,
and some key business applications.
In most cases, existing applications – such as the all-important labour scheduling and
supply chain management applications – could be virtualised and were ported to the new
architecture. Where applications couldn’t be virtualised, this was normally due to their age
and, therefore, a good excuse to ditch them and migrate to all-new applications.
The initial tender process was worked out with a consultancy called EquaTerra, which is
now part of KPMG.
‘We asked ourselves what we wanted to achieve,’ says Taylor. ‘What’s the output we want
to get to? Then, we worked with EquaTerra on how we would perform the benchmarks,
because the issue with benchmarking is that everyone calibrates it in some sort of way.
‘So we said, if we look at the outcome in mind, why don’t we benchmark about how those
outcomes have been achieved using EquaTerra’s databases of contracts won and
tendered for? That gave us a good feel for what could be achieved and the size of the prize
– what it would cost us to do and the likely running costs.’
Once an IT partner had been tendered for and identified, a solid plan for the migration
needed to be worked out.
‘We took all the elements of our IT and categorised it into six key areas,’ says Taylor. ‘That
meant the data centre, network, outlets, end-user computing, central services and
applications. Then we looked at the outputs that we wanted from each of those areas, the
cost base and the areas where we wanted to get our innovation from.’
Initially, the data centre and the network were prioritised as they provided the platform that
supported the rest of the business – the applications running in the data centre, while the
network supports the outlets, which in a modern hospitality business also require 24/7
logistic and IT support.
Infrastructure renewal was not the only consideration. M&B was also keen to consolidate
applications and, as far as possible, to share applications across its business units as far as
possible.
‘Our finance system, human resources, payroll and property management systems are
common throughout the organisation,’ says Taylor.
‘It doesn’t matter whether it is a Toby, Harvester or an All Bar One, we get the synergies of
having one application and streamlining our processes so that they are common
throughout. Occasionally, we will have to use something slightly different for the odd brand,
but in the majority of cases, everything is consistent.’
(Burton, 2013)
Rob Wilson, the Conservative MP for Reading East, said: ‘The BBC spent well over £100m
experimenting with a system that it appears was highly unlikely to work. It is a disaster for
the BBC but a bigger disaster for the licence fee payer.’
The BBC initially awarded a £79m contract to Siemens in February 2008 without open
competition, a Public Accounts Select Committee report noted in April 2011, but no
technology was delivered and it was terminated in July 2009. The BBC then brought the
project in-house, clawing back £27.5m from Siemens – but was still unable to bring costs
under control, and did not deliver the software required.
The PAC in 2011 noted that instead of saving £17.9m, the DMI had cost it a net £38.2m. It
expected that the DMI would be delivered by summer – but that deadline slipped, and the
forecast benefits slipped to an overall cost to the corporation.
(Conlan and Arthur, 2013)
Activity 1
30 minutes
Apart from one being public sector and one being private sector, what do you think are
the three main differences between these two case studies? Make notes (around half
a page in each case) on what you think made the first system a success and the
second one a failure.
Discussion
In our view (and throughout these answers we recognise that your view may be
different and just as valid), the three main differences between the case studies are as
follows:
● A clear plan was followed for Mitchells & Butlers’ system (M&B), whereas the
BBC Digital Media Initiative (DMI) appears to have changed its nature over time.
● Although both were ambitious and large-scale projects, the M&B system was
appropriate in its scale, whereas the DMI was over-ambitious.
● The M&B system was completed to plan and successfully rolled-out; the DMI was
left incomplete.
Mitchells & Butlers’ IT overhaul feels like a successful system. It is designed to draw
upon existing systems, but to work with modern technology − there is much use of
virtualisation and the cloud. It is standardised across different sites, although with
appropriate local changes if necessary. A clear plan was identified and followed, and
benchmarking with comparable organisations used to get a feel for the success of the
plan. It has to be said that most of the discussion is from the central management
perspective, and that other stakeholders within the organisation might see the success
or otherwise somewhat differently.
By contrast, the BBC Digital Media Initiative feels like a failing system. It is described
very negatively throughout the report. It was over-ambitious in terms of its scale,
significantly behind schedule and ended up being largely incomplete. A few aspects of
it were completed (notably the ‘Fabric archive database’) but most of the project
remained incomplete, which as it was conceived as an integrated whole, meant that it
was largely unusable. At the time of the report given here, reasons for the failure were
still to be investigated.
Activity 2
1 hour
a. Having read the two short case studies of success and failure, search online for
two short case studies of your own, one of a successful IT system and the other of
a failing IT system.
b. For each of your case studies, write a sentence explaining why you regard it as a
success or a failure.
Discussion
We hope you enjoyed finding these case studies. There are many rich case studies
available online, although it can sometimes be challenging to separate genuine
descriptions of an IT success story from what is basically a marketing piece by a
vendor or consultancy. Failures are easier to spot in this regard!
This is one of those definitions where almost every word has significance! The basic
definition is usually expanded upon in the following way:
The last of these points is especially important. Although the loose use of phrases such as
the financial system and the health system (and even IT systems) might sound as if they
are describing real entities, for the most part the systems they describe should be
regarded as constructs because the way that the system is understood has been
constructed (either consciously or unconsciously) by a particular individual or group who
are observing a situation, and viewing aspects of it as a system. The perspective from
which the situation is viewed will shape what the viewer identifies as the ‘system of
interest’. As you will see later, where the boundaries of a system are defined – what is
considered to be part of the system, and what is considered to be outside the system –
can differ greatly according to who is defining those boundaries, the purpose they
consider the system to have, and even the time when they are considering the
boundaries.
For a non-IT example, consider ‘the healthcare system’. What could be included in this?
Groups and organisations that might be considered part of it: general practitioners,
hospitals, healthcare administrators, insurance companies, dentists, opticians, patients,
pharmaceutical companies, pharmacies, government regulators, ‘alternative’ practitioners
such as homeopaths and acupuncturists, gymnasiums … the list could go on. Which of
those are part of the healthcare system and which are not? For some purposes, it would
be appropriate to include some of the above list within the boundary of the healthcare
system, and to exclude others. Moreover, the boundary would be drawn differently in
different countries and probably by those holding different political or ideological
viewpoints. To take just one example, someone working for the NHS in the UK would
define the health system quite differently from someone working for one of the large
health insurance companies in the USA.
Activity 3
10 minutes
Have you previously encountered systems thinking in some form? Did it match the
Open University definition of a system found on the previous page?
Discussion
Systems thinking can be found in a number of different forms in different places, and
approaches that take a holistic perspective but don’t use the term system in even more
places. Although the language is different, the ideas of interconnection between
components and of purpose will be found in many understandings of systems.
One concept missing from this definition is the idea of feedback or circularity, which
some approaches to systems thinking regard as fundamental. In our view this is an
important concept, but it is secondary to the ideas of components, interconnection and
purpose.
It is worth observing that you may come across the use of the word ‘system’ to refer
solely to technology (such as software). Although this may fall within the strict
definition of a set of components interconnected for a purpose, it wouldn’t qualify as an
IT system as discussed in this course.
Before looking at what systems thinking can tell us about the nature of IT systems, we will
introduce the concept of sociotechnical systems thinking. This is a strand of systems
thinking that dates back to the early 1950s and is highly relevant to this course. It is
framed around the idea that the social and the technical aspects of a system are
inextricably linked. This course has, at its foundation, the idea that all IT systems are
sociotechnical – they cannot be understood without a sense of the relationship between
the social aspects (organisational and people) and the technical aspects (hardware and
software) of the system.
One of the long-standing practitioners of sociotechnical systems thinking, Ken Eason, has
written of the usefulness of the ideas and its importance in making sense of IT systems, as
follows:
● the technology of the system: the software, hardware, networks and other
infrastructure which go to make it up. A few years ago this largely meant fixed
networks of PCs in most organisations, with large mainframes performing back-end
tasks. The rise of mobile and wireless devices, and the importance of the cloud for
information storage and processing, have changed this significantly, and there are
currently many possible combinations of hardware and software.
● the organisation where the system is used and developed. The success of a system
in use depends a lot upon how well it fits with the need of this organisation, and the
way it is organised.
● the people involved in the system: technical staff (such as developers, maintainers
and support staff); end users; managers; training staff; and many other groups.
The basic structure of an IT system with these three core components, showing their
influences on each other, might look something like Figure 1.
Technology Organisation
People
Activity 4
10 minutes
Do you think these are sufficient components of an IT system? What other components
might you want to add? Write down these additional components.
Discussion
You may well have come up with other components as being important, but in our view
they can usually be seen as subsystems of the three main components of Technology,
Organisation and People.
Table 1 Standish findings by year (adapted from Nasir and Sahibuddin, 2011,
p. 2175; Business Wire, 2003; and Standish, 2013, p. 1)
Year 1994 1996 1998 2000 2003 2004 2006 2008 2010 2012
Succeeded 16 27 26 28 34 29 35 32 37 39
(%)
Challenged 53 33 46 49 51 53 46 44 42 43
(%)
Failed (%) 31 40 28 23 15 18 19 24 21 18
As you can see, there are some grounds for optimism in Table 1 in that the proportion
succeeding was increasing during the period represented but nevertheless the picture
painted is not rosy.
A similar impression is created by the work of Flyvberg and Budzier (2011). They looked
at 1471 ‘large IT projects … that ran the gamut from enterprise resource planning to
management information and customer relationship management systems’ (p. 24) and
compared their budgets and estimated performance benefits with the actual costs and
results. Their conclusion was that the average cost overrun was 27%.
It is not only survey data that shows the difficulties of building successful systems. It is
true that the media prefers reporting bad news – it is claimed (see, for example,
Williams, 2010) that the ratio of bad news stories to good news stories is around 17 to 1 –
but it is also the case that where systems failure is concerned there is plenty to report. As
discussed earlier, in 2008 the BBC launched its Digital Media Initiative to build a system
that would allow all its audio and visual material (new and archived) to be made available
to staff making programmes via a desktop. Between 2010 and 2012 £98.4 million was
spent on the project and in May 2013 the initiative was cancelled. At the very same time
the media were reporting problems being experienced by the Co-operative Bank, one of
which related to its IT system:
In September 2013 the National Audit Office (NAO) reported an investigation into plans by
the Department for Work and Pensions to roll-out universal credit across the UK whereby
benefits and tax credits to people who are unemployed or on low incomes are merged
together into a single monthly payment. This is one aspect of what they found:
Over 70 per cent of the £425 million spent to date has been on IT systems. The
Department, however, has already written off £34 million of its new IT systems
and does not yet know if they will support national roll-out. The existing systems
offer limited functionality. For instance, the current IT system lacks a component
to identify potentially fraudulent claims so that the Department has to rely on
multiple manual checks on claims and payments. Such checks will not be
feasible or adequate once the system is running nationally. Problems with the
IT system have delayed national roll-out of the programme.
(NAO, 2013)
Of course, a lot of systems do work. Admittedly some need tweaking and others need
more major remedial work before they are judged to be successful but there are those that
meet the goal of ‘right first time’. Overall though, evidence suggests that ‘system design
and building’ ought to be placed in the high-risk category of endeavour. The next topic we
are going to look at lies right at the heart of this question and, indeed, the course’s title:
what do we mean by ‘a successful system’?
achieved what was intended of it; it was operational at the time and cost that
was planned; the project team and the users are pleased with the result and
they continue to be satisfied afterwards.
(Fortune and Peters, 2005, p. 13)
On the face of it, this definition sounds straightforward, but once we start to examine it
carefully, we begin to see that it is not as clear-cut as it at first appears. Let us look at it
phrase by phrase.
achieved what was intended of it
This implies that the requirements for the system were identified accurately and translated
into stated and agreed objectives before the system was developed and that it is possible
to measure performance of the system against these objectives in order to check they
have been met.
… it was operational at the time and cost that was planned
Here it is assumed that there was an agreed and approved development plan that
included timescales and costs and that performance against this plan can be measured. It
also assumes that it is clear what ‘operational’ means and it is possible to be certain when
it has been achieved.
An important difference between these first two parts of the definition is that the first one is
about the success of the system and the second one is concerned with the success of the
project that built the system. For an individual project, judgments of success are not
necessarily the same across both aspects. A project regarded as well-managed may fail
to deliver the intended outcomes whilst a project that experiences many problems can still
be capable of delivering success, though almost always at a price. There does tend to be
a positive correlation between the quality of the project management and the quality of the
output, but there are exceptions.
… the project team and the users are pleased with the result
This is where the definition becomes even murkier with a number of potentially conflicting
judgements. First, there is the relative importance of the views of the project team and the
users. Some would regard the views of the professionals who make up a project team as
paramount but others would say that the views of the project team are largely irrelevant as
long as the users are content. The next big question it raises is ‘who are the users?’ Are
the users just the people who interact directly with the system or do they include those
who may not know it exists but are users of the services it supports? Are all users’ views
equally important, and what about the views of the client or customer? This part of the
definition also implies that ‘pleasure’ can be measured or assessed.
… and they continue to be satisfied afterwards.
This shares the problems of the previous phrase. Who are the users whose degree of
satisfaction should be considered later? Another question is how long a period of time is
covered by ‘afterwards’. They may not be the original users, however defined. Measuring
and/or assessing satisfaction is also an issue here. Should the same criteria be used as
when the system was new or might there be a different set of standards now that users
are familiar with the system? Another issue is what allowances should be made for the
passage of time. For example, the environment may have changed to such an extent that
there is now a need for the system to do things that were not envisaged when the system
was designed.
Hopefully you can see from the examination of this definition that complexity and
ambiguity surround the notion of success and, indeed, failure.
Activity 5
15 minutes
Identify three things that stand out to you in this examination of the succinct definition
of a successful system.
Discussion
The three things that stand out most for us are:
● Judgements about success and failure are usually a combination of the objective
and the subjective and can vary quite significantly from person to person. As a
consequence, the overall judgement about whether a particular system is
classified as a failure or a success will often be contested.
● It is important to know to whom you are referring when you use terms such as
‘users’, ‘customers’ and the like.
● Perceptions of success and failure can change over the life of a system.
The first type includes systems where objectives are never met and those that work some,
or even most, of the time, but are not as reliable as they should be. An example of the
former is the BBC’s Digital Media Initiative mentioned earlier where the aim had been ‘to
create a fully integrated digital production and archiving system to help staff to develop,
create, share and manage video and audio content and programming on their desktops’
(BBC Trust, 2014). An example of the latter is the temporary collapse of NatWest’s online
banking and other services including cash withdrawals from ATMs and debit card
payments:
In the second type of failures the original objectives are met but there are also
consequences or side effects which are judged to be inappropriate or undesirable. For
example, a suite of programmes might work well but leave the company that has installed
them vulnerable because they create a security loophole or an unwise dependency on a
third party. Even worse, these first two categories of failure are not mutually exclusive; a
system may fail to live up to expectations and have undesirable consequences!
It can be argued that the distinction between the first and third categories of failure hinges
on whether the objective setting was carried out correctly in the first place. In the first type
the objectives are clearly taken as given and a judgement made solely about the extent to
which they are met. ‘Inappropriate objectives’ leaves open the question of whether the
original objectives were flawed. Once again, what at first appears to be a straightforward
categorisation rapidly becomes more complicated because it relies heavily on the view
taken of the original objectives which is in turn dependent on the standpoint of the
observer.
These criteria for judging project success are very similar to those implied in the simple
definition we started with. However, a more recent survey (Fortune et al., 2011) across
Australia, Canada and the UK found a broader range of criteria being used when 50
respondents in each of the three countries were asked to provide and to rank in order of
importance the success criteria they had used to make a judgement about the success of
a project they had recently worked on. In Table 2 you can see the success criteria they
provided. The criteria have been weighted according to the order of importance placed
upon them. (The criteria regarded as most important has been given a weighting of 3, the
second most important a weighting of 2 and the third a weighing of 1.) As can be seen, the
four highest scoring criteria are wholly concerned with the success of the project but after
that, aspects associated with longer-term system success start to appear in the list.
Table 2 Criteria for judging success (Source: Fortune et al., 2011, p. 560)
Criteria Australia Canada United Grand
Kingdom Total
One of the consequences of broadening the criteria used to judge the success of IT
projects is that it can lead to the situation where a system can be perceived to have failed
if it misses any of the criteria and thus drag the overall judgements across all projects
downwards. It then becomes hardly surprising that some observers have argued that
most large and many small IT projects are failures.
Different people will, of course, prioritise different criteria so even when talking about one
system, not all judgements will necessarily be the same.
Activity 6
10 minutes
Job role is often cited as a reason why different people’s judgements about success and
failure may vary but that is not the only cause of variation. Another cause is the
personalities of the people making the judgements. For any situation in which we find
ourselves, some of us tend to see the positive and some of us the negative. And to make it
even more complicated we do not necessarily see the same positives or the same
negatives! This difference in attitude works alongside other factors such as individual
motivations and cognitive styles to influence individual’s judgements.
If you look at Table 3 you will see that differences in judgements of this type are not new.
In 1978 Wedley and Ferrie reported the results of a survey conducted across 49
operations research (OR) and management science projects. They asked the analysts
working on the projects and the managers responsible for implementation to classify their
own projects according to the degree of success. As you can see, the analysts regarded
63% of the projects to be successful and implemented whereas only 20% of them were
classified thus by the managers.
Managers’
classification
Unsuccessful 6% 6% 10%
Successful but 10% 14% 33%
unimplemented
Within the e-commerce context, the primary system users are customers or
suppliers rather than internal users. Customers and suppliers use the system to
make buying or selling decisions and execute business transactions.
(DeLone and Mclean, 2003, p. 24)
This, however, is not an entirely satisfactory summary – what about potential customers?
Have you ever been about to buy something over the internet and then become so
irritated by the site that you have decided not to bother after all? Many people have. Were
they users of the site?
A very useful concept here is that of stakeholder. This concept is said to have been first
used in 1963 within an internal memo at the Stanford Research Institute in California to
refer to those groups without whose support the organisation would cease to exist.
Freeman (1984, p. 46) defined it as ‘any group or individual who can affect or is affected
by the achievement of the organization’s objectives’. Nowadays it is used even more
loosely to refer to people who have a vested interest in a situation.
There is a range of stakeholder analysis techniques – Bryson (2004) identifies 15 – but
here we shall be looking at just the three main aspects of stakeholder analysis. These
enable you to:
● identify stakeholders
● understand key stakeholders
● prioritise stakeholders.
● work in small, close groups of perhaps five or six, in a private, protected area away
from interference or interruption
● create an atmosphere that is safe, supportive, concerned with encouragement and
building (not criticism or dissection), fun, playful, energetic, enthusiastic, permissive,
stimulating and risk taking
● divide the time into periods of relaxed privacy for individual imagination and
contrasting periods of excited, lively, rapid-fire group interaction
● write up all the ideas as they occur where everyone can see them
● treat everyone as equal and enable everyone to contribute, although it may be useful
to appoint a ‘compère’ who discourages criticism, encourages dramatic and
outlandish ideas and maintains the pace
● continue while the excitement lasts, but stop at the first signs of staleness
● when a good stock of raw suggestions has been generated, switch into a more
controlled mode and work through the list of suggestions to look for overlaps,
omissions and possibilities for forming groupings.
Activity 7
15 minutes
Which three of the seven rules listed above would you select as being the most
important to the success of a brainstorming session and why?
Discussion
In our view, the following rules will most affect the atmosphere of the session and thus
its likely success:
In practice, it is very difficult to ensure that the rules are followed. The stifling of critical and
negative remarks, for example, requires a good deal of self-discipline. ‘Everyone is equal
and everyone contributes’ can be difficult in the face of hierarchical differences. A similar
problem concerns the level of each individual’s knowledge about the situation under
consideration.
An alternative to brainstorming is brainwriting where the participants do not talk to each
other but communicate, usually electronically, instead. For example, it is possible to set up
a wiki and add suggestions over a period of a few days. Brainwriting is attractive because
it can overcome some of the problems associated with brainstorming but another big
advantage it offers is that people can participate remotely.
For example, a new IT system that will automatically record and track the progress of
production jobs through a factory will have among its stakeholders:
● all those people who record, collate and distribute the data under the old system
(e.g. operatives, sales staff)
● all those people who receive data under the old system (e.g. planners, accountants
and the managers of operatives and sales staff)
● anyone who uses the data as information for decision making (e.g. production and
warehouse managers)
● those who design and implement the new system, and to some extent those involved
in the old system (e.g. information systems and IT specialists, programmers)
● suppliers
● any people who maintain the old system or who will maintain the new one
● senior managers who grant the resources needed for the project
● anyone who championed some other project that did not get resources because they
went to this project
● the customers for the factory’s products.
Trying to identify less obvious stakeholders is very important. It is all too easy to confine a
stakeholder analysis to ‘the usual suspects’ such as those listed in Table 4. Another point
to be aware of is that organisations and people can be identified as stakeholders but
ultimately you can only communicate with people so will become necessary to identify the
most appropriate individual stakeholders within a stakeholder organisation so that you
can work with them. It is also the case that changes may occur over time with new
stakeholders emerging and others ceasing to have a role.
Activity 8
15 minutes
Suggest two refinements you could make to the recipient group to make it more
comprehensive.
Discussion
The two we would add are potential customers you are hoping to attract and the key
customers of customers.
In the context of IT systems, Dix et al. (2004) provide a useful distinction between
stakeholders. They identify four classes:
● Primary stakeholders − people who will actually use the system – the end-
users.
● Secondary stakeholders − people who do not directly use the system, but
receive output from it or provide input to it (for example, someone who
receives a report produced by the system).
● Tertiary stakeholders − people who do not fall into either of the first two
categories but who are directly affected by the success or failure of the
system (for example, a director whose profits increase or decrease
depending on the success of the system).
● Facilitating stakeholders − people who are involved in the design,
development and maintenance of the system.
Activity 9
25 minutes
Now read the short description of Riverside House’s situation and try to identify five
groups of stakeholders and think about why you have selected them.
Riverside House is a large NHS general practice. For a variety of reasons they decide
to move from a paper-based patient records system to a fully computerised one, which
will store records of patients’ details and medical history, will issue prescriptions, and
share information with other institutions (such as local hospitals, NHS Trusts, and
different practices). A standard software package has been used for this purpose in
several other local practices, and Riverside House decides to use this also. They
contract with a company that has worked with many of the other practices to install
appropriate computers, software and networks, to maintain the hardware and
software, and to train staff in the system’s use. It is not correct to say that the practice
is introducing an IT system where none previously existed: the paper-based system
also held information, albeit in a different form and allowing different things to be done.
It is more useful to think of them as changing the ‘technology’ of their patient records
system from paper- to computer-based. Each ‘technology’ allows users to do some
things better and makes them do some things worse.
Discussion
The stakeholder groups that occurred to us include:
● Receptionists. With the paper system, they were the people who had the clearest
relationship with the patients’ information. They had to look it up in the files, get it
out for the doctors or nurses, make changes to address details, etc. If doctors and
nurses are able to look up details for themselves, receptionists might feel their
jobs to be threatened (especially if the system has been ‘imposed’ on them by
more senior staff). However, they will still need to enter new and changed details
on the system, and generally be the central point for the management of patient
information.
● Doctors and nurses. These groups have a similar interest in the working of the
new system. Each needs access to the records of the patients they are seeing
next. They will be working with those records in a new way in the computerised
system, but more or less carrying out the same tasks. The new system should
make it easier for them to see patients, and access their records outside of
normal working hours when receptionists might have gone home. As the system
issues prescriptions, doctors will no longer need to write these by hand.
● Patients. The new system makes it easier for patients to obtain repeat
prescriptions as the information is more readily to hand. If they go to the hospital
for treatment, their details can be printed out or sent electronically, making it less
likely that there will be errors as they are copied from one paper form to another.
The new system might mean they have greater access to their records if
requested as the records will not be written in many different styles of
handwriting; but the fact that they are stored on computer might also make
patients more nervous about asking for the information.
● Practice management. Those running the practice find that the system has
particular benefits in the collection of various statistics to be passed on to the
NHS Trust and to government departments. There is an increasing demand for
such statistics: to measure the effective spending of public money; to monitor the
success of health education campaigns; to look for trends in various conditions.
Computerised patient information makes the collation of such statistics much
easier. They may also find that planning for staff use within the practice is easier.
● Computer system retailers/maintainers. Clearly they have benefits in selling their
products and services in the first place. However, it is often the case that their
interests are rather different from those of the various user groups: changes to the
software that might benefit the users could be very difficult or expensive for the
system maintainers to carry out; and new features that developers think are a
good idea might turn out not to be used by anyone. In this example, it is very clear
that the computer people are hired by Riverside House, and so decisions rest with
Riverside; within a larger organisation (with internal computer staff), it is often not
so clear who should make decisions.
● Wider groups such as local NHS Trust, local hospitals, government, local
community, drug companies, etc. who have some interest in the effects of the IT
system at Riverside. We have seen some of the interests of local hospitals, NHS
Trusts and government already – though it is worth noting that all those groups
want to spend as little money as possible, and the computerised system may cost
more. The wider local community is affected by any change to the health of their
neighbours, friends, family or employees that might be caused by changes at
Riverside (the new system will not necessarily make such changes, but it might).
And many further groups might be thought about – to pick one example, what if
drug companies could pay to have their drug’s name appear first on the list when
doctors are creating a prescription?
High
Keep Manage
satisfied closely
Power
Monitor Keep
(minimum effort) informed
Low
Notwithstanding the fact that as Clegg (1989, p. xv) has argued ‘there is no such thing as
a single all-embracing concept of power per se’, it is important to get to grips with this
notion. We might begin by defining power as the ability or capacity to perform or act
effectively; alternatively, we might define it as the ability to direct or influence the
behaviour of others or the course of events in the pursuit of some goal or agenda. In his
classic study, Power: A Radical View, philosopher Steven Lukes (1974, p. 37) identifies
the most basic concept of power as follows:
The principal difference between the first of these three groupings and the other two has
to do with an understanding of power as something that can be possessed by an
individual or group in the former, as contrasted with a view of power as something that is
necessarily ‘situational’ in nature, that is, determined relative to a ‘background’ context
constituted by a network of relations between various actors – for example, stakeholders
– in an organisational setting. Another important distinction is that between the power of
agents (individuals, groups, organisations etc.) and the power of structures in which
such agents are embedded. Structural power can manifest in different domains – social,
economic, cultural, technological and so on – and take a variety of forms including legal,
financial, governmental and educational institutions.
Issues of power are central when considering the role played by different stakeholders in
planning IT systems and, as you saw at the end of the last section, stakeholders can
enhance their power by coming together, mobilising their power in pursuit of a common
goal or agenda. According to Clegg (1990, p. 349) and others, the process of mobilising
power is what is known as politics, and in the remainder of this section our focus will be
on issues of politics and stakeholder power relations within organisations.
Activity 10
15 minutes
Read the description in the box and then try to identify those events which best
illustrate the tension between competition and collaboration. (Hint: in terms of
competition, think about the differential power relations between stakeholders
attempting to avoid taking responsibility for the failure of the project.)
Discussion
There should have been collaboration between the CTO, director of operations and
project sponsor, with the project overseen by the director general of the BBC.
However, the director of operations maintained that at a two-hour meeting on 13
May 2013, where DMI’s future was discussed, the executive board had:
Nonetheless, the tribunal found no evidence of this in the notes of the meeting.
The CTO claimed that the director of operations gave him a choice: resign or go
through a disciplinary process and face dismissal; further, that the blame for the failure
of DMI was unfairly being pinned on him – a case of ‘scapegoating’. This is a case of
competing to avoid taking blame as pointed out in the report of the tribunal.
Linwood started work at the BBC on 6 April 2009, and took on a project that was already
late and over-budget. By that year, outsourced supplier Siemens was terminated and DMI
brought back in house.
What followed was supposed to be a fresh start – or at least a reboot for the project. A new
deadline was set for DMI in February 2011 for the ‘end’ of the year along with new
deliverables – or at least reduced deliverables.
But by summer 2011, the wheels were coming off and it was calculated that some £19m of
projected savings would be lost due to delays and ‘other issues’.
By May 2012, Linwood was tearing his hair out, saying there was a ‘desperate need’ for a
‘senior owner’ from the BBC’s Vision Group to deliver the project.
But by September there was a new director general – George Entwistle – and a new project
sponsor, Zarin Patel, while Linwood had a new line manager – Dominic Coles, the new
director of operations.
It was not until 4 October, ‘once the decision to stop the project had been made’, that Vision
chief creative officer Pat Younge became project sponsor.
Entwistle made it clear he planned to review the ‘relationship’ with technology but by
November, Entwistle was out – thanks to the Jimmy Savile scandal. Tony Hall was only
appointed as director general in April 2013.
By May, the big guns were firing. Former BBC trust chairman Lord Patten attended a BBC
Trust finance committee meeting on 8 May declared his ‘profound concern’ at the massive
write-off, while BBC trustee Anthony Fry promised to ‘fess up’ to the House of Commons
Public Accounts Committee that had been monitoring DMI’s chronic progress and losses.
He also promised to appoint an external consultant who would establish what had gone
wrong on project control and reporting.
A two-hour executive board meeting followed on May 13 2013, where DMI’s future was
discussed. Reviewing a one-page summary of the discussion of that event provided by
Linwood, the tribunal said it found ‘no reference whatever’ made to the embattled CTO.
Coles, however, apparently decided to ‘take stock’ of that day’s discussions and act.
‘It appeared to us, that the executive board had lost confidence in Mr. Linwood’s ability to
act as the BBC CTO and continue to run the BBC’s technology division,’ was his summary
of events that day.
He started working with BBC HR director Richard Burdon on the basis that Linwood ‘had a
case to answer for in relation to DMI’.
Coles’ notes of the board meeting talk of concern about Linwood’s lack of collaboration and
the executive board’s loss of confidence. But, according to the tribunal, he was unable to
explain why none of the content contained in his own evidence was present in the notes of
the meeting.
Coles and Burdon convened a meeting with Linwood on 14 May.
Linwood had no idea what to expect of that meeting but Coles and Burdon did. Burdon, an
HR exec of 20 years, admitted during the tribunal that he and Coles hit Linwood ‘cold’.
Linwood claimed he was given a choice of resigning or going through a disciplinary process
and facing dismissal. Coles and Burdon denied this. The tribunal seems to have sided with
Linwood.
Importantly, Linwood rejected the attempt to pin the blame for DMI on him, while calling the
pair’s actions ‘unfair’ as he had not received a written warning.
By 24 May 2013 it was all over for DMI ... and for Linwood. The BBC went public on its
cancellation of DMI and said chief techie Linwood had been suspended.
(Adapted from Clarke, 2014)
● competition for a resource that is scarce between social actors pursuing the same /
similar goals or different goals
● differing expectations – and behavioural preferences – of joint action
● different attitudes, values, beliefs, and skills.
However, conflict should not be viewed as something that is necessarily bad for an
organisation – irrespective of whether such conflict takes place within the organisation or
between two separate organisations. Increasingly, organisational conflict has come to be
seen as both legitimate and inevitable; it may even be a positive indicator of effective
organisational management. Furthermore, within certain limits, conflict is essential to
productivity: conflict may result in creative solutions to problems, while little or no conflict
in organisations may lead to stagnation, poor decisions and ineffectiveness.
Activity 11
20 minutes
Given what you have learned about the biased nature of stakeholder perspectives,
spend the next few minutes thinking about why understanding stakeholder analysis in
terms of these components might be problematic, and about what goes unchallenged
– or is not subjected to ‘contestation’ – in plotting stakeholders on a power/interest
grid. (Hint: try to think about what is being obscured, albeit unintentionally, in both
situations.) Write down your answer.
Discussion
As described at the start of Section 4, the three main components of stakeholder
analysis are: identify stakeholders; understand key stakeholders; and prioritise
stakeholders. This approach might seem straightforward enough but all three of these
activities can be done in very different ways, and it is easy to miss key stakeholders
due to unconscious bias. For example, there are a variety of stories about IT systems
involving voice recognition that were designed by men who tested the system on
themselves and managed to forget that women and children typically have higher
voices. In some cases this made the first version of the system only suitable for men.
Other stakeholders were ignored. No malice or intentional bias was intended – but
groups were ignored.
The same can be said for the power/interest grid – in itself it is a useful tool, but the
perspectives of those populating the grid must not be ignored. It is not an objective
instrument by itself.
According to Clegg (1989, p. 13), ‘the drawing of political boundaries [that is, the
identification of political groupings] in the formal sense is itself always an act of politics,
representing a mobilisation of bias.’ In short, there is no ‘view from nowhere’, no neutral or
objective vantage point from which a value-free stakeholder analysis can be performed.
Put another way, any identification of stakeholders in an IT system as the stakeholders in
that system will be politically motivated and hence, biased. Given the intrinsic bias (or
subjectivity) of stakeholder identification, the issue becomes one of determining whether
such bias can be legitimised and if so, how this is achieved.
the control of access to and accumulation of specialist knowledge and information about
technology. They wield significant power in many situations, including system design and
implementation, because they possess knowledge and skills that others do not. In
addition, experts who belong to professions are often able to limit access to the power
loop associated with system implementation shown in Figure 3. In terms of what was
stated above about the exercise of stakeholder influence through processes of
legitimisation, it should be noted that in some contexts a professional body is able to
maintain a situation where unless a person is qualified according to a set criterion they
cannot legitimately participate in any aspect of the work of that profession. (This does not
apply to the UK since there is no licence to practice in this context, although the British
Computer Society has worked hard to professionalise IT practice in the UK.)
Development and
implementation of system
Influences Shapes
Defines
All such criteria can and should be looked at from a power perspective. This is because
the very notion of ‘the system’ implies a consensual understanding of a situation, yet this
consensus – assuming it even exists – may only reflect the view of a small number of
stakeholders who are able to exert their influence on others. The same can be said for
determination of the system’s objectives and performance measures: who gets to decide
these, when, where and how? In this connection, consider the following assertion of
Markus and Robey (1983, p. 210):
While an information system might validly fit the organization task and users’
needs and cognitive styles, it might be resisted because it causes a
redistribution of power unacceptable to those losing power. Thus, organiza-
tional validity can also be defined in terms of the distribution of power within an
organization; a system can be said to be invalid to the extent that it embodies a
power distribution at odds with that existing in the organizational context of use.
Activity 12
20 minutes
In Activity 9, you were asked to read a short description of Riverside House, an NHS
general practice transitioning from a paper-based patient records system to a
computerised one. Read through the description again to refresh your memory.
a. For each of the five groups of stakeholders that you identified in that activity, try to
come up with a criterion that it might use to determine system success.
b. For those stakeholders that interact, take a pair of stakeholders and try to identify
the power relations between them in terms of which stakeholder is in a dominant
position and which is in a subordinate position.
Discussion
a. The following six stakeholder groups were listed in the answer to Activity 9 so we
will list criteria for system success for each one.
○ Receptionists: A successful IT system would be one that enables them to do
their job effectively and easily, but also to be able to keep their job.
○ Doctors and nurses: A successful IT system would allow these people to
have easy access to patient records, without going through receptionists,
both from work and home.
○ Patients: A successful IT system would be one that stores their information
correctly and allows relevant staff to access it when needed, as well as
enabling additional functionality such as repeat prescriptions.
○ Practice management: A successful IT system would enable practice
management to produce aggregate statistics, and to allow them to run the
practice more efficiently.
○ Computer system retailers/maintainers: A successful IT system for these
people is one that uses their technology but also requires them to do minimal
additional work.
○ Wider groups with some interest in the effect of the IT system at Riverside:
Success criteria for these groups is multiple and somewhat conflicted –
spending less money, but providing greater functionality in producing
management statistics while maintaining patient privacy.
b. Brief comments on power relations between stakeholder groups.
○ Receptionists are in a subordinate position to doctors and nurses, to practice
management, and somewhat to computer system retailers/maintainers; they
interact with patients but it is not clear whether they are dominant or
subordinate (in some ways both of these). They do not particularly relate to
the wider groups.
○ Doctors and nurses are in a dominant position to receptionists and probably
also to patients (in practice if not in theory). In some practices they will be
dominant to management and in others they are subordinate to it. In power
terms, they are somewhat subordinate to computer system retailers/
manufacturers (as they are users rather than buyers). They will be
subordinate to some wider groups and dominant to others.
○ Patients are in a subordinate position to doctors and nurses and to practice
management; they have a complicated relationship to receptionists. They
probably do not relate to computer retailers/manufacturers (as patients).
They may well form part of the wider groups but, as a group, don’t have a
power relation to them.
○ Practice management are in a dominant position to receptionists, patients
(probably) and computer system retailers/manufacturers. They are some-
times dominant and sometimes subordinate to doctors and nurses, and
likewise to the wider groups (though as the latter are often fund holders, they
are more likely to be subordinate to them).
○ Computer system retailers/maintainers are in a subordinate position to
practice management and in a de-facto dominant position to doctors and
nurses, and to receptionists. They do not really relate to patients or the wider
groups.
○ Wider groups are dominant to some of the above and subordinate to others,
but it varies within each group of stakeholders.
Conclusion
In this course you have learnt about the nature of success in IT systems. In particular you
have learnt about:
We hope you have found this course helpful, and that it’s given you insight into what we
mean by IT systems success. There are many more free OpenLearn courses on aspects
of systems thinking, which expand on topics in this course, including
Systems thinking and practice and an overview of the use of Systems diagramming to
model all kind of systems.
If you would like to learn in more detail about tools for ensuring that IT systems are
successful, the Open University course TM353 IT systems: planning for success may be
for you.
Keep on learning
References
Batty, D. (2013) ‘NatWest hit by system failure less than a year after last outage’,
Guardian, 24 May [Online]. Available at http://theguardian.com/business/2013/mar/07/
natwest-bank-system-failure-outage (Accessed 5 November 2015).
BBC Trust (2014) ‘Trust publishes NAO report into BBC Digital Media Initiative’, BBC
Trust, 23 September [Online]. Available at http://bbc.co.uk/bbctrust/news/press_releases/
2014/nao_dmi.html (Accessed 13 February 2015).
Bryson, J. M. (2004) ‘What to do when stakeholders matter’, Public Management Review,
vol. 6, no. 1, pp. 21−53.
Burton, G. (2013) ‘Bottoms up: pub chain Michells & Butlers’ top-to-toe IT overhaul’,
Computing, 26 June [Online]. Available at http://computing.co.uk/ctg/feature/2277013/
bottoms-up-pub-chain-mitchells-butlers-toptotoe-it-overhaul (Accessed 5 No-
vember 2015).
Business Wire (2003) ‘Latest Standish Group CHAOS Report Shows Project Success
Rates Have Improved by 50%’, Business Wire, March 25 [Online]. Available at http://
businesswire.com/news/home/20030325005636/en/Latest-Standish-Group-CHAOS-Re-
port-Shows-Project (Accessed 5 November 2015).
Clarke, G. (2014) ‘£100m DMI omnifail: BBC managers’ emails trawled by employment
tribunal’, the register, 12 August 2014 [Online]. Available at http://theregister.co.uk/2014/
08/12/bbc_linwood_tribunal/ (Accessed 5 November 2015).
Clegg, S. R. (1989) Frameworks of Power, London, SAGE Publications Ltd.
Clegg, S .R. (1990) Modern Organizations, London, SAGE.
Conlan, T. and Arthur, C. (2013) ‘BBC suspends technology officer after Digital Media
Initiative failure’, Guardian, 24 May [Online]. Available at http://theguardian.com/media/
2013/may/24/bbc-digital-media-initiative-failure (Accessed 5 November 2015).
Davis, K. (2013) ‘Different stakeholder groups and their perceptions of project success’,
International Journal of Project Management, vol. 32, no. 2, pp. 189−201 [Online].
Available at http://dx.doi.org/10.1016/j.ijproman.2013.02.006 (Accessed 5 No-
vember 2015).
DeLone, W. H. and McLean, E. R. (2003) ‘The DeLone and McLean model of information
systems success: a ten-year update’, Journal of Management Information Systems,
vol. 19, no. 4, pp. 9−30.
Dix, A., Finlay, J., Abowd, G. D. and Beale, R. (2004) Human–Computer Interaction,
Harlow, Pearson Prentice Hall.
Eason, K. (2008) ‘Sociotechnical systems theory in the 21st century: another half-filled
glass?’, in Graves, D. (ed) Sense in Social Science: A collection of essays in honour of Dr.
Lisl Klein [Online], Broughton, Desmond Graves, pp. 123−34. Available at http://
bayswaterinst.org/storage/Sociotechnical%20systems%20theory%20in%20the%2021st
%20Century.pdf (Accessed 5 November 2015).
Flyvberg, B. and Budzier, A. (2011) ‘Why your IT project might be riskier than you think’,
Harvard Business Review, September, pp. 23−5.
Fortune, J. and Peters, G. (2005) Information Systems: Achieving Success by Avoiding
Failure, Chichester, Wiley.
Fortune, J., White, D., Jugdev, K. and Walker, D. (2011) ‘Looking again at current practice
in project management’, International Journal of Managing Projects in Business, vol. 4,
no. 4, pp. 553−72.
Freeman, R. E. (1984) Strategic Management: A Stakeholder Approach, Boston, MA,
Pitman.
Griffiths, K. (2013) ‘Co-op to sell mortgage processor’, The Times, 10 June [Online].
Available at http://thetimes.co.uk/tto/business/industries/banking/article3786949.ece
(Accessed 5 November 2015).
Lukes, S. (1974) Power: A Radical View. London, Macmillan.
Markus, L. and Robey, D. (1983) ‘The Organizational Validity of Management Information
Systems’, Human Relations, vol. 36, no. 3, pp. 203−26.
McAvoy, J. and Butler, T. (2009) ‘A failure to learn in a software development team: the
unsuccessful introduction of an agile method’, in C. Barry et al. (eds) Information Systems
Development: Challenges in Practice, Theory, and Education, Vol. 1, Berlin, Springer.
Mendelow, A. (1991) ‘Stakeholder mapping’, Proceedings of the Second International
Conference on Information Systems, Cambridge, MA, December 7−9.
NAO (2013) Universal Credit: Early Progress [Online]. Available at http://www.nao.org.uk/
report/universal-credit-early-progress/ (Accessed 5 November, 2013).
Nasir, M. H. N. and Sahibuddin, S. (2011) ‘Critical success factors for software projects: a
comparative study’, Scientific Research and Essays, vol. 6, no. 10, pp. 2174−86.
Ramage, M. and Shipp, K. (2009) Systems Thinkers, London, Springer.
Standish (2013) ‘The chaos manifesto’, The Standish Group International.
Wateridge, J. (1998) ‘How can IS/IT projects be measured for success?’, International
Journal of Project Management, vol. 16, no. 1, pp. 59−63.
Wedley, W. C. and Ferrie, A. E. J. (1978) ‘Perceptual differences and effects of
managerial participation on project implementation’, Journal of the Operational Research
Society, vol. 29, no. 3, pp. 199−204.
Williams, R. B. (2010) ‘Why we love bad news’, Psychology Today, 30 December [Online].
Available at http://psychologytoday.com/blog/wired-success/201012/why-we-love-bad-
news (Accessed 5 November 2015).
Acknowledgements
This free course was written by Magnus Ramage, Joyce Fortune, Neil Murray and
Mustafa Ali.
Except for third party materials and otherwise stated (see terms and conditions), this
content is made available under a
Creative Commons Attribution-NonCommercial-ShareAlike 4.0 Licence.
The material acknowledged below is Proprietary and used under licence (not subject to
Creative Commons Licence). Grateful acknowledgement is made to the following sources
for permission to reproduce material in this course:
Course image: © Exdez/Getty Images.
Text
Text in Box 1: Courtesy of www.incisivemedia.com.
Text in Box 2: Conlan T., Arthur C., ‘BBC Suspends Technology Officer after Digital Media
Initiative Failure’, 24th May 2014, The Guardian Newspaper.
Text in Box 3: Clarke, G. (2014) ‘£100m DMI Omni fail: BBC Managers' Emails Trawled by
Employment Tribunal’, The Register, 12 August 2014, © The Register, http://www.
theregister.co.uk/
Every effort has been made to contact copyright owners. If any have been inadvertently
overlooked, the publishers will be pleased to make the necessary arrangements at the
first opportunity.
Don’t miss out
If reading this text has inspired you to learn more, you may be interested in joining the
millions of people who discover our free learning resources and qualifications by visiting
The Open University – www.open.edu/openlearn/free-courses.