Pavitt 2006
Pavitt 2006
This article is concerned with innovation processes within firms, focusing mainly on
innovation within large corporations in advanced countries. It draws on empirical studies
of innovation processes, bearing in mind the difficulties for generalization posed by the
highly contingent nature of innovation. It presents a short introduction to the many
theories and empirical studies of innovation and suggests a simple framework for
disaggregating the many innovation activities which take place at the firm level. Three
broad, overlapping subprocesses of innovation are identified: the production of
knowledge; the transformation of knowledge into artifacts—which mean products,
systems, processes, and service; and the continuous matching of the latter to market
needs and demands. This article examines key aspects of each of these three
subprocesses, showing how each has evolved historically and why they pose such difficult
problems for innovation-related managers, entrepreneurs, researchers, and workers.
4.1 Introduction1
THIS chapter concerns innovation processes within firms, focusing mainly on innovation
within large corporations in advanced countries.2 What do we know about the historical
evolution of these innovation processes and about the key challenges facing “innovation
managers” within modern industrial corporations?3 The chapter draws on empirical
studies of innovation processes, bearing in mind the difficulties for generalization posed
by the highly contingent nature of innovation. Section 4.2 presents a short introduction to
the many theories and empirical studies of innovation4 and suggests a simple framework
for disaggregating the many innovation activities which take place at the firm level. Three
broad, overlapping subprocesses (not stages) of innovation are identified: the production
of knowledge; the transformation of knowledge into artifacts—by which we mean
Page 1 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
products, systems, processes, and services; and the continuous matching of the latter to
market needs and demands.5 Sections 4.3 through 4.5 examine key aspects of each of
these three subprocesses, showing how each has evolved historically and why they pose
such difficult problems for innovation-related managers, entrepreneurs, researchers, and
workers. The chapter identifies these management difficulties and points to some of the
strategies firms have deployed to meet these challenges.
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
out to examine a wider set of organizational factors, as well as the skills and experience
of a wider range of individuals participating in each innovation.
(p. 88)
In order to understand this rich but potentially confusing mosaic of knowledge about
innovation processes, I suggest the following general framework:
(1) Innovation processes involve the exploration and exploitation of opportunities for
new or improved products, processes or services, based either on an advance in
technical practice (“know-how”), or a change in market demand, or a combination of
the two. Innovation is therefore essentially a matching process. The classic paper on
this subject is Mowery and Rosenberg (1979).
(2) Innovation is inherently uncertain, given the impossibility of predicting
accurately the cost and performance of a new artifact, and the reaction of users to it.
It therefore inevitably involves processes of learning through either experimentation
(trial and error) or improved understanding (theory). Some (but not all) of this
learning is firm-specific. The processes of competition in capitalist markets thus
involve purposive experimentation through competition among alternative products,
systems, processes, and services and the technical and organizational processes that
deliver them.
• The production of scientific and technological knowledge: a major trend, since the
industrial revolution, has been for the production of scientific and technological
knowledge to have become increasingly specialized, by discipline, by function and by
institution. History and social studies of science, technology and business have
contributed significantly to our understanding of this transformation.
• The translation of knowledge into working artifacts: in spite of the explosive growth
in scientific knowledge in recent years, theory remains an insufficient guide to
technological practice. This reflects an underlying trend for growing complexity of
technological artifacts,8 and in the knowledge bases underpinning them. Technological
and business history have made major contributions here as have the cognitive
sciences more recently.
• Responding to and influencing market demand: this involves a continual process of
matching working artifacts with users' requirements. The nature and extent of the
opportunities to transform technological knowledge into useful artifacts vary amongst
fields and over time, and determine in part the nature of products, users and methods
of production. In the competitive capitalist system, corporate technological and
organizational practices co-evolve with markets. Social change and innovations in
Page 3 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
marketing and market research have contributed to complex problems and equally
complex solutions to the challenge of matching technological opportunities with
market needs and organizational practices. These (p. 89) processes are central
concerns of scholars in management, economics and marketing studies.
I now discuss the implications of change over time in the structure and nature of each of
these features of innovation processes. Such change presents considerable challenges to
the modern innovation manager and to the corporation as a whole.
Page 4 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
dependent pattern of technical change that places great demands on corporations for
coordination of processes within their boundaries and between these organizations and
others external to the firm. These processes of change, examined below in more detail,
have intensified and broadened the challenges facing managers, “intrapreneurs,” and
entire corporations.10
A major source of innovation in the twentieth century was the industrial R&D laboratory,
which remains important in the twenty-first century. It emerged first in Germany in the
chemical industry and in the USA in the electrical industry, for two reasons. It was part of
the more general process of functional specialization of the large manufacturing firm
(Mowery 1995; see also the chapter by Bruland and Mowery in this volume), which itself
emerged from the exploitation of economies of scale and speed made possible by radical
innovations in materials processing and forming, and in power sources (Chandler 1977).
But the industrial research laboratory also provided these firms with a means for
exploiting the rich veins of useful knowledge emerging from fundamental advances in
chemistry and physics. In addition, these new in-house laboratories served as a
“monitoring post” for established firms seeking to acquire new technologies from other
firms.
Mowery (1995) has shown for the USA that a growing proportion of industrial R&D in the
twentieth century was integrated within large manufacturing firms, rather than in
independent companies. Until about 10 years ago, business-funded R&D in all OECD
countries was almost exclusively performed within innovating firms (not only
manufacturing firms, since telecommunications and some other services have long
undertaken R&D). Mowery explained this lack of vertical disintegration by the difficulties
of writing contracts for an activity whose output is uncertain and idiosyncratic, and
pointed out that integration of R&D within the firm reflected important operating
advantages as well. Thus competitive advantage can be gained by the effective
combination of specialized and often tacit knowledge across functional boundaries, within
the individual firm. Accumulated firm-specific experience is very important.11
A robust conclusion emerging from research on innovation processes is that one of the
most important factors differentiating successful from unsuccessful innovation has been
the degree of collaboration and feedback between product design and other corporate
functions, especially manufacturing and marketing within the firm (Rothwell 1992). Many
product designs turn out to be technically difficult (even (p. 91) impossible) to
manufacture, and/or fail to take into account often elementary user requirements (Forrest
1991).
From a corporate strategy perspective, the importance of such intrafirm collaboration has
increased the importance of cross-functional integration spanning departmental
boundaries. Japanese automobile firms pioneered the use of “heavyweight” project
Page 5 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
managers, empowered to control resources across the firm, reporting directly to the
senior management team at the same level as the departmental manager (Clark and
Fujimoto 1992). These project managers were in turn linked to innovation processes
within customers and key suppliers, enabling fast, project-based innovation. These
“heavyweight” project managers occasionally clash with functional bosses, some of whom
are unwilling to “give up” control over their resources and object to project-led
management. Many large firms now provide formal training in project management to
their professional project manager, covering such issues as management of fast-moving
project teams responsible for integrating research outputs, conceptual and detailed
design, and various engineering functions, while at the same time responding to changing
or emerging customer requirements during the production process.
Many writers stress the importance of personal contacts and exchanges across functions
within the firm to deal with tacit elements of both product design and its successful
transfer to manufacture and market. There is no perfect or foolproof process for ensuring
effective coordination. Indeed, so called “best practice” can be positively harmful when
its application is taken too far. Excessive use of “heavyweight” project managers can lead
to the loss of such benefits from integration as economies of scale, and cost reductions
from the use of common components (e.g. in automobile development; see Leonard-
Barton 1995). Firms can find it hard to decide what to do with a heavyweight product
manager (and the associated staff) when a product development is failing. Failure to
grasp this difficult nettle can lead to the problem of “escalation” or an inability to
terminate a failing project.12 Managing the trade-offs between project and functional
management, and overcoming the inherent difficulties in project-based management,
present major difficulties to senior technology managers.
Even in industries with heavy investments in product innovation, however, some “vertical
disintegration” (outsourcing of specific activities to supplier firms) in manufacturing
process innovation has occurred since the nineteenth century, often stimulated by
technological advances. Rosenberg (1976) highlighted the emergence of specialized
machine tool firms in the nineteenth-century US economy as a (p. 92) result of advances
in metal cutting and metal-forming techniques that produced technological
“convergence” in operations that were common to a number of manufacturing processes.
For example, boring accurate circular holes in metal was an operation common to the
making both of small arms and of sewing machines. Although the skills associated with
such machining operations were often craft-based and tacit, their outputs could be
codified and standardized. The demand for such common operations grew sufficiently
that markets for machines to perform them became large enough to sustain the growth of
specialized firms who designed and made such machines. Large manufacturing
customers could therefore buy machines that incorporated the latest improvements
Page 6 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
(drawing on the feedback from many users) and were far superior to what they could do
by themselves.
Lundvall (1988) and other writers show that the links between the (often small) firms
providing these specialized production inputs and their (mainly large) customers are
often “relational” rather than arm's-length, and include considerable exchange of
information and personnel related to the development, operation and improvement of the
specialized inputs. Managing the outsourcing of these critical inputs has become a major
challenge to managers of large firms (Quinn 2000). For (p. 93) example, logistics and ICT
systems often differ between component suppliers and integrator companies, creating
serious (albeit often technically simple) problems for communication and transactions
among these firms. More fundamentally, the choice of which activities to outsource and
which to retain in-house defines the “core competence” of the modern corporation,
molding the boundaries of the firm (Hamel and Prahalad 1994; Davies et al. 2001).
Page 7 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
The range of interactions between firms and universities is considerable. At one extreme,
there is something close to the so-called (but relatively rare) “linear model.” Here,
fundamental research by a university scientist leads to a discovery, its practical
importance is recognized by a business firm, which may collaborate with the university
scientist in order to exploit it. This happens most often in science-based industries
including the chemical, biotechnology, and pharmaceutical sectors, where the focus is on
the discovery of interesting and useful synthetic molecules.
At the other extreme, the provision of trained researchers, familiar with the latest
research techniques and integrated in international research networks, is important to
firms. It is ranked by many industrialists as the greatest benefit provided by universities
(Martin and Salter 1996). Thus, even if university research in mechanical engineering has
fewer direct applications than research in chemistry, it still provides mechanical
engineers trained (for example) in those simulation and modelling techniques that are
increasingly important in the design and development of automobiles and aero-engines.
(1) The importance of personal and often informal contacts. Informal relationships
give practitioners entry points into the academic world, people who they can ask
about where the important developments lie and who the relevant people are. Such
relationships give researchers insight into the (p. 94) problems that are confronting
industry, how the leading edge of corporate practice is developing, and so on. The
informal relationships can result in formal outputs that can in turn trigger more
informal contacts. For instance, industrial publications in the scientific literature can
be seen as signals to the wider academic community of fields and problems of
industrial interest that would benefit from more intense personal exchanges (Hicks
1995).
Page 8 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
Over the past twenty years, governments have begun to expect greater direct usefulness
from university research. Often this has been supported by empirically questionable
assumptions and theories,13 or an incomplete understanding of the indirect benefits
actually valued by industrialists. For entirely different reasons, certain fields of university
research—many fields of biotechnology and some of software and related activities—now
provide an increasing stream of inventions with potential industrial application. These are
reflected in increases in university licensing activity, in university-founded spin-off firms,
and increases in private funding of university research. In Chapter 8, Mowery and
Sampat discuss the nature and implications of these recent developments.
Page 9 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
Page 10 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
The heterogeneity and contingent nature of innovation means that there can be no simple
“best practice” innovation model for firms or managers to follow. Each firm proceeds on
the basis of its prior experience and the technological trajectories evident in the specific
industry or product group. But the lack of global “best practices” should not be taken to
mean that innovation strategy does not matter, nor that good management cannot make a
difference to firms' productivity, market share, or profitability.
Managers involved in transforming S&T knowledge into products, systems, and services
need to be aware of four sets of specific trends in their industries. These are: (a)
technology trajectories and scientific theories; (b) where relevant, governmentfunded
R&D programs; (c) systems integration; and (d) techniques and approaches to managing
uncertainty. I deal with each of these issues below.
(p. 97)
In spite of the spectacular increases in scientific knowledge over the past 200 years,
theory remains an insufficient guide to technological practice. This is partly because of
the increasing complexity of physical artifacts and the knowledge bases that underpin
them. The importance of practice is reflected in the continuing dominance in industrial
R&D laboratories of development activities—the design, building and testing of specific
artifacts—compared to research in fields on which they are based. Constant (2000)
describes this as technology advancing through the recursive practices of scientists and
engineers, involving “alternate phases of selection and of corroboration by use…. The
result is strongly corroborated foundational knowledge: knowledge that is implicated in
an immense number and variety of designs embodied in an even larger population of
Page 11 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
devices, artifacts, and practices, that is used recursively to produce new knowledge” (p.
221).
Nightingale (2000) has shown that these mechanisms have radically changed
experimental techniques in the pharmaceutical industry during the past ten years. There
has been a shift towards more fundamental science, for example, linking biochemical
mechanisms to the expression of genes; and there has been a much greater use of
simulations (involving models, extensive data banks, etc.) to conduct (p. 98) virtual
experiments complementary to real ones. A third related development has been the use of
high throughput screening techniques.20
Page 12 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
well as the case studies in Nelson 1982). More recently, policies to encourage the
development of renewable energy technologies have met with mixed success. And
controversy surrounds the achievements of a whole series of EU programs.
Since the 1980s government programs for “pre-competitive” collaborative R&D in Europe
(e.g. ESPRIT and Eureka), the USA (e.g. Sematech) and Japan (e.g. the 5G ICOT
Program) have proliferated. Thus, most major firms are presented with opportunities for
participation in such programs. Firms require methods for evaluating their potential
contribution to corporate goals, the financial and organizational costs of participating,
the risks involved in not participating, and the ways in which government programs can
complement or fit into the overall corporate strategy (Floyd 1997).
It is difficult to generalize from the recent history of government support for industrial
innovation. All such programs involve technical lobbies successfully putting pressure on
governments for financial support, often in fields related closely to military applications,
or (often large-scale) infrastructure, such as transport, energy, housing, and
communications. This process can lead to neglect of commercial constraints and to
premature commitments to particular designs. Economists highlight the opportunity costs
of these programs; but government support can also speed up critical technological
learning at a time when purely private markets are not ready to take the risks. The early
development of ICT in the USA suggests the importance of diversity and experimentation
in government support for technological progress. But would this have worked for the
development of high-speed trains, where the costs of experiments are much higher and
technical change is more incremental? And, as we shall see in the next section, everyone
makes mistaken assumptions about future developments in a complex and fast-changing
world.
Integration
Firms designing these increasingly complex products find it difficult to master advances
in all the fields that they embody. Hence the growing importance of modular product
architectures, where component interfaces are standardized, and interdependencies
amongst components are decoupled. This enables the outsourcing of design and
production of components and subsystems, within the constraints of overall product (or
system) architecture.
Page 13 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
At first sight, these recent changes might appear to point to a neatly specialized system
for the production of innovations, with product and systems designers, their
subcontractors for components and subsystems, and their manufacturers, working
together through arm's-length market relations—a trend foreseen by Sturgeon (1999).
But this neglects the consequences of important distinctions that need to be made
between the properties of artifacts, the knowledge on which they are based, and the
degree to which such knowledge can be transformed into codified information
(Granstrand et al. 1997).
Briefly stated, the development and production of increasingly complex artifacts are, as
we have seen, based on the integration of an increasing number of fields of specialized
knowledge. These fields advance at different speeds and their progress cannot be tracked
solely by monitoring codified information. The division of labour between companies in
production thus cannot be mirrored by an equivalent (p. 100) division of labour in
knowledge (Brusoni et al. 2001). Some overlap between companies in knowledge
competencies is necessary to deal with the transfer of tacit knowledge, to manage
unforeseen consequences of systemic complexity, and to resolve imbalances between
components that are liable to result from their uneven rates of technical change.
Similarly arm's-length relations between firms will not be as effective as forms of “loose
coupling” with periodic bouts of integration, when systems architectures and the tasks of
component suppliers are redefined by firms specializing increasingly in systems design
and integration.
Specialized R&D and related activities in business firms have become institutionalized
and predictable sources of discoveries, inventions, innovations, and improvements.
However, the process of innovation is complex, involving many variables whose
properties and interactions (and economic usefulness) are understood imperfectly. As a
consequence, firms are not able to explain fully and predict accurately either the
Page 14 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
Business firms (and others) rarely are capable of defining the full array of possible uses
that may emerge for their innovations, especially radical ones. Examples of inaccurate
predictions about what turned out later to be spectacularly successful technologies and
innovations are legion. Early twentieth-century pioneers of radio communication
conceived it as a system of point-to-point communications, particularly between naval
vessels—it was only much later that the much larger market for mass radio
communications was recognized. After World War II, the founder of IBM foresaw a world
market for computers in single figures. For the more recent period between the 1960s
and the 1980s, Schnaars and Berenson (1986) concluded that only about half the major
new product families announced in the USA turned out to be commercially successful.
The recent experience of inaccurate forecasts of the potential markets for various
generations of the mobile phone, and various functions associated with these (the
unexpected success of text messaging, for instance) is equally instructive.
(p. 101)
Corporate managers therefore face severe difficulties in deciding how to deal with
innovative activities, which have some of the elements of conventional investment
activities, but for which severe uncertainty means that continuous feedback from the
market, past experience and experimentation are essential. In practice, top-down
corporate visions can be a poor guide to innovation strategies. Ericsson's success in
opening up mobile telephony began with initiatives from middle-level technical
management, rather than from the top. In the academic and business literatures, the
failures of top-down visions are easily forgotten and the successes oversimplified. For
example, Prahalad and Hamel (1990) tell the story of Canon's successful diversification
from optics and precision mechanics into electronics technology, and from cameras into
photocopying and computer peripheral products; but they ignore the firm's failed
diversification into recording products and electronic calculators (Sandoz 1997).
The broad differences between search and selection activities have been recognized for a
long time—in practice, with the distinction between corporate and divisional R&D
activities; and in theory with the distinction between “knowledge building” and “strategic
positioning” on the one hand, and “business investment” on the other (Mitchell and
Hamilton, 1988). However, as the recent history of corporate R&D shows, maintaining
Page 15 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
balance and linkages between the two is not an easy task. Briefly stated, there is no one
best way of evaluating the costs and benefits of corporate R&D expenditures ex ante.
Rule-based systems fail, because they inevitably simplify, and may therefore neglect what
turn out to be important factors in a complex system. Judgement-based systems fail,
because of the impossibility of quickly distinguishing good judgement from good luck.
One consequence is periodic swings in fashions and management practices. These often
reflect struggles for influence between financially trained managers, who tend to prefer
rule-based systems, and those who are technically trained and prefer to rely on technical
judgements.
Chandler (1977) has shown that the rise in the USA at the end of the nineteenth century
of the large, multi-unit firm, and of the coordinating function of professional middle
managers, depended critically on the development of the railroads, coal, the telegraph,
and continuous flow production. Similarly, the later development of the multidivisional
firm reflected in part the major opportunities for product diversification in the chemical
industry opened up by breakthroughs in synthetic organic chemistry. Although it is
commonplace today to argue that technologies and organizational practices do, or should,
co-evolve with market demands, there is some risk of “technological determinism” in
Chandler's argument that this process largely involves the adaptation of corporate
organizational practices to emerging market needs and technological opportunities.
Technical advances often precede organizational and market advances, among other
reasons because of the firmer knowledge base and lower costs of experimentation
associated with technical, as opposed to market or organizational, innovation. This does
not mean that technology imposes one organizational “best way” or even a clear strategy
towards the marketplace. Variety in the characteristics of technologies, their continuous
change and uncertain applications also produces variety and experimentation in
Page 16 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
organizational and marketing practices. But this variety and change does not mean that
“anything goes” in either organizational or marketing terms. It may be practically
impossible for a firm that wishes to remain competitive to resist making use of new
technologies and knowledge in its own future product and process development—unless
it wishes to become a niche producer like the manufacturers of clockwork watches and
analogue record players. But moving into new technologies without appropriate changes
in terms of skills and training, divisions of labour and interrelations between parts of the
organization, can be even more costly. Or consider the firm's investment decisions. A firm
applying conventional cost–benefit analysis and strict cost controls to all of these
decisions will not prosper in the long term in a competitive market governed by (p. 103)
the exploitation of a rich, varied and rapidly advancing body of technological
knowledge.23
The empirical literature summarized in the first two columns in Table 4.2 highlights the
organizational and marketing practices that must be made consistent with key features of
technologies:
• External linkages with potential customers, and with the important sources of
knowledge and skills.
• Internal linkages in the key functional interfaces for experimentation and learning.
• The centralization of resource allocation and monitoring activities needs to be
consonant with the costs of technological and market experimentation.
Inherent characteristics
Page 17 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
(p. 104)
• Criteria for resource allocation need to be consonant with levels of technological and
market opportunity.
• Alignment of professional groups, who possess power and control, with fields of
future opportunity.
The richness of the technological and market opportunities and the scale of technical
experiments should determine the appropriate share of resources allocated to
technological search, as well as the degree of centralization and fluidity in organization
structures. Supporting skills and networks will define the specific competencies to be
accumulated, professional networks to be joined and key functions and functional
interfaces within and across which learning must take place within the firm.
The particular circumstances of the individual firm and project will obviously define the
basic skills required for commercial innovation. But the discussion in this chapter leads to
a clear-cut conclusion: in addition to specialist skills, “gatekeeper” skills and general
communication skills now are more important almost everywhere. People who are
capable of communicating across organizational barriers, disciplinary barriers, and
professional barriers can be invaluable. In very small firms it may be satisfactory for one
or two key individuals to possess the unique combination of required skills. In larger
Page 18 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
firms, the specific requirements may be hard to anticipate. There is no single managerial
planning prescription.
The past 200 years have seen periodic step-jumps in technological understanding and
performance in specific fields. During the past several decades, these discontinuous
advances have been more often than not based on major scientific breakthroughs.
“Radical” innovations have reduced considerably the costs of key economic inputs, and
have therefore been widely adopted and become the catalysts for major structural
changes in the economy. They include steam power, electricity, (p. 105) motorization,
synthetic materials, and radio communications (Freeman and Louçã 2001). The most
celebrated contemporary example, of course, is the massive and continuing reductions in
the costs of storing, manipulating, and transmitting information brought about by
improvements in ICT.
Each wave of radically new technologies has been associated with the growth of firms
that have mastered the new technologies and have pioneered in the development and
commercialization of related products, processes, and services. In the current jargon of
corporate strategy, these firms have developed core competencies in the new
technologies, which have become a distinctive and sustainable competitive advantage.
Ever since Schumpeter associated the advent of revolutionary technologies with “waves
of creative destruction,” there has been debate about the relative role of incumbent large
firms and new entrants in exploiting them. Over the past twenty years, most of the
analytical writing has been stacked against incumbents, although recent empirical
studies point to evidence in favour of both (Methe et al. 1996). Over time, the weight of
the argument has shifted somewhat away from emphasis on the difficulties facing
incumbents in mastering new fields of technological knowledge (Cooper and Schendel
1976; Tushman and Anderson 1986; Utterback 1994).
More recent work has emphasized the difficulties faced by incumbent firms that must
adapt established organizational practices to seize the opportunities opened by
revolutionary technological changes. Examples include the organizational consequences
of changes in product architectures (Henderson and Clark 1990), resistance from groups
Page 19 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
with established competencies (Leonard-Barton 1995; Tripsas and Gavetti 2000), and the
unexpected emergence of new markets (Christensen 1997; Levinthal 1998).
The third column of Table 4.2 identifies some reasons why such experiments may fail in
incumbent firms. Some are a consequence of the need to modify competencies or
organizational practices; and some of the inevitable uncertainties in the early stages of
radically new technologies. The likelihood that established firms will fail increases with
the number of practices and competencies that need to be changed. (p. 106) Here a
comparison between the conclusions of two recent industry studies is instructive. Klepper
and Simons (2000) have shown that firms already established in making radios were
subsequently the most successful in the newly developing colour TV market. On the other
hand, Holbrook and his colleagues (2000) have shown that none of the firms established
in designing and making thermionic valves was subsequently successful in
semiconductors.
With the benefit of hindsight, we can see that success in semiconductors required more
changes in technological competencies, organizational practices, and market
experimentation amongst incumbents, than did success in colour TV. The valve firms
required new competencies and networks in quantum physics, a much stronger interface
between product design and very demanding manufacturing technology, and the ability to
deal with new sorts of customers (computer makers and the military, in addition to
consumer electronics firms). For the radio firms, the shift to color TV required basically
the same technological competencies, augmented by well-known screen technologies.
Otherwise, the customers and distribution channels remained unchanged, as did the key
networks and linkages both inside and outside the firm.
Page 20 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
minority of the largest firms was able to remain at the top through several waves. This
suggests that the micro-level evidence considered in this Section, especially the factors
listed in the third (right-hand) column of Table 4.2, have had significant consequences for
the evolution of industry structure.24 Radical technological change, and the success or
failure of incumbent firms in adapting to it, thus may have important consequences for
structural change in the economy as a whole.
Firms in the vanguard of developing and exploiting radically new technologies must be
distinguished from the more numerous firms who adopt and integrate the new
technologies with their current activities. For these firms, in-house competencies in the
new technologies are background: in other words, necessary for the effective adoption of
advances made outside the firm. Paradoxically, the very fact that radically new
technologies allow step-jump reductions in the costs of a key input simultaneously makes
their adoption a competitive imperative and an unlikely source for sustained competitive
advantage among adopting firms. For example, in the past many factories had no choice
but to adopt coal and steam—and later electricity—as a source of power, given their cost
and other advantages. The same is true today for many ICT-based management practices.
But in neither case were these revolutionary advances by themselves a source of
sustainable competitive (p. 107) advantage for the adopting firms. Much of the emphasis
by writers on corporate strategy—like Barney (1991) and Porter (1996)—on the
importance of establishing a distinctive and sustainable advantage accordingly does not,
and cannot, apply to the major transformations now inevitably happening in many
companies through the adoption of ICT. Their framework can help understand CISCO (a
major US supplier of equipment for the Internet), but does not help much with TESCO (a
major UK supermarket chain, increasingly using the Internet).
The difficulties in introducing the new, in the face of the tried and tested old, were spelled
out long ago:
It must be considered that there is nothing more difficult to carry out, nor more
doubtful of success, nor more dangerous to handle, than to initiate a new order of
things. For the reformer has enemies in all those who profit from the old order of
Page 21 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
things, and only lukewarm defenders in all those who would profit by the new
order, this lukewarmness arising partly from fear of their adversaries … and partly
from the incredulity of mankind, who do not truly believe in anything new until
they have had actual experience of it. Thus it arises that on every opportunity for
attacking the reformer, his opponents do so with the zeal of partisans, the others
only defend him half-heartedly. (Machiavelli 1950: 21–2)
Well-documented contemporary examples of this process include IBM's early reluctance to enter
the personal computer market and Polaroid's early commitment but subsequent failure to
develop a business based on digital imaging (Tripsas and Gavetti 2000). In both cases, a
company with the technical resources to develop the new technology, failed to do so, due to
resistance and scepticism from the established power structures. In these cases, it can plausibly
be argued that yesterday's “core competencies,” became today's “core rigidities” (Leonard-
Barton 1995).
But the new does not always turn out to be better than the old. Conservative resistances
in oil companies to investments in nuclear power in the 1970s turn out to have been
largely justified. So, more recently, was scepticism about the dot.com (p. 108) boom. And
in the light of IBM's subsequent success in systems integration and software, resistance
to heavy commitment to the PC could yet be seen as beneficial in the longer run. This is
what makes decision making about radical innovations so difficult. The political battle for
influence often involves one-sided and distorted analyses, reflecting the interests of
specific disciplines and functions. Crucial factors and key uncertainties may be ignored,
consciously or otherwise. The successes and failures only become clear well after the
smoke of battle has cleared.
For today's corporate manager there can be no simple tools or model to neutralize the
uneasy, politicized task of dealing with radical innovations. Good judgement, experience,
trial and error learning remain the only feasible “toolkit” available to today's innovative
corporations.
4.6 Conclusions
Despite spectacular improvements in the scientific knowledge base, and slower but
steady improvements in organizational know-how, innovation processes are neither tidy,
nor easy to delineate or manage. Increasing specialization in the production of artifacts
and in knowledge has also increased levels of complexity—in artifacts themselves, in the
knowledge on which they are based, and in the organizational forms and practices for
their development and commercial exploitation. As a consequence—and contrary to some
of the predictions of Schumpeter (1962) and Penrose (1959):
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
As a consequence, established large firms have sometimes found it difficult to deal with
the radically new. In the future, they will confront new challenges. Increasing
complexities in products, systems and the underlying knowledge base are leading firms to
experiment with modular product architectures and greater use of ICTs and the
outsourcing of component design and production. Large innovating firms are therefore
likely to become less self-sufficient in their processes, not more so.
(p. 109)
References
ARIS, S. (1998), Arnold Weinstock and the Making of GEC, London: Aurum Press.
BECKER, G., and MURPHY, K. (1992), “The Division of Labour, Co-ordination Costs, and
Knowledge,” The Quarterly Journal of Economics 107: 1137–60.
—— (1997), “The United States: Engines of Economic Growth in the Capital Intensive and
Knowledge Intensive Industries,” in A. Chandler, F. Amatori, and T. Hikino (eds.), Big
Business and the Wealth of Nations, Cambridge: Cambridge University Press.
Page 23 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
DAVIES, A., TANG, P., BRADY, T., HOBDAY, M., RUSH, H., and GANN, D. (2001),
Integrated Solutions: The New Economy between Manufacturing and Services, Brighton:
SPRU.
DRUCKER, P. F. (1985), Innovation and Entrepreneurship, New York: Harper & Row.
—— and LOUÇÃ, F. (2001), As Time Goes By: From the Industrial Revolutions to the
Information Revolution, Oxford: Oxford University Press.
GEORGHIOU, L., METCALFE J. S., GIBBONS M., RAY, T., and EVANS, J. (1986), Post-
Innovation Performance, Basingstoke and New York: MacMillan.
GIBBONS, M., LIMOGES, C., NOWOTNY, H., SCHWARTZMAN, S., SCOTT, P., and
TROW, M. (1994), The New Production of Knowledge, the Dynamics of Science and
Research in Contemporary Societies, London: Sage.
Page 24 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
HAMEL, G. (2000), Leading the Revolution, Boston: Harvard Business School Press.
—— and PRAHALAD, C. K. (1994), Competing for the Future, Boston: Harvard Business
School Press.
HOBDAY, M. (1995), Innovation in East Asia: the Challenge to Japan, Aldershot: Edward
Elgar.
* HOLBROOK, D., COHEN, W., HOUNSHELL, D., and KLEPPER, S. (2000), “The
Nature, Sources, and Consequences of Firm Differences in the Early History of the
Semiconductor Industry,” Strategic Management Journal 21: 1017–41.
KLEPPER, S., and SIMONS, K. (2000), “Dominance by Birthright: Entry of Prior Radio
Producers and Competitive Ramifications in the U.S. Television Receiver Industry,”
Strategic Management Journal 21: 997–1016.
LEVINTHAL, D. (1998), “The Slow Pace of Rapid Technological Change: Gradualism and
Punctuation in Technological Change,” Industrial and Corporation Change 7: 217–47.
LOUÇÃ, F., and MENDONÇÃ, S. (1999), “Steady Change: The 200 Largest US
Manufacturing Firms in the Twentieth Century,” Working Paper No. 14/99, CISEP-ISEG,
UTL, Lisbon.
Page 25 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
MACHIAVELLI, N. (1950 edn.), The Prince, New York: Modern Library College
(p. 113)
Editions.
MAHDI, S. (2002), “Search Strategy in Product Innovation Process: Theory and Evidence
from the Evolution of Agrochemical Lead Discovery Process,” D.Phil. Thesis, Unpublished,
SPRU, University of Sussex.
MARTIN, B., and SALTER, A. (1996), “The Relationship between Publicly Funded Basic
Research and Economic Performance: a SPRU Review,” Report for HM Treasury, SPRU,
University of Sussex.
MOWERY, D. (1995), “The Boundaries of the U.S. Firm in R&D,” in N. R. Lamoreaux and
D. M. G. Raff (eds.), Coordination and Information: Historical Perspectives on the
Organization of Enterprise, Chicago: University of Chicago Press of NBER.
NARIN, F., HAMILTON, K., and OLIVASTRO, D. (1997), “The Increasing Linkage
Between U.S. Technology and Public Science,” Research Policy 26: 317–30.
Page 26 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
PENROSE, E. T. (1959), The Theory of the Growth of the Firm, Oxford: Basil Blackwell.
PRAHALAD, C. K., and HAMEL, G. (1990), “The Core Competence of the Corporation,”
Harvard Business Review, 90(3): 79–91.
(p. 114) ROBERTS, E. (1991), Entrepreneurs in High Technology: Lessons from MIT and
Beyond, Oxford: Oxford University Press.
—— (1994), Exploring the Black Box: Technology, Economics and History, Cambridge:
Cambridge University Press.
*—— FREEMAN, C., HORSLEY, A., JERVIS, V., ROBERTSON, A., and TOWNSEND, J.
(1974), “SAPPHO Updated—Project SAPPHO Phase II,” Research Policy 3(3): 258–91.
Page 27 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
SALTER, A., D'ESTE, P., MARTIN, B., GEUNA, A., SCOTT, A., PAVITT, K., PATEL, P.,
and NIGHTINGALE, P. (2000), Talent Not Technology: Publicly Funded Research and
Innovation in the UK, CVCP, SPRU, and HEFCE.
SCHUMPETER, J. (1962), Capitalism Socialism and Democracy, 3rd edn., New York:
Harper Torchbooks Edition (originally published 1942 by Harper and Brothers).
SMITH, A. (1937), An Inquiry into the Nature and Causes of the Wealth of Nations, New
York: Modern Library Edition.
* TIDD, J., BESSANT, J., and PAVITT, K. (2001), Managing Innovation: Integrating
Technological Market and Organizational Change, 2nd edn., Chichester: Wiley.
TRIPSAS, M., and GAVETTI, G. (2000), “Capabilities, Cognition and Inertia: Evidence
from Digital Imaging,” Strategic Management Journal 21: 1147–61.
VAN DE VEN, A., POLLEY, D. E., GARUD, R., and VENTKATARAMAN, S. (1999), The
Innovation Journey, New York: Oxford University Press.
Notes:
(1.) Keith Pavitt had prepared several drafts of this chapter, but passed away before
completing it. Amendments to the original have been made by Christopher Freeman,
Mike Hobday, Ian Miles, and the editors.
(2.) This chapter focuses mainly on large firms within the USA, Europe, and Japan. It does
not consider issues arising in connection with entrepreneurial attitudes and motivations,
such as their willingness to take risks (Drucker (1985) examines some of the links
between entrepreneurship and innovation, and Roberts (1991) and Oakey (1995) examine
the process of innovation within SMEs). For studies of innovation processes within firms
Page 28 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
based in the industrializing countries (or “latecomer firms”) see Hobday (1995), Kim
(1997), and Fagerberg and Godinho in this volume.
(3.) Arguably, “innovation managers” (in practice, if not formally identified by job title)
can be found at all levels of the firm (for an overview of innovation management in firms
see Tidd et al. 2001). Hamel (2000) examines “strategic innovation” (or innovation in
strategy approach) while Schonberger (1982) and Robinson (1991) deal with kaizen (or
continuous improvements) to current vintages of capital equipment and organization.
(4.) For critical assessments of firm-level models of innovation, ranging from the linear
model to chain-link models and more recent interactive/contingent models, see Rothwell
(1992), Forrest (1991) and Mahdi (2002).
(5.) The term “stages” is avoided here, as it implies linearity. Research has consistently
shown that the process of innovation within the firm is anything but linear (Kline and
Rosenberg 1986; Tidd et al. 2001; Van der Ven et al. 1999). The three sub-processes of
innovation, although distinctive, overlap considerably and often occur concurrently.
(6.) For a review of models of innovation and the importance of contingency, see Mahdi
(2002: ch. 2).
(7.) As noted earlier, most innovation processes are overlapping and intertwined, terms
like “stages” or “phases” impose an unrealistic linearity on the various innovation
processes.
(8.) Recall that by artifacts we mean services and systems as well as more tangible
material artifacts such as items of equipment.
(9.) The classic texts on this are Rosenberg (1974), Price (1984), and Mowery and
Rosenberg (1989).
(10.) See Pinchot (1997) for a discussion of the intrapreneur, that is, an innovator
operating within a large corporation.
(12.) For a discussion of escalation using examples from the UK stock exchange and other
major ICT project failures, see Flowers (1996). In the public sector, or state-dependent
industries, the problem can be acute. The experience of many countries that established
agencies to develop nuclear power, for instance, suggests that these are often extremely
difficult to restrain.
(13.) Three very different lines of argument have been mobilized over recent years. First
is the view that the output of university research is a free good available to everybody—as
assumed by orthodox economics. In contrast, a second view argues that publicly funded
university research is a form of conspicuous intellectual consumption reflecting
technological and economic achievements, but not contributing to them (as suggested by
Kealey 1996). A more nuanced argument is the “mode 2” claim that the locus of useful
Page 29 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
(16.) Community Innovation Survey data (see the chapter by Smith in this volume for
further discussion) are now beginning to provide us with systematic data on many
aspects of the innovative effort and sources of innovative ideas for firms of different types
and in different sectors.
(17.) For example, in the absence of theory and/or cheap methods for constructing and
testing prototypes, the costs of search and selection become prohibitively high—see
Martin (2000) on why Japanese swords did not improve over a period of more than 500
years.
(18.) See e.g. Rosenberg and Nelson (1994) on the origins of the engineering disciplines
in US universities.
(19.) A similar conclusion has been reached by Becker and Murphy (1992). They argue
that the degree of specialization in tasks is limited not by the extent of the market, as in
Smith's famous formulation, but by the costs of coordinating specialized activities. These
coordination costs are reduced by increases in general knowledge.
(21.) Sturgeon lists apparel and footwear, toys, data processing, offshore oil drilling,
home furnishings and lighting, semiconductor fabrication, food processing, automotive
parts, brewing, enterprise networking, and pharmaceuticals. In addition, Prencipe (1997)
demonstrates that outsourcing has increased in the production of aircraft engine
components.
(22.) Rosenberg (1994) has pointed out that in the nineteenth century, the Western Union
turned down an opportunity to purchase Bell's patent for the telephone, which it
regarded as an inferior product to the telegraph.
(23.) See e.g. the history of the UK General Electric Company under Arnold Weinstock
(Aris 1998).
(24.) Note also, the first point in this column (1a). This relates also to the attitude and
behavior of the financial system. Some recent work on financial capital has returned to
the original Schumpeterian emphasis on “credit creation” for the finance of innovation at
Page 30 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).
various stages of the successive technological revolutions. These factors which affect the
growth, composition and fluctuation of demand and hence the influence of demand upon
innovation at the firm level are further considered in the chapters by Verspagen and
O'Sullivan in this volume.
Keith Pavitt
Page 31 of 31
PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights
Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in
Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).