The Globalization of Software R&D: The Search For Talent
The Globalization of Software R&D: The Search For Talent
1
A position paper for the December 12, 1996 meeting of the Council on Foreign Relations’
Study Group on the Globalization of Industrial R&D. The authors are independent software
industry analysts working with Prof. William F. Miller, Graduate School of Business, Stanford
University, on a Sloan Foundation grant to study the global software industry.
http://www-scip.stanford.edu/scip/
The Search for Software Talent
The importance of the software industry. The most visible segments of the
software industry, the software products publishers and services firms, grossed
worldwide in 1995 approximately $92B and $170B, respectively.2 The US
software products and services industries, at $71B and $92B in annual revenues,
dominate the world picture.3 With current growth rates of 12-15% expected to
continue, some analysts predict that the industry will represent 10% of the GDP
by early next century.
The true impact of software on the economy, however, goes well beyond
product and services sales. In terms of dollar value of activity, more software is
written by companies for their own operations (finance, administration,
manufacturing automation, etc.) than the value of software products and
2
Software products: Companies like Microsoft, Oracle, Novell and SAP. Sometimes sold shrink-
wrapped, sometimes leased, sometimes bundled with hardware or with consulting services.
Seventy-seven percent of the world’s packaged software is sold by US firms.
Software services: Firms like IBM/ISSC, Anderson Consulting and EDS. Software-related
services include consulting, systems design, systems integration, contract programming and
maintenance.
3
The reasons for the US dominance of the software industry, especially of packaged software
products, are significant, and neither transient nor based on some “head start” advantage. In
fact, US market share for software products increased between 1994 and 1995 from 74% to
77%. The US advantage stems from cultural attitudes toward software and programmers and
the relative speed of change of industrial institutions in response to rapid technology change.
See Edward Feigenbaum, Where’s the Walkman in Japan’s Software Future, in The Future of
Software, edited by Derek Leebaert, MIT Press, 1995. Also, Barr & Tessler, The US Domination
Of Worldwide Software Products Sales Increased In 1995, SCIP Research Note, October 1996.
The biggest industrial impact of software mostly likely results from the use of
embedded chips to achieve product functionality in everything from cellular
telephones to automobiles. As the cost of computer chips drops, computers and
the software that runs them have become as important a part of everyday
products as they are of aerospace and defense systems. Companies in industries
like telecommunications (cellular phones), aircraft manufacturing (on-board
avionics), consumer electronics (programmable VCRs), and automobiles (air
bags and anti-lock brakes) now have products whose competitive features
depend on the software they’ve embedded in them. Some of these companies
have indicated that 70% of their product development costs are now in software
development. There are no estimates of the total amount of this “embedded”
software in the products of so many industries, but we estimate that it is even
larger than the $500B in-house software segment. Furthermore, software-based
product functionality is a relatively new phenomenon and there is every
indication that it will continue to grow rapidly, in the amount of software and
in its complexity.4
4
Reasons for the rapid trend toward more embedded software of increasing complexity: (1)
Constantly cheaper chips mean more computers and more digital control systems in all kinds
of devices, equipment and other products. (2) Putting increasingly complex functionality in
software is cheaper and more flexible than mechanical or electrical solutions. (3) Once there is
a computer in the product, there are all kinds of features that might have competitive
advantage that can be “programmed in” in subsequent designs. (4) Once there are two or
more computers in a product (there are over a dozen in many automobiles), the inter-
processor communication requirements immediately makes the software much more complex.
Added to feature expansion and maintenance “patches” over a multi-year, multi-developer
lifetime, this embedded software will eventually become as complex as any.
The timing was right — offshore software services firms appeared during the
period that IS departments had downsized, laying off the software people most
experienced with their systems, and were beginning to outsource big contracts
for operations and software development. At the time, these offshore service
firms were offering low rates, based on wage differentials, as we will discuss
below.
5
We will not discuss in depth, but mention here the familiar list of enablers that underlay the
dramatic growth in globalization in the last 10 to 15 years: (1) growth of the packaged
software industry, especially PC software; (2) global digital networks, which allow offshore
workstations to appear as if they were on the office network; (3) e-mail, as the primary
mechanism for interproject communication, which is blind to distance; (4) English as the
international language of software; (5) common software tools and platforms accessible to
development teams worldwide (such as C++, Visual Basic, etc.); (6) affordable computing
equipment; (7) newly-enlightened government policies in countries around the world, in an
attempt to nurture a domestic software capability.
6
Erik Brynjolffson. The Productivity Paradox of Information Technology. Communications of the
ACM. December, 1993.
7
This period of downsizing caused painful and damaging dislocation to the many companies
and industries. On the other hand, the resulting reorganization of the software industry
around strategic partners and outsourcing, which never happened in Japan, for example, has
been on the whole a competitive advantage for US firms, fostering the software publishing
industry and the independent software services firms.
Furthermore, several publishers have found that they can produce products
specifically for foreign markets, like Asian-language word processors or
Intuit’s product for a German’s personal finances, which are very different from
those typical for an American. Again, some or all of the R&D might well be
sourced locally, as was indeed the case for Intuit.
8
See William F. Miller. The Art of Rapid Change. SCIP Research Note, 1995.
9
See The Importance of Being American. The Economist. May 25, 1996.
Finding the talent. Demand for software is growing beyond the labor resources
that we have locally to produce it, and the search for talent is driving the
movement of software R&D offshore more than any other factor. Both for
specific skills, as we discussed above, and for quality software people
generally, software groups in all segments of the industry are expanding their
search efforts.
At the same time, the tremendous growth of the packaged-product and services
segments created additional jobs for programmers. Since the firms in these
industries made a living on software, they knew from the beginning that they
needed the best software talent. Furthermore, many of these firms were
managed by software professionals who were better prepared to hire, nurture
and reward the most talented analysts, systems architects, programmers,
project managers, testing engineers, documentation writers and all of the other
professionals that make up the software team. During this period, software
people, who had once been no more than clerks-turned-coders in IS
departments, became professionals, and eventually, folk heroes.
While we believe that the demand for software professionals has been
increasing at an increasing rate during this entire period of 10 to 15 years, some
major labor dislocations masked the increasing demand. These events were, of
course, the massive downsizing of corporate IS departments in many industries
and the post-cold-war defense spending cuts and subsequent layoffs in the
aerospace segment. Both of these events peaked during the 1988-1993 period
and resulted in the availability of several hundred thousand programmers. (At
one time, there were 75,000 unemployed engineers in Orange and Los Angeles
counties alone.) Many were re-absorbed immediately by software services
firms who took outsourcing contracts from the same IS departments that had
been downsized, but the trailing effects of these layoffs on the supply of
programmers continued well into mid-decade.
In the last couple of years, a talent shortage has become apparent. We believe
this shortage will soon become a serious issue in the software industry and in
the many other industries that depend critically on software (computer
hardware, telecommunications, banking, trading, etc.), and will eventually
influence business and product strategy in many more industries. Competitive
advantage, product differentiation, project delays, and systems errors and
device failures are all at stake.
10
In Kathy Rebello. We humbly beg you to take this job, please. Business Week. June 17, 1996.
Despite marketing campaigns over the years for a variety of technologies, like
CASE (Computer-Assisted Software Engineering), knowledge-based
programming, object-oriented programming, and software reuse, we are aware
of no technological solution that will dramatically change the way most
software is developed over the next ten years. Object technology, with its the
notion of assembling software from off-the-shelf components, holds promise,
but will require a generation to have widespread impact. For the foreseeable
future, software development will remain a craft, dependent on the skill and
experience of talented programmers.
Good programmers are hard to find. Unlike most other engineering and
“product development” disciplines, software has remained an art, the creative
output of individuals with unique skills. Some studies show that the best
programmers are 20 times better than average programmers, whether you
measure speed, error rate, or overall output.11 Thus, there is a “talent” element
in the labor resource for this industry — not everyone can become a good
programmer. The number of good programmers a nation produces is limited
by raw talent, educational resources, and competition from other possible
occupations.
11
For example, see G. Edward Bryan, Not All Programmers Are Created Equal, IEEE, 1994. The
worst programmers are two orders of magnitude worse than the best!
There are at present tens of thousands of unfilled positions for specific software
skills ranging from SAP configuration specialist to Oracle consultant to
webmaster. The US Department Labor does not collect detailed data on
software professionals and software jobs, but we can present some anecdotal
evidence based on interviews with software industry insiders here in Silicon
Valley:
• Pro-sports-style, multi-million-dollar signing bonuses for key technical
gurus are occurring more frequently.
• The increase in the number of programmers who go out on their own as
contractors or form “boutique” software services firms also indicates a
seller’s market for software talent.
• Industry executives and technical managers express a growing concern
about the availability of software professionals. Even well-funded start-
ups and the major software publishers are beginning to see hiring delays,
rising salaries, and increased mobility among software professionals.
Our educational system cannot produce enough of the right kind of people.
Can we educate a new cadre of talented software people? Programs in software
engineering and other efforts to train thousands of new programmers with the
needed analysis, design, development, and project management skills are only
beginning to be offered in the university and post-graduate education systems.
For example, the University of California Extension Program for continuing
education produced a curriculum of this nature just this year.
The software labor shortage is not a phenomenon particular to US. In fact, the
shortage has been felt longer and more acutely in other parts of the world
where software professionals were not as highly valued as in the US. Reports
from the UK indicate that foreign outsourcing started about 15 years ago and
today is the norm for large corporate IS organizations. Both the labor shortage
and wage differentials are given as the main reasons. The UK and much of
Western Europe look to India, Ireland, and increasingly, to Eastern Europe to
fill their labor requirements. From the supplier side, outsourcing countries
such as the Philippines also complain of labor shortages. There they cannot
train enough new programmers or retain enough graduates (who migrate to
higher paying countries) to accept all of the outsourcing work offered to
them. 12
As a result, the Indian software export industry, which started out as a cost-
savings alternative, has become a major source of talented programmers and
software development services. In just 6 years, India has reached $700M in
annual services exports by filling a growing skill shortage in IS departments in
12
Antonio Lopez. Goodby, Philippines: Can Manila Stem a Computer Brain Drain? Asiaweek.
October 25, 1996.
13
Note that we are not talking about Indian nationals working as independents in the US labor
market, but about an organized industry involving both client-site participation of (English-
speaking) Indian programmers and outsourced development abroad. The familiarity phase of
a project, in which Indian programmers might come to the client site to become familiar with
the systems and the personnel for a year or more, is critical to the success of the offshore team.
the US, Japan and Europe. Indian businessmen have reduced the discount they
need to offer to get repeat business from customers, and have grown their
business by word-of-mouth based on successful projects. At the same time, US
software and high-tech firms have opened subsidiaries in Bangalore to tap into
this talent pool directly and attempt to realize increased cost savings.
14
The subject of the Indian software industry in particular will be revisited in Tessler & Barr’s
paper in CFR sessions 4-5, “Comparing Budapest, Bangalore, Santiago and Singapore.”
15
See also Erran Carmel. Thirteen Assertions for Globally Dispersed Software Development Research.
To appear in Proceedings of the 30th Hawaii International Conference on Systems Science.
January, 1997.
4. Any country besides India which is developing fast enough to produce lots
of good programmers is going to have a domestic demand for those
programmers in their own banks, phone companies and manufacturing
firms. In most cases this will preclude the development of a large software
services export business in the short run.
16
See Shirley Tessler and Avron Barr. A Pilot Survey of Software Product Management. To appear
in the proceedings of the Software Engineering Process Group Conference. San Jose, 1997.
17
National Academy of Engineering, Foreign Participation in US Research and Development, 1996.
The issue of software quality will also reach the attention of policy planners in
the next few years, perhaps rather dramatically on January 1, 2000.18 Business
and government organizations have no choice but to continue to build software
that is critical to their operations and to our lives. If they cannot find enough
good people, somewhere on this planet, to build these systems right, the result
will be systems delays, failures, buggy software products and devices that don’t
work. Inevitably, there will be loss of life.19, 20
18
See, for example, Peter De Jager’s Millennium predictions, including the global stand-down of
all air traffic on New Years Eve, 1999. Computer Weekly, August 15, 1996.
19
The Standish Group International estimates that in 1995 US companies and government
agencies will have spent $81 billion for canceled software projects and an additional $59
billion for software projects that exceed their original time estimates.
20
Note also that movement of programmers between companies, which is symptomatic of
shortages and salary ramping, also has a devastating effect on project deadlines and
potentially on software quality. See Shirley Tessler and Avron Barr. A Pilot Survey of Software
Product Management. To appear in the proceedings of the Software Engineering Process Group
Conference. San Jose, 1997.
21
Nagy Hanna describes efforts by the Japanese government, including a 3-year training
program in Japanese language and software engineering, to enlarge the supply of overseas
software talent. Exploiting Information Technology for Development: A Case Study of India. World
Bank Discussion Papers. 1994.
We also note that in software R&D, foreign outsourcing does not engage just a
few scientists and other very high-level professionals, but provides
employment to a larger number and wide variety of skilled professionals who
derive valuable skills and experience that might be useful in the development
of a domestic software industry. Clearly, we are training our competition. We
feel, however, that this is not an issue of concern for the foreseeable future. The
labor requirements in those countries may soon become as problematic as they
are in the US.
At the present time, government data about the software industry and the
software labor pool are inadequate. 22 The increasing importance of software in
so many industries, in addition to the growing importance of software products
and services themselves, speaks to better surveillance on this industry.
Specifically, more and better categories of software and software professionals
should be tracked in both the business and labor censuses.23
One final concern about the impact of a software labor shortage: the world of
software and IT generally will slow down if projects are delayed or not even
attempted because of lack of adequate development resources. Business
software publishers depend on their customers’ programmers and systems
integrators to adopt their latest offerings. They will delay releases if corporate
customers are unable to integrate new products into their operations.
Innovation will be hampered for the first time in the history of computing.
22
Avron Barr, Shirley Tessler & Brian Lent. Revising the Classification of the Software Industry.
Memo to the US Office of Management and Budget, Economic Classification Policy Committee,
March, 1995.
23
In fact, most companies we talk to do not know how much they spend on software
(purchase/lease, upgrades, installation, training, outsourced development, in-house
development, maintenance, and embedded). They do not know how many of their
employees are involved in developing and maintaining software. And they cannot account
for their software assets with any accuracy. The few firms that have investigated this issue
have been appalled at the size of the expense and the criticality of their software effort. Policy
changes and a new respect for the importance of software to their business are positive
outcomes.
Before we express relief over the thought of a pause in the rapid and relentless
rate of change of the last 40 years, we should consider this: the advantage of the
US in software, and thus in information technology generally, is based on a
differential capability to accommodate rapid change. When the pace of change
slows down, everyone else will catch up. True, this technology revolution will
slow down eventually, when inventions reach the physical limits or some
utility plateau. But a premature braking of the rate of innovation because of a
severe labor shortage will have serious negative consequences
Concluding Remarks
Driven by the increasing demand for software of all types, US firms both in the
software industry and in other industries dependent on software, will continue
to seek software R&D resources offshore. By and large, the US software
industry recognizes that it is exporting projects and jobs overseas at an
increasing rate. While most of the work is currently in the less creative areas of
software development, such as Year-2000 retrofitting and the rewriting of
legacy systems, more important and cutting-edge software R&D will
increasingly be outsourced overseas to take advantage of scarce talent.
The industry may be inevitably leveling the worldwide playing field for
software development in its relentless drive to find new software talent and
open new markets. Yet, two factors mitigate US software industry concern.
First, as a result of long-term domestic problems such as poor software
training, high rates of piracy, or counter-productive government policies, most
of these countries are not likely to become either competitive software
publishing centers or software services exporters, at least not in the next
decade. In fact, in most cases, they are not likely to catch up to their own
increasing domestic demand for software. Secondly, until the rate of
technology change slows significantly, current US policy and cultural attitudes
will continue to give this country an advantage in the software industry as it
continues it rapid evolution. There are policy changes that might improve the
situation, including increased basic research funding, targeted training
programs to produce good software professionals and enhance the skills of
existing programmers, and especially, an open immigration policy for skilled
programmers. The software industry will thrive, however, under current policy
as long as computing technology continues to advance at breathtaking speeds.
Sources
Asia’s Top Software Firms Count on the Net to Become World Players. Asiaweek. October 25, 1996.
Barr, A., Tessler, S. and Lent, B. Revising the Classification of the Software Industry. Memo to the
US Office of Management and Budget, Economic Classification Policy Committee, March, 1995.
Barr, Avron and Tessler, Shirley. Good Programmers are Hard to Find: An Alternative Perspective on
the Immigration of Engineers. Stanford Computer Industry Project, Research Note. October, 1996.
Barr, Avron and Tessler, Shirley. The US Domination of Worldwide Product Sales Increased in 1995.
Stanford Computer Industry Project, Research Note. October, 1996.
Barr, Avron. IS 2000: A New Role for Corporate IS Departments and People. An address to the
Software Development Conference. San Francisco, 1995.
Carmel, Erran. Thirteen Assertions for Globally Dispersed Software Development Research. To appear
in Proceedings of the 30th Hawaii International Conference on Systems Science. January, 1997.
Dave, Rishi. Patterns of Success in the Indian Software Industry. Stanford University. May, 1996.
Global Competitiveness of the US Computer Software and Service Industries. Office of Industries, US
International Trade Commission. June, 1995.
Hanna, Nagy. Exploiting Information Technology for Development: A Case Study of India. World
Bank Discussion Papers. 1994.
Lopez, Antonio. Goodby, Philippines: Can Manila Stem a Computer Brain Drain? Asiaweek.
October 25, 1996.
O’Riain, Sean. An Offshore Silicon Valley? The Emerging Irish Software Industry. Unpublished
report. 1996.
Rebello, Kathy. We Humbly Beg You to Take This Job Please. Business Week. June 17, 1996.
Reid, Proctor and Schriesheim, Alan, ed. Foreign Participation in US Research and Development:
Asset or Liability? Washington, DC: National Academic Press, 1996.
Schmid, Gregory. The Future of America’s Research-Intensive Industries. Institute for the Future.
August, 1995.
The Standish Group International, Inc. The Chaos Report. Dennis, Massachusetts, 1995.
Tessler, Shirley and Barr, Avron. A Pilot Survey of Software Product Management. To appear in
the proceedings of the Software Engineering Process Group Conference. San Jose, 1997.
Zachary, Paul. US Software: Now It May Be Made in Bulgaria. Wall Street Journal. Feb. 21, 1995.