Bostrom
Bostrom
Bostrom
Abstract
This paper traces the cultural and philosophical roots of transhumanist thought and
describes some of the influences and contributions that led to the development of
contemporary transhumanism.
(Mitchell 2004).
NICK BOSTROM
alchemists invented some useful things, such as new dyes and improvements in
metallurgy, the goal of life-extension proved elusive.
The quest to transcend our natural confines, however, has long been viewed with
ambivalence. On the one hand there is fascination. On the other there is the concept of
hubris: that some ambitions are off-limits and will backfire if pursued. The ancient Greeks
exhibited this ambivalence in their mythology. Prometheus stole the fire from Zeus and
gave it to the humans, thereby permanently improving the human condition. Yet for this
act he was severely punished by Zeus. In the myth of Daedalus, the gods are repeatedly
challenged, quite successfully, by the clever engineer and artist who uses non-magical
means to extend human capabilities. In the end, however, disaster ensues when his son
Icarus ignores paternal warnings and flies too close to the sun, causing the wax in his
wings to melt.
Medieval Christianity had similarly conflicted views about the pursuits of the alchemists,
who tried to transmute substances, create homunculi in test tubes, and invent a
panacea. Some scholastics, following the anti-experimentalist teachings of Aquinas,
believed that alchemy was an ungodly activity. There were allegations that it involved
the invocation of daemonic powers. But other theologians, such as Albertus Magnus,
defended the practice.2
The otherworldliness and stale scholastic philosophy that dominated Europe during the
Middle Ages gave way to a renewed intellectual vigor in the Renaissance. The human
being and the natural world again became legitimate objects of study. Renaissance
humanism encouraged people to rely on their own observations and their own judgment
rather than to defer in every matter to religious authorities. Renaissance humanism also
created the ideal of the well-rounded person, one who is highly developed scientifically,
morally, culturally, and spiritually. A landmark of the period is Giovanni Pico della
Mirandolas Oration on the Dignity of Man (1486), which proclaims that man does not
have a readymade form and is responsible for shaping himself:
We have made you a creature neither of heaven nor of earth, neither mortal nor
immortal, in order that you may, as the free and proud shaper of your own being,
fashion yourself in the form you may prefer. It will be in your power to descend to
the lower, brutish forms of life; you will be able, through your own decision, to rise
again to the superior orders whose life is divine.3
The Age of Enlightenment is often said to have started with the publication of Francis
Bacons Novum Organum, the new tool (1620), which proposes a scientific
methodology based on empirical investigation rather than a priori reasoning.4 Bacon
advocated the project of effecting all things possible, by which he meant using
science to achieve mastery over nature in order to improve the living condition of
human beings. The heritage from the Renaissance combines with the influence of Isaac
Newton, Thomas Hobbes, John Locke, Immanuel Kant, the Marquis de Condorcet, and
others to form the basis for rational humanism, which emphasizes empirical science and
critical reason rather than revelation and religious authority as ways of learning about
the natural world and our place within it, and of providing a grounding for morality.
Transhumanism has roots in rational humanism.
In the 18th and 19th centuries we begin to see glimpses of the idea that even humans
themselves can be developed through the appliance of science. Condorcet speculated
about extending human life span through medical science:
Would it be absurd now to suppose that the improvement of the human race
should be regarded as capable of unlimited progress? That a time will come
when death would result only from extraordinary accidents or the more and more
gradual wearing out of vitality, and that, finally, the duration of the average
interval between birth and wearing out has itself no specific limit whatsoever? No
doubt man will not become immortal, but cannot the span constantly increase
between the moment he begins to live and the time when naturally, without
illness or accident, he finds life a burden?5
Benjamin Franklin longed wistfully for suspended animation, foreshadowing the cryonics
movement:
I wish it were possible... to invent a method of embalming drowned persons, in
such a manner that they might be recalled to life at any period, however distant;
for having a very ardent desire to see and observe the state of America a
hundred years hence, I should prefer to an ordinary death, being immersed with
a few friends in a cask of Madeira, until that time, then to be recalled to life by
the solar warmth of my dear country! But... in all probability, we live in a century
too little advanced, and too near the infancy of science, to see such an art
brought in our time to its perfection.6
After the publication of Darwins Origin of Species (1859), it became increasingly
plausible to view the current version of humanity not as the endpoint of evolution but
rather as a possibly quite early phase.7 The rise of scientific physicalism might also have
contributed to the foundations of the idea that technology could be used to improve
the human organism. For example, a simple kind of materialist view was boldly proposed
in 1750 by the French physician and materialist philosopher, Julien Offray de La Mettrie in
LHomme Machine, where he argued that man is but an animal, or a collection of
springs which wind each other up.8 If human beings are constituted by matter that
obeys the same laws of physics that operate outside us, then it should in principle be
possible to learn to manipulate human nature in the same way that we manipulate
external objects.
It has been said that the Enlightenment expired as the victim of its own excesses. It gave
way to Romanticism, and to latter day reactions against the rule of instrumental reason
and the attempt to rationally control nature, such as can be found in some
postmodernist writings, the New Age movement, deep environmentalism, and in some
parts of the anti-globalization movement. However, the Enlightenments legacy,
including a belief in the power of human rationality and science, is still an important
shaper of modern culture. In his famous 1784 essay What Is Enlightenment?, Kant
summed it up as follows:
(Condorcet 1979).
(Franklin et al. 1956), pp. 27-29.
7
(Darwin 2003).
8
(La Mettrie 1996).
6
NICK BOSTROM
Enlightenment is mans leaving his self-caused immaturity. Immaturity is the
incapacity to use ones own understanding without the guidance of another.
Such immaturity is self-caused if its cause is not lack of intelligence, but by lack of
determination and courage to use ones intelligence without being guided by
another. The motto of enlightenment is therefore: Sapere aude! Have courage to
use your own intelligence!9
It might be thought that the German philosopher Friedrich Nietzsche (1844-1900) would
have been a major inspiration for transhumanism. Nietzsche is famous for his doctrine of
der bermensch (the overman):
I teach you the overman. Man is something that shall be overcome. What have
you done to overcome him? All beings so far have created something beyond
themselves; and do you want to be the ebb of this great flood and even go back
to the beasts rather than overcome man?10
What Nietzsche had in mind, however, was not technological transformation but rather a
kind of soaring personal growth and cultural refinement in exceptional individuals (who
he thought would have to overcome the life-sapping slave-morality of Christianity).
Despite some surface-level similarities with the Nietzschean vision, transhumanism with
its Enlightenment roots, its emphasis on individual liberties, and its humanistic concern for
the welfare of all humans (and other sentient beings) probably has as much or more in
common with Nietzsches contemporary J.S. Mill, the English liberal thinker and utilitarian.
2. Speculation, science fiction, and twentieth century totalitarianism
In 1923, the noted British biochemist J. B. S. Haldane published the essay Daedalus:
Science and the Future, in which he argued that great benefits would come from
controlling our own genetics and from science in general. He projected a future society
that would be richer, have abundant clean energy, where genetics would be employed
to make people taller, healthier, and smarter, and where the use of ectogenesis
(gestating fetuses in artificial wombs) would be commonplace. He also commented on
what has in more recent years become known as the yuck factor:
The chemical or physical inventor is always a Prometheus. There is no great
invention, from fire to flying, which has not been hailed as an insult to some god.
But if every physical and chemical invention is a blasphemy, every biological
invention is a perversion. There is hardly one which, on first being brought to the
notice of an observer from any nation which has not previously heard of their
existence, would not appear to him as indecent and unnatural.11
Haldanes essay became a bestseller and set off a chain reaction of future-oriented
discussions, including The World, the Flesh and the Devil, by J. D. Bernal (1929)12, which
speculated about space colonization and bionic implants as well as mental
improvements through advanced social science and psychology; the works of Olaf
Stapledon, a philosopher and science fiction author; and the essay Icarus: the Future of
(Kant 1986).
(Nietzsche 1908).
11
(Haldane 1924).
12
(Bernal 1969).
10
13
(Russell 1924)
(Huxley 1932).
15
(Shelley 1818).
16
(Orwell 1949).
14
NICK BOSTROM
The Holocaust left a scar in the human psyche. Determined not to let history repeat itself,
most people developed an instinctive revulsion to all ideas that could appear to have
any kind of association with Nazi ideology. (And yet, it must be remembered, history did
repeat itself e.g. in the Rwandan genocide of 1994, in which the world did nothing but
wring its hands as 800,000 Africans were slaughtered.) In particular, the eugenics
movement as a whole, in all its forms, became discredited because of the terrible crimes
that had been committed in its name, although some of the milder eugenics programs
continued for many years before they were finally scrapped. The goal of creating a new
and better world through a centrally imposed vision became pass. The Stalinist tyranny
again underscored the dangers of totalitarian utopianism.
In the postwar era, many optimistic futurists who had become suspicious of collectively
orchestrated social change found a new home for their hopes in scientific and
technological progress. Space travel, medicine, and computers seemed to offer a path
to a better world. The shift of attention also reflected the breathtaking pace of
development taking place in these fields. Science had begun to catch up with
speculation. Yesterdays science fiction was turning into todays science fact or at least
into a somewhat realistic mid-term prospect.
Transhumanist themes during this period were discussed and analyzed chiefly in the
science fiction literature. Authors such as Arthur C. Clarke, Isaac Asimov, Robert Heinlein,
and Stanislaw Lem explored how technological development could come to profoundly
alter the human condition.
The word transhumanism appears to have been first used by Aldous Huxleys brother,
Julian Huxley, a distinguished biologist (who was also the first director-general of UNESCO
and founder of the World Wildlife Fund). In Religion Without Revelation (1927), he wrote:
The human species can, if it wishes, transcend itself not just sporadically, an
individual here in one way, an individual there in another way but in its entirety,
as humanity. We need a name for this new belief. Perhaps transhumanism will
serve: man remaining man, but transcending himself, by realizing new possibilities
of and for his human nature.17
3. Technological genies: AI, the singularity, nanotech, and uploading
Human-like automata have always fascinated the human imagination. Mechanical
engineers since the early Greeks have constructed clever self-moving devices.
In Judaic mysticism, a golem refers to an animated being crafted from inanimate
material. In the early golem stories, a golem could be created by a holy person who was
able to share some of Gods wisdom and power (although the golem, not being able to
speak, was never more than a shadow of Gods creations). Having a golem servant was
the ultimate symbol of wisdom and holiness. In the later stories, which had been
influenced by the more Islamic concern about humanity getting too close to God, the
golem became a creation of overreaching mystics, who would inevitably be punished
for their blasphemy. The story of the Sorcerers Apprentice is a variation of this theme: the
apprentice animates a broomstick to fetch water but is unable to make the broom stop
17
18
(Capek 2004).
(Turing 1950).
20
(Minsky 1994; Moravec 1999; Bostrom 1998, 2002; Kurzweil 1999).
21
(Ulam 1958).
22
(Moore 1965).
19
NICK BOSTROM
improving artificial intelligence will at some point result in radical changes within a very
short time span. This hypothesis was first clearly stated in 1965 by the statistician I. J. Good:
Let an ultraintelligent machine be defined as a machine that can far surpass all
the intellectual activities of any man however clever. Since the design of
machines is one of these intellectual activities, an ultraintelligent machine could
design even better machines; there would then unquestionably be an
intelligence explosion, and the intelligence of man would be left far behind.
Thus the first ultraintelligent machine is the last invention that man need ever
make.23
Vernor Vinge discussed this idea in a little more detail in his influential 1993-paper
Technological Singularity, in which he predicted:
Within thirty years, we will have the technological means to create superhuman
intelligence. Shortly after, the human era will be ended.24
Transhumanists today hold diverging views about the singularity: some see it as a likely
scenario, others believe that it is more probable that there will never be any very sudden
and dramatic changes as the result of progress in artificial intelligence.
The singularity idea also comes in a somewhat different eschatological version, which
traces its lineage to the writings of Pierre Teilhard de Chardin, a paleontologist and Jesuit
theologian who saw an evolutionary telos in the development of an encompassing
noosphere (a global consciousness) via physicist Frank Tipler, who argued that
advanced civilizations might come to have a defining influence on the future evolution
of the cosmos, and, in the final moments of the Big Crunch, might manage to extract an
infinite number of computations by harnessing the sheer energy of the collapsing
matter.25,26 However, while these ideas might appeal to those who fancy a marriage
between mysticism and science, they have not caught on either among transhumanists
or the larger scientific community. Current cosmological theories indicate that the
universe will continue to expand forever (falsifying Tiplers prediction). But the more
general point that the transhumanist might make in this context is that we need to learn
to think about big-picture questions without resorting to wishful thinking or mysticism.
Big-picture questions, including ones about our place in the world and the long-term fate
of intelligent life are part of transhumanism; however, these questions should be
addressed in a sober, disinterested way, using critical reason and our best available
scientific evidence. One reason why such questions are of transhumanist interest is that
their answers might affect what outcomes we should expect from our own technological
development, and therefore indirectly what policies it makes sense for humanity to
pursue.
In 1986, Eric Drexler published Engines of Creation, the first book-length exposition of
molecular manufacturing.27 (The possibility of nanotechnology had been anticipated by
Nobel laureate physicist Richard Feynman in his famous after-dinner address in 1959
entitled There is Plenty of Room at the Bottom.28) In this seminal work, Drexler not only
23
(Good 1965).
(Vinge 1993).
25
(Teilhard de Chardin 1964).
26
(Tipler 1994).
27
(Drexler 1985).
28
(Feynman 1960).
24
29
(Drexler 1992).
(Drexler and Smalley 1993).
31
(Drexler 1985), p. 3.
32
(Bostrom 2003).
30
NICK BOSTROM
new medium, individual transhumanists take different views on these philosophical
matters.
If either superintelligence, or molecular nanotechnology, or uploading, or some other
technology of a similarly revolutionary kind is developed, the human condition could
clearly be radically transformed. Even if one believed that the probability of this
happening any time soon is quite small, these prospects would nevertheless merit serious
attention in view of their extreme impact. However, transhumanism does not depend on
the feasibility of such radical technologies. Virtual reality; preimplantation genetic
diagnosis; genetic engineering; pharmaceuticals that improve memory, concentration,
wakefulness, and mood; performance-enhancing drugs; cosmetic surgery; sex change
operations; prosthetics; anti-aging medicine; closer human-computer interfaces: these
technologies are already here or can be expected within the next few decades. The
combination of these technological capabilities, as they mature, could profoundly
transform the human condition. The transhumanist agenda, which is to make such
enhancement options safely available to all persons, will become increasingly relevant
and practical in the coming years as these and other anticipated technologies come
online.
4. The growth of grassroots
Benjamin Franklin wished to be preserved in a cask of Madeira and later recalled to life,
and regretted that he was living too near the infancy of science for this to be possible.
Since then, science has grown up a bit. In 1962, Robert Ettinger published the book, The
Prospect of Immortality, which launched the idea of cryonic suspension.33 Ettinger
argued that as medical technology seems to be constantly progressing, and since
science has discovered that chemical activity comes to a complete halt at low-enough
temperatures, it should be possible to freeze a person today (in liquid nitrogen) and
preserve the body until a time when technology is advanced enough to repair the
freezing damage and reverse the original cause of deanimation. Cryonics, Ettinger
believed, offered a ticket to the future.
Alas, the masses did not line up for the ride. Cryonics has remained a fringe alternative to
more traditional methods of treating the terminally diseased, such as cremation and
burial. The practice of cryonics was not integrated into the mainstream clinical setting
and was instead conducted on the cheap by a small number of enthusiasts. Two early
cryonics organizations went bankrupt, allowing their patients to thaw out. At that point,
the problem of massive cellular damage that occurs when ice crystals form in the body
also became more widely known. As a result, cryonics acquired a reputation as a
macabre scam. The media controversy over the suspension of baseball star Ted Williams
in 2002 showed that public perception of cryonics has not changed much over the past
decades.
Despite its image problem and its early failures of implementation, the cryonics
community continues to be active and it counts among its members several eminent
scientists and intellectuals. Suspension protocols have been improved, and the infusion of
cryoprotectants prior to freezing to suppress the formation of ice crystals has become
standard practice. The prospect of nanotechnology has given a more concrete shape
to the hypothesized future technology that could enable reanimation. There are
33
(Ettinger 1964).
10
34
(Ettinger 1972).
(Esfandiary 1970).
36
(FM-2030 1989).
37
(Regis 1990).
35
11
NICK BOSTROM
together disparate groups of people with futuristic ideas and facilitated the formation of
novel memetic compounds. The Institute ran a series of conferences, but perhaps most
important was the extropians mailing list, an online discussion forum where new ideas
were shared and debated. In the mid-nineties, many got first exposure to transhumanist
views from the Extropy Institutes listserve.
More had immigrated to California from Britain after changing his name from Max
OConnor. Of his new name, he said:
It seemed to really encapsulate the essence of what my goal is: always to
improve, never to be static. I was going to get better at everything, become
smarter, fitter, and healthier. It would be a constant reminder to keep moving
forward.38
Max More wrote the first definition of transhumanism in its modern sense, and created his
own distinctive brand of transhumanism, extropianism, which emphasized the
principles of boundless expansion, self-transformation, dynamic optimism,
intelligent technology, and spontaneous order. Originally, extropianism had a clear
libertarian flavor, but in later years More has distanced himself from this ingredient,
replacing spontaneous order with open society, a principle that opposes
authoritarian social control and promotes decentralization of power and responsibility.39
Natasha Vita-More (married to Max) is the Extropy Institutes current president. She is an
artist and designer, and has over the years issued a number of manifestos on
transhumanist and extropic art.40
The Extropy Institutes conferences and mailing list also served as a hangout place for
some people who liked to discuss futuristic ideas but who were not necessarily joiners.
Those who were around in the mid-nineties will remember individuals such as Anders
Sandberg, Alexander Sasha Chislenko, Hal Finney, and Robin Hanson from among the
more thoughtful regulars in the transhumanist milieu at the time. An enormous amount of
discussion about transhumanism has taken place on various email lists in the past
decade. The quality of postings has been varied (putting it mildly). Yet at their best, these
online conversations explored ideas about the implications of future technologies that
were, in some respects, far advanced over what could be found in printed books or
journals. The Internet played an important role in incubating modern transhumanism by
facilitating these meetings of minds and perhaps more indirectly, too, via the irrational
exuberance that pervaded the dot-com era?
The World Transhumanist Association was founded in early 1998 by Nick Bostrom and
David Pearce, to provide a general organizational basis for all transhumanist groups and
interests, across the political spectrum. The aim was also to develop a more mature and
academically respectable form of transhumanism, freed from the cultishness which, at
least in the eyes of some critics, had afflicted some of its earlier convocations. The two
founding documents of the WTA were the Transhumanist Declaration (see appendix),
and the Transhumanist FAQ (v. 1.0).41 The Declaration was intended as a concise
consensus statement of the basic principle of transhumanism. The FAQ was also a
38
(Regis 1994).
(More 2003).
40
(Vita-More 2002).
41
(WTA 2002).
39
12
(Office 1949).
Journal of Evolution and Technology 14(1) April 2005
13
NICK BOSTROM
system spawned new ethical dilemmas turning off life-support, organ donation,
resource allocation, abortion, advance directives, doctor-patient relationships, protocols
for obtaining informed consent and for dealing with incompetent patients. In the 1970s, a
broader kind of enquiry began to emerge, stimulated particularly by developments in
assisted reproduction and genetics. This field became known as bioethics. Many of the
ethical issues most directly linked to transhumanism would now fall under this rubric,
although other normative discourses are also involved, e.g. population ethics, metaethics, political philosophy, and bioethics younger sisters computer ethics, engineering
ethics, environmental ethics.
Bioethics was from the beginning an interdisciplinary endeavor, dominated by
theologians, legal scholars, physicians, and, increasingly, philosophers, with occasional
participation by representatives of patients rights groups, disability advocates, and other
interested parties. 44 Lacking a clear methodology, and operating on a plain often swept
by the winds of political or religious controversy, the standard of scholarship has
frequently been underwhelming. Despite these difficulties, bioethics burgeoned. A cynic
might ascribe this accomplishment to the ample fertilization that the field received from
a number of practical imperatives: absolving doctors of moral dilemmas, training
medical students to behave, enabling hospital boards to trumpet their commitment to
the highest ethical standards of care, providing sound bites for the mass media, and
allowing politicians to cover their behinds by delegating controversial issues to ethics
committees. But a kinder gloss is possible: decent people recognized that difficult moral
problems arose in modern biomedicine, that these problems needed to be addressed,
and that having some professional scholars trying to clarify these problems in some sort of
systematic way might be helpful. While higher-caliber scholarship and a more robust
methodology would be nice, in the meantime we make the most of what we have.
Moral philosophers have in the last couple of decades made many contributions that
bear on the ethics of human transformation, and we must limit ourselves to a few
mentions. Derek Parfits classic Reasons and Persons (1984) discussed many relevant
normative issues.45 In addition to personal identity and foundational ethical theory, this
book treats population ethics, person-affecting moral principles, and duties to future
generations. Although Parfits analysis takes place on an idealized level, his arguments
elucidate many moral considerations that emerge within the transhumanist program.
Jonathan Glovers What Sort of People Should there Be? (1984) addressed technologyenabled human-transformation at a somewhat more concrete level, focusing especially
on genetics and various technologies that could increase social transparency. Glover
gave a clear and balanced analytic treatment of these issues that was well ahead of its
time. His general conclusion is that
not just any aspect of present human nature is worth preserving. Rather it is
especially those features which contribute to self-development and selfexpression, to certain kinds of relationships, and to the development of our
consciousness and understanding. And some of these features may be extended
rather than threatened by technology.46
43
(World_Medical_Organization 1996).
See (Jonsen 1998).
45
(Parfit 1984).
46
(Glover 1984).
44
14
(Singer 2003).
(Savulescu 2001).
49
(Buchanan et al. 2002).
50
E.g. (Stock 2002; Harris 1992; Pence 1998; Parens 1998).
51
(Walker 2002).
52
(Bostrom 2003).
53
(Bostrom 2004).
54
(Bostrom 2005).
48
15
NICK BOSTROM
broader conception of human dignity which can accommodate posthuman dignity.55
A recent joint paper by Bostrom and Toby Ord proposes a heuristic for eliminating status
quo bias in bioethics, a bias which, they claim, afflicts many of our moral intuitions.56
Eliezer Yudkowsky (an independent scholar) has probed the ethics of superintelligence
and has tried to develop a theory of how to program a human-friendly AI, a challenge
that could take on life-and-death significance once we become capable of creating
such a machine. Yudkowsky argues that simple rule-based injunctions (such as Isaac
Asimovs three laws of robotics) would produce deadly unintended consequences. He
conceives of a superintelligence as an enormously powerful optimization process, and
the central task is to specify the mental architecture and goal-structure of the AI in such
a way that it realizes desirable outcomes. Rather than creating a list of specific goals,
Yudkowsky argues that we need to take a more indirect approach and choose the AIs
initial conditions so that it would use its superior intellectual powers to derive the specific
goals and extrapolate our decisions if we were better calibrated, better informed, and
better able to reflect on the forces influencing our decisions. Yudkowsky also wishes to
specify an AI that would use its initial rules for extrapolation to extrapolate smarter human
decisions about extrapolation rules; in effect, a set of initial rules for extrapolation would
renormalize themselves.57
Aside from normative questions, there are also positive questions to be asked, about the
nature and timing of transforming technologies and their consequences. Hans
Moravecs 1989-book Mind Children explored the ramifications of possible future
advances in robotics and uploading.58 A later Moravec book, Robot (1999), and Ray
Kurzweils best-selling Age of Spiritual Machines (1999) introduced these ideas to a wider
audience.59,60 As we have seen, Eric Drexler was trying to anticipate the consequences
of molecular nanotechnology back in the 80s, an endeavor in which he has since been
joined by several other researchers such as Robert Freitas, who has studied potential
medical application of nanotechnology in great detail, and Ralph Merkle who has
collaborated with Freitas to study the kinematics of self-replicating systems and the
technical steps towards crude molecular assemblers.61 All these authors recognize that
technologies as potent as superintelligence or molecular nanotechnology are not
without serious risks of accidents or deliberate misuse.
Bostrom (2002) introduced the concept of an existential risk, defined as one where an
adverse outcome would either annihilate Earth-originating intelligent life or permanently
and drastically curtail its potential, and created a catalogue of what he saw as the
most probable existential risks.62 Both nanotechnology- and superintelligence-related risks
attain high ranks on that list. In a much-discussed popular article, Why the Future
Doesnt Need Us (2000), Bill Joy argued that we ought to relinquish developments in AI,
nanotechnology, and genetics because of the risks that will eventually emerge from
these disciplines.63 Several people, reacting to Joy, argued against such bans on grounds
that they are unrealistic, would deprive us of great benefits, and might increase rather
55
(Bostrom 2005).
(Bostrom and Ord 2005).
57
(Yudkowsky 2004).
58
(Moravec 1989).
59
(Moravec 1999).
60
(Kurzweil 1999).
61
(Freitas and Merkle 2005).
62
(Bostrom 2002).
63
(Joy 2000).
56
16
64
17
NICK BOSTROM
role for government in regulating new technologies for safety and ensuring that the
benefits will be available to all, not just a wealthy or tech-savvy elite.
In principle, transhumanism can be combined with a wide range of political and cultural
views, and many such combinations are indeed represented, e.g. within the membership
of the World Transhumanist Association. One combination that is not often found is the
coupling of transhumanism to a culture-conservative outlook. Whether this is because of
an irresolvable tension between the transformative agenda of transhumanism and the
cultural conservatives preference for traditional arrangements is not clear. It could
instead be because nobody has yet seriously attempted to develop such a position. It is
possible to imagine how new technologies could be used to reinforce some cultureconservative values. For instance, a pharmaceutical that facilitated long-term pair
bonding could help protect the traditional family. Developing ways of using our growing
technological powers to help people realize widely held cultural or spiritual values in their
lives would seem a worthwhile undertaking.
This is not, however, the route for which cultural conservatives have so far opted. Instead,
they have gravitated towards transhumanisms opposite, bioconservatism, which
opposes the use of technology to expand human capacities or to modify aspects of our
biological nature. People drawn to bioconservatism come from groups that traditionally
have had little in common. Right-wing religious conservatives and left-wing
environmentalists and anti-globalists have found common causes, for example in their
opposition to the genetic modification of humans.
The different strands of contemporary bioconservatism can be traced to a multifarious
set of origins: ancient notions of taboo; the Greek concept of hubris; the Romanticist
view of nature; certain religious (anti-humanistic) interpretations of the concept of
human dignity and of a God-given natural order; the Luddite workers revolt against
industrialization; Karl Marxs analysis of technology under capitalism; various Continental
philosophers critiques of technology, technocracy, and the rationalistic mindset that
accompanies modern technoscience; foes of the military-industrial complex and
multinational corporations; and objectors to the consumerist rat-race. The proposed
remedies have ranged from machine-smashing (the original Luddites), to communist
revolution (Marx), to buying organic, to yoga (Jos Ortega y Gasset), but nowadays
it commonly emanates in calls for national or international bans on various human
enhancement technologies (Fukuyama, Annas, etc.).
Feminist writers have come down on both sides of the debate. Ecofeminists have
suspected biotechnology, especially its use to reshape bodies or control reproduction, of
being an extension of traditional patriarchal exploitation of women, or, alternatively,
have seen it as a symptom of a control-obsessed, unemphatic, gadget-fixated, bodyloathing mindset. Some have offered a kind of psychoanalysis of transhumanism,
concluding that it represents an embarrassing rationalization of self-centered immaturity
and social failure. But others have welcomed the libratory potential of biotechnology.
Shulamith Firestone argued in the feminist classic The Dialectic of Sex (1971) that women
will be fully liberated only when technology has freed them from having to incubate
children.69 Cyberfeminist Donna Haraway says that she would rather be a cyborg than
a goddess and argues against the dualistic view that associates men with culture and
technology and women with nature.70
69
70
(Firestone 1970).
(Haraway 1991).
18
Perhaps the most prominent bioconservative voice today is that of Leon Kass, chairman
of President Bushs Council on Bioethics. Kass acknowledges an intellectual debt to three
other distinguished bioconservatives: Protestant theologian Paul Ramsey, Christian
apologist C. S. Lewis, and German-born philosopher-theologian Hans Jonas (who studied
under Martin Heidegger).71 Kasss concerns center on human dignity and the subtle ways
in which our attempts to assert technological mastery over human nature could end up
dehumanizing us by undermining various traditional meanings such as the meaning of
the life cycle, the meaning of sex, the meaning of eating, and the meaning of work. Kass
is well-known for his advocacy of the wisdom of repugnance (which echoes Hans
Jonass heuristics of fear). While Kass stresses that a gut feeling of revulsion is not a
moral argument, he nevertheless insists that the yuck factor merits our respectful
attention:
In crucial cases repugnance is the emotional expression of deep wisdom,
beyond reasons power to fully articulate we intuit and feel, immediately and
without argument, the violation of things we rightfully hold dear To pollution
and perversion, the fitting response can only be horror and revulsion; and
conversely, generalized horror and revulsion are prima facie evidence of foulness
and violation.72
Francis Fukuyama, another prominent bioconservative and member of the Presidents
Council, has recently identified transhumanism as the worlds most dangerous idea.73
For Fukuyama, however, the chief concern is not about the subtle undermining of
meanings but the prospect of violence and oppression. He argues that liberal
democracy depends on the fact that all humans share an undefined Factor X, which
grounds their equal dignity and rights. The use of enhancing technologies, he fears,
could destroy Factor X.74
Bioethicists George Annas, Lori Andrews, and Rosario Isasi have proposed legislation to
make inheritable genetic modification in humans a crime against humanity, like torture
and genocide. Their rationale is similar to Fukuyamas:
The new species, or posthuman, will likely view the old normal humans as
inferior, even savages, and fit for slavery or slaughter. The normals, on the other
hand, may see the posthumans as a threat and if they can, may engage in a
preemptive strike by killing the posthumans before they themselves are killed or
enslaved by them. It is ultimately this predictable potential for genocide that
makes species-altering experiments potential weapons of mass destruction, and
makes the unaccountable genetic engineer a potential bioterrorist.75
There is some common ground between Annas et al. and the transhumanists: they agree
that murder and enslavement, whether of humans by posthumans or the other way
around, would be a moral atrocity and a crime. Transhumanists deny, however, that this
is a likely consequence of germ-line therapy to enhance health, memory, longevity, or
other similar traits in humans. If and when we develop the capability to create some
singular entity that could potentially destroy the human race, such as a superintelligent
71
(Kass 2002).
(Kass 1997).
73
(Fukuyama 2004). For a response, see (Bostrom 2004).
74
(Fukuyama 2002).
75
(Annas, Andrews, and Isasi 2002).
72
19
NICK BOSTROM
machine, then we could indeed regard it as a crime against humanity to proceed
without a thorough risk analysis and the installation of adequate safety features. As we
saw in the previous section, the effort to understand and find ways to reduce existential
risks has been a central preoccupation for some transhumanists, such as Eric Drexler, Nick
Bostrom, and Eliezer Yudkowsky.
There are other commonalities between bioconservatives and transhumanists. Both
agree that we face a realistic prospect that technology could be used to substantially
transform the human condition in this century. Both agree that this imposes an obligation
on the current generation to think hard about the practical and ethical implications.
Both are concerned with medical risks of side-effects, of course, although
bioconservatives are more worried that the technology might succeed than that it might
fail. Both camps agree that technology in general and medicine in particular have a
legitimate role to play, although bioconservatives tend to oppose many uses of
medicine that go beyond therapy to enhancement. Both sides condemn the racist and
coercive state-sponsored eugenics programs of the twentieth century. Bioconservatives
draw attention to the possibility that subtle human values could get eroded by
technological advances, and transhumanists should perhaps learn to be more sensitive
to these concerns. On the other hand, transhumanists emphasize the enormous potential
for genuine improvements in human well-being and human flourishing that are
attainable only via technological transformation, and bioconservatives could try to be
more appreciative of the possibility that we could realize great values by venturing
beyond our current biological limitations.
20
References:
Annas, G., L. Andrews, and R. Isasi (2002), "Protecting the Endangered Human: Toward an
International Treaty Prohibiting Cloning and Inheritable Alterations", American
Journal of Law and Medicine 28 (2&3):151-178.
Bacon, F. (1620), Novum Organum. Translated by R. L. Ellis and J. Spedding. Robertson, J.
ed, The Philosophical Woeks of Francis Bacon, 1905. London: Routledge.
Bernal, J. D. (1969), The world, the flesh & the devil; an enquiry into the future of the three
enemies of the rational soul. Bloomington: Indiana University Press.
Bostrom, N. (1998), "How Long Before Superintelligence?" International Journal of Futures
Studies 2.
(2002), "Existential Risks: Analyzing Human Extinction Scenarios and Related
Hazards", Journal of Evolution and Technology 9.
21
NICK BOSTROM
(2002), "When Machines Outsmart Humans", Futures 35 (7):759-764.
(2003), "Are You Living in a Computer Simulation?" Philosophical Quarterly 53
(211):243-255.
(2003), "Human Genetic Enhancements: A Transhumanist Perspective", Journal of
Value Inquiry 37 (4):493-506.
The Transhumanist FAQ: v 2.1. World Transhumanist Association 2003.
http://transhumanism.org/index.php/WTA/faq/.
(2004), "Transhumanism - The World's Most Dangerous Idea?" Betterhumans
10/19/2004.
(2004), "Transhumanist Values", in Fredrick Adams (ed.), Ethical Issues for the 21st
Century: Philosophical Documentation Center Press.
(2005), "The Fable of the Dragon-Tyrant", Journal of Medical Ethics forthcoming.
(2005), "The Future of Human Evolution", in Charles Tandy (ed.), Death and AntiDeath: Ria University Press.
(2005), "In Defence of Posthuman Dignity", Bioethics forthcoming.
Bostrom, N., and T. Ord (2005), "Status Quo Bias in Bioethics: The Case for Cognitive
Enhancement", in Nick Bostrom and Julian Savulescu (eds.), Improving Humans,
Oxford: Oxford University Press.
Buchanan, A., D. W. Brock, N. Daniels, and D. Wikler (2002), From Chance to Choice:
Genetics and Justice: Cambridge University Press.
Capek, K. (2004), R.U.R. (Rossum's universal robots), Penguin classics. London: Penguin
Books.
Condorcet, J.-A.-N. d. C. (1979), Sketch for a historical picture of the progress of the
human mind. Westport, Conn.: Greenwood Press.
Darwin, C. (2003), The origin of the species, Barnes & noble classics. New York, NY: Fine
Creative Media.
Drexler, E., and R. Smalley (1993), "Nanotechnology: Drexler and Smalley make the case
for and against 'molecular assemblers'", Chemical & Engineering News 81 (48):3742.
Drexler, K. E. (1985), Engines of Creation: The Coming Era of Nanotechnology. London:
Forth Estate.
(1992), Nanosystems: Molecular Machinery, Manufacturing, and Computation.
New York: John Wiley & Sons, Inc.
Esfandiary, F. M. (1970), Optimism one; the emerging radicalism. New York: Norton.
Ettinger, R. (1964), The prospect of immortality. New York: Doubleday.
Ettinger, R. C. W. (1972), Man into superman; the startling potential of human evolution-and how to be part of it. New York: St. Martin's Press.
Feynman, R. (1960), "There is Plenty of Room at the Bottom", Engineering and Science
Feb.
Firestone, S. (1970), The dialectic of sex; the case for feminist revolution. New York,:
Morrow.
22
23
NICK BOSTROM
Minsky, M. (1994), "Will Robots Inherit the Earth?" Scientific American.
Mitchell, S. (2004), Gilgamesh: a new English version. New York: Free Press.
Moore, G. E. (1965), "Cramming more components onto integrated circuits", Electronics
38 (8).
Moravec, H. (1989), Mind Children. Harvard: Harvard University Press.
(1999), Robot: Mere Machine to Transcendent Mind. New York: Oxford University
Press.
More, M. Principles of Extropy, Version 3.11 2003. http://www.extropy.org/principles.htm.
Newman, W. R. (2004), Promethean ambitions: alchemy and the quest to perfect nature.
Chicago: University of Chicago Press.
Nietzsche, F. W. (1908), Also sprach Zarathustra: ein Buch fur alle und keinen. Leipzig:
Insel-Verlag.
Office, U. S. G. P. (1949), "Trials of War Criminals before the Nuremberg Military Tribunals
under Control Council Law No. 10", 2:181-182.
Orwell, G. (1949), Nineteen eighty-four, a novel. New York: Harcourt.
Parens, E. (1998), Enhancing human traits: ethical and social implications, Hastings Center
studies in ethics. Washington, D.C.: Georgetown University Press.
Parfit, D. (1984), Reasons and Persons. Oxford: Clarendon Press.
Pence, G. E. (1998), Who's afraid of human cloning? Lanham: Rowman & Littlefield.
Pico della Mirandola, G. (1956), Oration on the dignity of man. Chicago: Gateway
Editions.
Posner, R. (2004), Catastrophe. Oxford: Oxford University Press.
Rees, M. (2003), Our Final Hour: A Scientist's Warning: How Terror, Error, and Environmental
Disaster Threaten Humankind's Future in This Century - On Earth and Beyond: Basic
Books.
Regis, E. (1990), Great mambo chicken and the transhuman condition: science slightly
over the edge. Reading, Mass.: Addison-Wesley.
(1994), "Meet the Extropians", Wired 2 (10).
Russell, B. (1924), Icarus; or The future of science. London: K. Paul, Trench, Trubner & Co.,
ltd.
Savulescu, J. (2001), "Procreative Beneficence: Why We Should Select the Best Children",
Bioethics 15 (5-6):413-426.
Shelley, M. W. (1818), Frankenstein; or, The modern Prometheus. London,: Printed for
Lackington, Hughes, Harding, Mavor, & Jones.
Singer, P. (2003), "Shopping at the Genetic Supermarket", in SY Song, YM Koo and DRJ.
Macer (eds.), Bioethics in Asia in the 21st Century: Eubios Ethics Institute, 143-156.
Stock, G. (2002), Redesigning Humans: Our Inevitable Genetic Future: Houghton Mifflin
Company.
Teilhard de Chardin, P. (1964), The future of man. New York: Harper & Row.
Tipler, F. (1994), The Physics of Immortality. New York: Doubleday.
24
25