Dawn of the New Everything: Encounters with Reality and Virtual Reality
By Jaron Lanier
3.5/5
()
About this ebook
Named one of the best books of 2017 by The Economist, The Wall Street Journal, & Vox
The father of virtual reality explains its dazzling possibilities by reflecting on his own lifelong relationship with technology
Bridging the gap between tech mania and the experience of being inside the human body, Dawn of the New Everything is a look at what it means to be human at a moment of unprecedented technological possibility.
Through a fascinating look back over his life in technology, Jaron Lanier, an interdisciplinary scientist and father of the term “virtual reality,” exposes VR’s ability to illuminate and amplify our understanding of our species, and gives readers a new perspective on how the brain and body connect to the world. An inventive blend of autobiography, science writing, philosophy and advice, this book tells the wild story of his personal and professional life as a scientist, from his childhood in the UFO territory of New Mexico, to the loss of his mother, the founding of the first start-up, and finally becoming a world-renowned technological guru.
Understanding virtual reality as being both a scientific and cultural adventure, Lanier demonstrates it to be a humanistic setting for technology. While his previous books offered a more critical view of social media and other manifestations of technology, in this book he argues that virtual reality can actually make our lives richer and fuller.
Jaron Lanier
Jaron Lanier is a scientist, musician, and writer best known for his work in virtual reality and his advocacy of humanism and sustainable economics in a digital context. His 1980s start-up VPL Research created the first commercial VR products and introduced avatars, multi-person virtual world experiences, and prototypes of major VR applications such as surgical simulation. His books Who Owns the Future? and You Are Not a Gadget were international bestsellers, and Dawn of the New Everything was named a 2017 best book of the year by The Wall Street Journal, The Economist, and Vox.
Read more from Jaron Lanier
You Are Not a Gadget Rating: 3 out of 5 stars3/5Who Owns the Future? Rating: 4 out of 5 stars4/5Close to the Machine: Technophilia and Its Discontents Rating: 4 out of 5 stars4/5Radical Markets: Uprooting Capitalism and Democracy for a Just Society Rating: 4 out of 5 stars4/5
Related to Dawn of the New Everything
Related ebooks
Enchanted Objects: Innovation, Design, and the Future of Technology Rating: 5 out of 5 stars5/5Exodus to the Virtual World: How Online Fun Is Changing Reality Rating: 3 out of 5 stars3/5Excursions to the Far Side of the Mind: A Book of Memes Rating: 3 out of 5 stars3/5World Wide Mind: The Coming Integration of Humanity, Machines, and the Internet Rating: 4 out of 5 stars4/5Information Doesn't Want to Be Free: Laws for the Internet Age Rating: 0 out of 5 stars0 ratingsAvatar Dreams: Science Fiction Visions of Avatar Technology Rating: 0 out of 5 stars0 ratingsThe Internet Is Not What You Think It Is: A History, a Philosophy, a Warning Rating: 3 out of 5 stars3/5Rise of the Machines: the lost history of cybernetics Rating: 4 out of 5 stars4/5The Singularity: Could artificial intelligence really out-think us (and would we want it to)? Rating: 0 out of 5 stars0 ratingsVirtually Human: The Promise—and the Peril—of Digital Immortality Rating: 4 out of 5 stars4/5Beyond Zero and One: Machines, Psychedelics, and Consciousness Rating: 5 out of 5 stars5/5Time and the Digital: Connecting Technology, Aesthetics, and a Process Philosophy of Time Rating: 0 out of 5 stars0 ratingsThe Creativity Code: Art and Innovation in the Age of AI Rating: 4 out of 5 stars4/5AI Aesthetics Rating: 0 out of 5 stars0 ratingsUnderstanding Media: The Extensions of Man Rating: 4 out of 5 stars4/5The End of Forgetting: Growing Up with Social Media Rating: 4 out of 5 stars4/5Cypherpunks: Freedom and the Future of the Internet Rating: 4 out of 5 stars4/5Danielle: Chronicles of a Superheroine Complete Edition Rating: 0 out of 5 stars0 ratingsOpen Source Democracy: How online communication is changing offline politics Rating: 4 out of 5 stars4/5Enlightenment 2.0 Rating: 4 out of 5 stars4/5Life on the Screen Rating: 3 out of 5 stars3/5Our Final Invention: Artificial Intelligence and the End of the Human Era Rating: 4 out of 5 stars4/5New Dark Age: Technology and the End of the Future Rating: 4 out of 5 stars4/5Where Wizards Stay Up Late: The Origins Of The Internet Rating: 4 out of 5 stars4/5The Emotion Machine: Commonsense Thinking, Artificial Intelligence, and the Future of the Human Mind Rating: 4 out of 5 stars4/5The Fuzzy and the Techie: Why the Liberal Arts Will Rule the Digital World Rating: 3 out of 5 stars3/5Magic and Loss: The Internet as Art Rating: 3 out of 5 stars3/5The Muse in the Machine: Computerizing the Poetry of Human Thought Rating: 5 out of 5 stars5/5
Biography & Memoir For You
A Stolen Life: A Memoir Rating: 4 out of 5 stars4/5Maybe You Should Talk to Someone: A Therapist, HER Therapist, and Our Lives Revealed Rating: 4 out of 5 stars4/5Becoming Bulletproof: Protect Yourself, Read People, Influence Situations, and Live Fearlessly Rating: 4 out of 5 stars4/5The Good Neighbor: The Life and Work of Fred Rogers Rating: 4 out of 5 stars4/5First, We Make the Beast Beautiful: A New Journey Through Anxiety Rating: 4 out of 5 stars4/5Maybe You Should Talk to Someone: the heartfelt, funny memoir by a New York Times bestselling therapist Rating: 4 out of 5 stars4/5Good Girls Don't Rating: 4 out of 5 stars4/5Meditations: Complete and Unabridged Rating: 4 out of 5 stars4/5Alive: The Story of the Andes Survivors Rating: 4 out of 5 stars4/5Jack Reacher Reading Order: The Complete Lee Child’s Reading List Of Jack Reacher Series Rating: 4 out of 5 stars4/5I'll Be Gone in the Dark: One Woman's Obsessive Search for the Golden State Killer Rating: 4 out of 5 stars4/5Paris: The Memoir Rating: 4 out of 5 stars4/5Breaking Free: How I Escaped Polygamy, the FLDS Cult, and My Father, Warren Jeffs Rating: 4 out of 5 stars4/5Killing the Mob: The Fight Against Organized Crime in America Rating: 4 out of 5 stars4/5Why Fish Don't Exist: A Story of Loss, Love, and the Hidden Order of Life Rating: 4 out of 5 stars4/5The Indifferent Stars Above: The Harrowing Saga of the Donner Party Rating: 4 out of 5 stars4/5Mommie Dearest Rating: 3 out of 5 stars3/5Seven Pillars of Wisdom: A Triumph Rating: 4 out of 5 stars4/5This Is Going to Hurt: Secret Diaries of a Young Doctor Rating: 3 out of 5 stars3/5A Billion Years: My Escape From a Life in the Highest Ranks of Scientology Rating: 4 out of 5 stars4/5People, Places, Things: My Human Landmarks Rating: 5 out of 5 stars5/5Red Notice: A True Story of High Finance, Murder, and One Man's Fight for Justice Rating: 4 out of 5 stars4/5Lakota Woman Rating: 4 out of 5 stars4/5On Writing and Failure: Or, On the Peculiar Perseverance Required to Endure the Life of a Writer Rating: 5 out of 5 stars5/5Leonardo da Vinci Rating: 4 out of 5 stars4/5
Reviews for Dawn of the New Everything
40 ratings5 reviews
- Rating: 5 out of 5 stars5/5Thank You This Is Very Good, Maybe This Can Help You
Download Full Ebook Very Detail Here :
https://amzn.to/3XOf46C
- You Can See Full Book/ebook Offline Any Time
- You Can Read All Important Knowledge Here
- You Can Become A Master In Your Business - Rating: 4 out of 5 stars4/5I'd requested an advance review copy of this book from LibraryThing back in 2017 and was selected, but for some reason never received it. So it sat in my unreviewed queue. I don't shotgun requests because I'm not interested in "free" books, rather I request books on topics I am interested in, and I curate those requests. If I win, cool. If not, I try to get to the book later after it is published because something about it interested me. In this case, it was virtual reality. I did some work at UConn back in 1982 that was cutting edge VR, but I didn't realize it at the time, nor until many years later. I wrote the code that translated a camera trace of an outline of a person standing in front of a silver screen (blue, and then green was not invented yet, I guess) into a stick figure display. Raise your arm, the stick figure did, too. Yeah. The professor and his grad assistant, who was a friend that recruited me, loved what I did and wanted me to do more. But I was too cool for that. "Cool" being a kind term for "young and stupid". Anyway, a lifetime later, I finally read Lanier's memoir-ish semi-history, five years after never receiving my review copy. Not what I expected (and I had to remember why I requested it in the first place, to recall what my expectations actually were). Semi-meandering, Lanier weaves in his life with that of the early world of VR. Really, he offers definitions of VR as he goes along and relates the starts, stops, and evolution (up to 1992) of VR as he saw, led and experienced it. I think it a bit sad that while technology has vastly improved since the 1980s, VR is still seen primarily as visual. Better and better graphics and software, but still no real haptics. Anyway, an interesting read. BTW, he ends with 51 definitions.Some highlighted highlights:[on death, in this case, of his mother] "Therapists, daytime TV hosts, and social networks all counsel that we should talk. It’s a luxury when you can afford to do it. " Interesting perspective. I find it is exceedingly rare that “talk” helps more than it hurts. But I find myself in a minority on that.[On chance encounters] "Who are these strange creatures who walk among us? Today I would Google or Bing, but in those days one moved from mystery to mystery." I like his writing."Becoming an adult does not mean a total loss of creative power. It just means you have to put up with an enormous amount of inconvenience."Preach, brother! "Exotic road stories are fun to tell and fun to hear, but they depend on not having had a deep stake. When you alight in a place, you must deal with people for real. When you’re planted, you must also deal with yourself. "[On Joseph Campbell] "Well, yeah. Anyway, Campbell—really great guy—has a theory I don’t really like much, that all human stories are variations on the same shared story." Concur [On his unique and groundbreaking game Moondust] "The music was algorithmic and pretty, with an echo and wetness, which was a trick in those days. The music was driven by the action, a first in gaming." I had to look it up, Pretty cool. [Jumping off point] Scott Rosenberg wrote a book that in part recounted my experience of dreaming in code, called, naturally, Dreaming in Code" My notes of this type are usually "Find". In this case, I found it and read it in parallel with this one.[memories] "If I’m not great at remembering events, faces, or sequences, how do I know my life? I remember experiences in terms of ideas; how a story I lived through illuminated a deeper question. My experiences become allegories." Hmmm. I tend to discard names faster than other things, with experience details after, to make room for more, I suppose. This prompted me to stop and consider the perspective.[more on memory] "My cognition is oddly ill-suited to the task of reconstructing meticulously accurate history. One reason is that I have a more than moderate case of prosopagnosia, or face blindness. I generally do not recognize people on sight.[...]I’d rather convey the authentic incompleteness of my memory. The events happened, but the cast is uncredited." I can definitely relate [on programming] "Programming was an Eden. Today it’s a crowded bureaucracy; code is all about reconciling what you want to do with endless layers of preexisting structures in the Cloud. "It used to be an individual thing. Even if you worked on someone else’s code, it became yours when you were done. And it stood alone. [Jumping off point] "Fred Brooks had long ago observed, in his classic book The Mythical Man-Month "Find [On musical instruments, expression, and computers] "Not only are instruments the best haptic interfaces yet invented, they are the best interfaces of any kind, if what we care about is the potential for mastery and expressiveness. Instruments show what’s possible; how far computer science must go before we can call it even a beginning." [On VR] "Most people lose touch with the thrill of VR after the initial novelty if they can’t interact and have an impact on the virtual world."Seems quite true. [Jumping off point] "When I was a kid we had 78s of Uday Shankar and other amazing non-Western musicians. In the LP era I was obsessed with releases on the Nonesuch label: gamelan, Tibetan ritual, drumming from Ghana and Senegal, gagaku court music, and on and on." Okay, I have some genres and music to find. [Me] He uses words like this a lot: spirit, ghost [On Timothy Leary...yes, that Timothy Leary] "Tim was always ringed by circles of adoring hippie kids, but he also adored being embedded in the world of Hollywood glamor. He became a great friend with whom I disagreed. It was good practice for me, as I would grow to have more of those over time" Great friend with whom I disagreed. Everybody needs one of those. I need one. (I have a great friend, but we agree much much more than not.[on a VR demo developed for a drug company to promote Prozac to psychiatrists] "What I had not foreseen is that I’d spend exhausting, bizarre days at the annual psychiatrists’ convention putting the world’s top shrinks through demos in which they shrank. The situation was more surreal than even VR ought to be; in those days half of them looked like Freud impostors." Oops, my fingers slipped and keyed in this note to myself: "Freud was an imposter "[on the failure to anticipate the internet properly] "Much later on, companies like Google and Facebook would make hundreds of billions of dollars for the service of partially mapping what should have been mapped from the start."[on email] In the early days of the popularization of the Internet, there was a debate about whether to make online digital experiences seem casual and weightless or whether to make them feel serious, with costs and consequences. For instance, early luminaries including Esther Dyson and Marvin Minsky advocated micropostage for email. If people had to pay for email, even if only a tiny fraction of a penny, big-time spammers would be discouraged. Meanwhile email would be appreciated for what it is, a big human project that costs a lot.Something too late to think about.[more on the internet] "Reasonable people started to change through online experience, and for the worse. [...]A new medium was bringing out the worst in a tiny minority of people, but that minority was in your face." How true.[more on that "worst"] "For years, Gamergate was only a plague within digital culture, but by 2016 its legacy was influencing elections, particularly the one in the United States. Gamergate turned out to be a prototype, rehearsal, and launching pad for the alt-right." [futurism] "Don’t make the mistake of treating this book as a conservative or traditionalist reaction against trendy futurism. I’ll usually out-futurize other futurists in futurism cutting contests."I recently read a book on futurism. He's right.
- Rating: 4 out of 5 stars4/5
Good writing. Instantly engaged. I wasn't sure I'd be that interested in the subject but the feel and rhythm of the author moves you along.
- Rating: 4 out of 5 stars4/5Although I had devoured three other of Lanier's books, I originally wasn't going to get this one, because I'm not terribly interested in virtual reality. But having read a sample of his personal memoir, I was hooked enough to make the purchase. Lanier seems remarkably un-self-conscious about what an extraordinary upbringing he had. As a young teen, he was allowed by his single parent father to DESIGN their house. Which they then BUILT. And LIVED IN - I think his father was there till his old age. You have to see the picture and read the descriptions of this structure. Moving on, Lanier also downplays what an extraordinary polymath he is; his young adult years are full of wonder and interest in almost everything life throws his way. What an extraordinary individual! Alas, I'm still not very interested in virtual reality; and he dwells an awful lot on the his company in the 80s, the people and the physical surroundings, which really don't make as good a read as the multi-dome structure in the middle of the desert designed and built by a lunatic teenager. The appendices trod over territory familiar to those who've read his other books, but serve as excellent summaries of his positions on AI and social media, which endear him to me.
- Rating: 1 out of 5 stars1/5I was very looking forward to reading this book. I have not gotten too much into virtual reality but it is something that intrigues me. Therefore I was very interested in what Mr. Lanier had to say as one of the first to experience virtual reality. What I got was some history about his childhood. Not that I did not find it interesting that he and his father lived in the desert for years. Yet, for the most part I really did not find that much interesting. The further that I read the more I started to get turned off. After getting a third of the way into the book and not finding myself looking forward to reading anymore, I put this book down. If it had been just about the history of virtual reality, without the memoir aspect, I may have stuck with this book longer.
Book preview
Dawn of the New Everything - Jaron Lanier
Begin Reading
Table of Contents
About the Author
Copyright Page
Thank you for buying this
Henry Holt and Company ebook.
To receive special offers, bonus content,
and info on new releases and other great reads,
sign up for our newsletters.
Or visit us online at
us.macmillan.com/newslettersignup
For email updates on the author, click here.
The author and publisher have provided this e-book to you for your personal use only. You may not make this e-book publicly available in any way. Copyright infringement is against the law. If you believe the copy of this e-book you are reading infringes on the author’s copyright, please notify the publisher at: us.macmillanusa.com/piracy.
To everyone mentioned in this book and the many more I wish I’d been able to mention: thank you for giving me my life.
Acknowledgments
Some passages of the present work are adapted from my contributions to John Brockman’s edge.org or my anthologies of science writing. Other passages are adapted from my works originally published in the Whole Earth Review or the New York Times.
My wife, Lena, not only supported and put up with me while I wrote this book, but I am astonished at the strength and brilliance she displayed during a period when she was battling cancer. Thank you!
Thanks to Maureen Dowd for correspondence that inspired some passages.
Thanks to Satya Nadella, Peter Lee, Harry Shum, and everyone else at Microsoft Research for their camaraderie and support. Not a word here represents a Microsoft point of view, of course.
Thanks to Mary and Steve Swig for the writing cottage at The Shadows.
Thanks to my editors, Gillian Blake in the USA and Will Hammond in the UK, for their always graceful interventions, and especially for their patience during a year of delays and difficult circumstances; and to my agents, especially Jay Mandel. Thanks to Eleanor Embry at Holt for her tireless attention to manuscript details.
Thanks for reading early drafts: Michael Angiulo, Tom Annau, Jeremy Bailenson, Steven Barclay, Maureen Dowd, George Dyson, Dave Eggers, Mar Gonzales Franco, Edward Frenkel, Alex Gibney, Ken Goldberg, Joseph Gordon-Levitt, Lena Lanier, Matthew McCauley, Chris Milk, Jane Rosenthal, Lee Smolin, Mary Swig, and Glen Weyl.
Preface: Virtual Reality’s Moment
It was the late 1980s, and a large envelope with a formidable DO NOT X-RAY sticker had just been dropped through the slot of the front door of a tech startup in Redwood City, California. The envelope contained a floppy disk that held the first digital model of a whole city. We had been waiting all morning. Jaron, it’s here, get to the lab!
One of the engineers rushed to snatch the envelope before anyone else could get at it, sliced it open, ran to the lab, and slid the disk into a slot in a computer.
It was time for me to enter a brand-new virtual world.
I squinted up at my hand against a perfectly clear blue sky. My gargantuan hand, soaring above downtown Seattle. It might have been a thousand feet from wrist to fingertip.
There was a bug, obviously. A hand should be about the right size to pick up an apple or a baseball, not bigger than a skyscraper. You shouldn’t have to measure a hand in feet, much less thousands of them.
The city was abstract. This was in the early days of VR, so plasticine blocks stood in for most buildings, in a jumble of too-cheerful-for-Seattle colors. The fog was preternaturally uniform and milky.¹
My first thought was to stop and fix the bug, but instead I took a moment to experiment. I flew down and tried to nudge a ferry on the sparkling Puget Sound. It worked! I had control. Not what I expected. That meant that I could still inhabit my hand when it was preposterously huge.
Once in a while, a bug in VR exposes a fresh way that people can connect to the world and each other. Those are the best moments. I always stop and linger when it happens, to hang on to the sensation.
After a few experiences of VR bugs, you have to ask yourself, Who is it who is suspended in nothing, experiencing these events?
It is you, but not exactly. What is left of you when you can change virtually everything about your body and the world?
A bundle of cables connected my EyePhone, through a loop hanging from the ceiling, to a line of refrigerator-size computers that roared to keep cool. I wore a DataGlove on my hand; slick black mesh woven through with fiber optic sensors, and yet more thick cables from the wrist arcing up to ceiling rings. Blinking lights, flickering screens. The EyePhone’s rubber rings left moist red indentations around my eyes.
I wondered at the strangeness of the world I found myself in, now back in the lab. Buildings in Silicon Valley used to have carpeted walls and cheap Space Age desks with fake wood grain. A faint smell of aluminum and dirty water.
A gang of eccentric technical geniuses converged, impatient to try. Chuck in his wheelchair; a robust, bearded lumberjack. Tom acting all professional and analytical, even though only a few minutes earlier he’d been telling me about his crazy adventures exploring San Francisco overnight. Ann seemed to be wondering why she was yet again cast in the role of the only adult in the room.
Did it feel like being in Seattle?
Kind of,
I said. It’s, it’s … marvelous.
Everyone shoved toward the gear. Every little iteration of our project got better. There’s a bug. The avatar hand is huge—by magnitudes.
I never got tired of the simple act of using my hand inside VR. When you could bring your body in there, you were not just an observer, but a native. But every tiny detail of functionality, of figuring out how a virtual hand could hold virtual things, turned out to be a struggle.
Fix a problem with how virtual fingertips mistakenly penetrate objects they are trying to pick up, and you might accidentally make the hand gargantuan. Everything connects with everything. Every tweak of the rules of a new world is a potential setting for a startling, surrealistic bug.
The author as he appeared in the late 1980s outside and inside VR.
Bugs were the dreams within virtual reality. They transformed you.
A moment with a giant hand changed not only how virtual reality felt to me, but how physical reality felt. My friends in the room now looked like pulsing beings, translucent. Their transparent eyes were filled with meaning. This was not hallucination, but improved perception.
Physicality revealed in fresh light.
Introduction
What Is It?
VR is those big headsets that make people look ridiculous from the outside; those who wear them radiate startled delight at what they’re experiencing from the inside. It’s one of the dominant clichés of science fiction. It’s where war veterans overcome PTSD. The very thought of VR is the fuel for millions of late night reveries about consciousness and reality. It’s one of the only ways, for the moment, to raise billions of dollars fleetly in Silicon Valley without necessarily promising to spy on everybody.
VR is one of the scientific, philosophical, and technological frontiers of our era. It is a means for creating comprehensive illusions that you’re in a different place, perhaps a fantastical, alien environment, perhaps with a body that is far from human. And yet it’s also the farthest-reaching apparatus for researching what a human being is in the terms of cognition and perception.
Never has a medium been so potent for beauty and so vulnerable to creepiness. Virtual reality will test us. It will amplify our character more than other media ever have.
Virtual reality is all these things and more.
My friends and I founded the first VR startup, VPL Research, Inc., in 1984. This book tells our story, and explores what VR might mean to the human future.
The first virtual reality system, according to the original definition, in which multiple people cohabited a virtual world at the same time. This was VPL’s RB2, or Reality Built for Two.
In the screens behind each person, you can see how they see each other as avatars. This photo is from a trade show in the late 1980s.
Recent VR enthusiasts might exclaim, 1984, no way!
But it’s true.
You might have heard that VR failed for decades, but that was true only for the attempts to bring out a low-cost, blockbuster popular entertainment version. Just about every vehicle you’ve occupied in the last two decades, whether it rolls, floats, or flies, was prototyped in VR. VR for surgical training has become so widespread that concerns have been expressed that it’s overused. (No one would suggest that it shouldn’t be used at all; it’s been a success!)
What Can a Book Do That VR Can’t, at Least as Yet?
The romantic ideal of virtual reality thrives as ever. VR the ideal, as opposed to the real, technology weds the nerdy thing with the hippie mystic thing; it’s high-tech and like a dream or an elixir of unbounded experience all at the same time.
I wish I could fully convey what it was like in the early days. There was a feeling of opening up a new plane of experience. Inhabiting the first immersive avatars, seeing others as avatars, experiencing one’s body for the first time as a nonrealistic avatar; these things transfixed us. Everything else in the tech world was dull in comparison.
I cannot use VR to share what that experience was like with you, at least not yet. VR, for all it can do, is not yet a medium of internal states. There is less and less need for me to make this point as VR becomes more familiar, but it’s a clarification that I have been called upon to give many times.
There’s occasional talk about VR as if it is on the verge of evolving into telepathic conjuring of arbitrary reality along with a conjoining of brains. It can be difficult to explain that VR is wonderful for what it is, precisely because it isn’t really everything.
Eventually a new culture, a massive tradition of clichés and tricks of the VR trade, might arise, and that culture might allow me to convey to you how early VR felt, using VR-borne technique. I have spent many hours daydreaming about what a mature culture of expression would be like in VR. A cross between cinema, jazz, and programming, I used to say.
First VR Definition: A twenty-first-century art form that will weave together the three great twentieth-century arts: cinema, jazz, and programming.
¹
Even though no one knows how expressive VR might eventually become, there is always that little core of thrill in the idea of VR. Arbitrary experience, shared with other people, conversationally, under our control. An approach to a holistic form of expression. Shared lucid dreaming. A way out of the dull persistence of physicality. This thing we seek, it’s a way of being that isn’t tied just to our given circumstances in this world.
If I tried to tell the story of VR dispassionately, I’d be lying. What makes VR worthwhile to me is that it’s about people. I can only tell you what VR means to me by telling my story.
How to Read This Book
Most of the chapters tell a story that begins in the midsixties, when I was a boy, and ends in 1992, when I left VPL.
There are also chapters interspersed throughout that explain or comment on aspects of VR, such as a chapter on VR headsets. These about
chapters include a dusting of basic introductory material, a hearty portion of sharp opinions, and more than a few out-of-sequence anecdotes. You have my permission to skip through them if you prefer storytelling to science or commentary. Or, if you don’t like storytelling and just want to read my thoughts on VR tech, then race right to those chapters.
Some of my stories and observations are found in long footnotes. I bet you’ll be glad if you find the time to read them, but you can leave that for later. There are also three appendices that expand on my ideas from the period, but are ultimately more concerned with the future than the past. Read them if you want to know what it feels like to have an informed worldview that doesn’t include AI destroying humanity any minute.
In keeping with the time period of the narrative, I’ll talk more about classical VR than mixed reality,² even though that’s what I’ve worked on more lately. (Mixed reality means the real world is not hidden entirely by the virtual one; you see virtual stuff placed within the real world, as experienced lately in a HoloLens.)
Meeting My Younger Self
Never thought I’d see you again.
What I always feared. You get old, then you milk your younger self. Like all the other writers.
You are so wrong. It would be easier not to deal with you. I’ve been feeling more comfortable with myself than ever before. Dealing with you brings up crummy old patterns. I get insecure and depressed. You’re recidivism bait. I’m only doing this because I think it would be useful for other people to know about you.
What’s going on with virtual reality? Is it even called VR?
Yeah, most people call it VR now.
You mean we won the terminology war?
No one remembers or cares about that war. It’s just words.
But is VR any good?
Well, we’re about to find out. It looks like this book might come out at about the same time that VR gets commonplace.
Oh crap, I hope they don’t screw it up.
Yeah, who knows … You know how hard it is to do VR well.
I hope VR isn’t still so—what’s the word?—pressured by all the psychedelic people.
Oh, you’d miss them. You won’t believe it, but singularity freaks cross-bred with libertarians, and their fanatical offspring are the main drivers of tech culture these days.
Wow, that sucks—worse than I imagined.
I feel embarrassed that you were expecting a perfect world.
I’m embarrassed that you think you’re noble or enlightened just because you learned to accept living with bullshit.
Oh, c’mon, let’s not fight. There are plenty of people out there to fight with.
Okay, so tell me about this cheap VR you say is shipping. Are people making up their own VR worlds?
Well, usually not while they’re inside, but yeah, a lot of people will probably be able to make worlds.
But if you can’t improvise the world from inside, what’s the point? Just more phenomena to clog the senses, and not even as good as in the natural world. Why does anyone care? You’ve got to do something to stop it before they bring out crap. What’s wrong with you?
Hey man, I’m not the VR police. I don’t run the show.
Why not? You were supposed to run the show!
It’s actually great to watch the kids reinvent VR. There are all these cute VR startups and teams in the big companies. Some of them even remind me of you and VPL, though the fashion these days is a lot straighter.
I’m insulted that you’d say someone reminds you of me if that person just thinks of VR as a spectacle. Don’t they know that’ll turn into a cliché pretty fast? What happened to the dream of improvising reality? Shared lucid dreaming? I mean, what’s the point of just making a flashier type of movie or video game?
Look, you can’t devote yourself to serving people if you think you’re better than them. VR will be kind of crummy but also kind of great and it will evolve and hopefully get really great. You have to relax about it. Enjoy the process. Respect the people.
What a load of crap. Are you at least screaming your head off about it?
Well, yeah, I guess … this book …
Okay, so who’s bringing out cheap VR? VPL?
No, VPL is long gone. Microsoft brought out a self-contained mixed reality headset—doesn’t need a base station—goes anywhere. You’d be really impressed.
Microsoft? Oh no …
Um, my research post lately is in Microsoft’s labs.
Are you institutionalized? Oh wait, you just said you are.
Give it a rest. Classic VR gear is also shipping; not unlike what we used to sell. One of the social media companies bought this little company called Oculus for two billion dollars.
Waaaaiiit whaaaat? Two billion for a VR company that hadn’t shipped yet? Wow, the future sounds like paradise. And what’s a social media company?
Oh, that’s a corporation people use to communicate with each other and keep personal remembrances, and there are algorithms that model the people so offers can be targeted; these companies can make people sadder or more likely to vote by tweaking the algorithms. They’re the center of a lot of people’s lives.
But, but, combining that with VR would be like a Philip K. Dick novel. Oh my, the future sounds like hell.
It’s both paradise and hell.
But bright, rebellious young people wouldn’t want to be running their lives through a corporation’s computer …
Weirdly, the new generation gap is—supposedly—that young people are more comfortable with corporations running digital society.
You say that like it’s just another fact you can live with. I mean, wouldn’t they become like serfs? Do they just live with their parents more, or what? The world’s gone mad. Everything’s inverted.
But that’s normal for the world. It’s what happens with time.
I feel like I need to slap you.
Maybe you do.
1. 1960s: Terrors of Eden
Border
My parents fled the big city right after I was born. They roamed for a while; eventually alighting in what was, at the time, an obscure and harsh place. The westernmost corner of Texas, outside El Paso, at the juncture of New Mexico and Mexico proper, was an outback, barely part of America. It was impoverished, relatively lawless, and of unsurpassed irrelevance to the rest of the country.
Why there? I never got a clear answer, but my parents were probably running. My Viennese mother had survived a concentration camp and my father’s family had been mostly wiped out in Ukrainian pogroms. I do remember hearing that we had to live as obscurely as possible, but it would be unacceptable to live too far from a good university. They came to rest in a place that split the difference, for there was a good university nearby in New Mexico.
I remember my mother saying that the Mexican schools were more like those in Europe, with a more advanced curriculum than was available in rural Texas at the time. Mexican kids were a couple of years ahead in math.
But Europe wanted to kill all of us. What’s good about Europe?
She replied that there were beautiful things everywhere, even in Europe, and you have to learn how to not get shut down completely by the evil of the world. Besides, Mexico most definitely wasn’t Europe.
So I crossed the international border every morning to go to a Montessori school in Ciudad Juárez, Mexico. Sounds strange today, since the border has come to look like the world’s most advertised prison, but back then it was understated and relaxed; creaky little school buses crossed all the time.
My school was a world apart from the one I would have attended in Texas. Our schoolbooks were sheathed in fantastic images of Aztec mythology. Teachers dressed up for holidays; colorful fabrics, mod 1960s cuts, with large, living, iridescent beetles soldered to silver chains, free to wander on shoulders. Every hour or so, the beetles were offered brightly colored sugar water from eyedroppers.
Since it was a Montessori school, we were free to roam like beetles, and I made a discovery. Looking through a ragged old art book on a low shelf in our forlorn schoolhouse, I saw an image of Hieronymus Bosch’s triptych The Garden of Earthly Delights.
Window
I remember being scolded at my little school for not paying attention. Instead I stared out the window endlessly, as if hypnotized. But this was not spacing out. It was an intense contemplation.
¡Atención! Pay attention!
The Garden of Earthly Delights had left me thunderstruck. I imagined being inside it, petting the soft, giant birds of intimate velvet colors, crawling through playgrounds made of transparent fleshy spheres, plucking and blowing the mammoth musical instruments that pierced each other and would eventually pierce me. I imagined how that would feel. An intense tickling, a spreading warmth.
A few of Bosch’s figures look out from the canvas. What if I were one of them? When I was staring out that window, I was looking out at our supposedly normal world from inside the painting. No small chore; it took hours, infuriating the teachers.
¿Qué es lo que estás mirando? "What have you been staring at?"
I saw the occasional naked child alight on the little sandbox, then prance until caught, rather like in the painting. But I also saw beyond the yellow grass of the schoolyard, through the chain-link fence, to a dusty and chaotic city street.
Grizzled men in frayed straw hats inside the glass heads of mammoth trucks painted in carnival colors, blinding speeds, black noisy exhaust clouds; weathered pastel neighborhoods vanishing up into tortured striations of rock in the far desert mountainside; silver planes in the sky filled with people. Right across the street was a heroic two-story mural of Quetzalcoatl climbing a parking lot wall.
Estoy viendo maravillas. I see miracles.
Right up close, just behind the fence, I could make out more detail: furled growths on the chest of a beggar; the tottering motion of a polio survivor delivering stacks of fresh newspapers; dirt on the fringes of a teenage boy’s green shirt; a pyramid of shiny green cut cactus on the handlebars of his wobbling bike. I once saw gashes in the face of a sullen prisoner in the smoky rear chamber of a careening Mexican police car, viewable for the barest instant through blinding, sweeping beacons.
Trifecta
Was everyone else in my little school blind and deaf? Why were they so inert? Why wasn’t everyone else thunderstruck? I did not understand them.
I became obsessed with useless speculations. What if I had gone to a school across the river, in Texas? Things must be more orderly in Texas. If you took a copy of The Garden to Texas and the little naked people looked out, would they see a world that looked weird, or would they say, Wow, we didn’t know anyplace could be that boring!
Was it possible that every place in the whole universe was wondrous, but people just get worn out by the chore of perception? Is that why all the other kids just sat there, pretending that everything was normal?
Of course I couldn’t have articulated these words. I was tiny.
I stared and stared at the painting and then out the window and then back. I felt my interior color shift each time, like blood rushing in and out of my head. Why was the painting so luscious? What was so naughty about it that drew me in?
Even better was staring at the image while listening to Bach. The schoolroom had a battle-worn record player. One LP had Bach’s organ music played by E. Power Biggs and another offered Glenn Gould on piano.
My favorite thing was staring into The Garden while listening to the Toccata and Fugue in D minor, loud, and eating from a bowl of Mexican chocolates, tinged with cinnamon. Hardly ever allowed.
Mood
My earliest memories are of being consumed by an overpowering subjectivity. Everything was distinct, moody, filled with flavor; each little place and every moment was a fresh spice in an endless spice cabinet, a new word in an endless dictionary.
It continues to surprise me how difficult it can be to convey a state of mind to those who do not immediately recognize it. Imagine you are hiking in the light of the full moon at midnight on a high ridge in New Mexico, looking down on a valley dusted in new snow that appears to fluoresce. Now imagine an exchange between two fellow travelers, one a romantic and the other possessing a dry, analytical temperament. The romantic might say, Isn’t this magical?
while his opposite might say, Well, the visibility is unusually good and the moon is full.
In my childhood I was hyperromantic, unable even to conceive of a pragmatic notion like visibility,
because the experience of magic
was completely overwhelming, to the near exclusion of everything else. My early experience was of the dominance of flavor over form, of qualia over explanation.
Over time I’ve learned to become more normal, or more boring. It used to be that I could hardly stand to fly from one place to another because the shift in mood and quality would be so overwhelming. I would always be stunned by what it felt like to land in San Francisco, coming from New York, even after doing it hundreds of times. The air was brisk, tinged with the smell of gasoline, but also the ocean; it was thinner, less pregnant. Just to take in the shift in feeling could take hours.
I worked at being able to suppress the overwhelming burden of subjective mood for many years, and started to make progress in my late thirties. These days, I fly from one place to another without difficulty. The airports are all finally starting to feel similar.
Spun
I called my parents by their first names. Lilly had been a prodigy concert pianist as a girl, born to a successful Jewish family in Vienna. Her father was a professor and a rabbi; an associate of Martin Buber’s. They lived in a nice house, had comfortable lives. My grandparents were determined to wait out the threatening politics of their day. They were convinced there was a limit to how low people would sink.
Lilly was a precocious and resourceful teenager, and while it would normally be the last thing you’d care about, it turned out to be crucial that she was very light-skinned and blond. She was able to talk her way out of a pop-up concentration camp by passing as Aryan, and then to forge paperwork to get her father released just before he would have been murdered.
Maneuvers like this were only possible in the earliest days of the Holocaust, before genocidal procedures were optimized. In the end, most of my mother’s family was murdered by the Nazis.
Some got out, eventually to New York City. At first, Lilly made a living as a seamstress; soon she had her own lingerie brand. She studied painting, and was still young enough to train as a dancer. She earned her own money to pursue these dreams. In photographs, she looks like a movie star.
We were so close that I had barely ever perceived her as a separate person. I remember playing Beethoven sonatas on the piano for her and her friends, and it felt as if we were playing them together from the same body. The interpretation was languorous and showy.
My parents had just transferred me to a Texas public elementary school. No art books to peruse, nothing interesting out the window. They were worried that I wasn’t learning what I would need in order to integrate into America.
Boy, was that true. In order to get to my new school, I had to walk through the territories of neighborhood bullies. These were kids with cowboy drawls and dirty boots. I was shocked when my parents decided a karate class would be prudent for me.
I loathed every little thing about karate, except that the costumes were kind of cool. When my mother came to the faux Texas dojo to see a demonstration of my training, I stood still and took it while another boy hit, kicked, and chopped at me. I don’t remember feeling scared or shy, but instead that fighting this other person would be stupid, wrong; just bad. Besides, the kid couldn’t really fight and nothing he did actually hurt. But my mother was horrified; she looked disappointed in me for the first time ever. I remember feeling the sky drop.
The next morning, as I walked across the hardened soil and stubby yellow grass in our yard on my way to school, I was surrounded by big bellicose bullies. I had a baritone horn with me, which is like a mini-tuba. But to a nine-year-old, it’s about as big as a tuba, and a strategy formed in my mind.
I started turning like a helicopter, the horn extended like a shield, though it acted like a battering ram. The bullies were not clear on the concept of momentum, and tried charging me head-on a couple of times, only to be knocked sideways to the ground. They couldn’t find it within themselves to stop for a moment to reconsider their approach. I think there were three of them, soon bruised and running away. I was dizzy, but music had saved me.
Suddenly my self-satisfaction was atomized by shrieking. Lilly was standing behind the front door, cracked open just a bit, wailing as if the Nazis had come for me. She was not dressed and did not come outside. It took me years to realize that she must have experienced a flashback to Vienna.
At the time, I was terrified by her reaction. My not fighting at the karate studio had displeased her, and yet here I fought, but that also freaked her out. Suddenly I felt a disconnection. The sensation was so disorienting and unpleasant to me that I didn’t know what to do. I ran away, to school. That was the last time I saw her.
Beyond Recall
A glum man with sharp features, in a perfectly pressed military uniform, knocked at the door of the classroom and asked for me. I was happy to get out of a droning lecture about the Alamo, but something felt terribly wrong.
Soon I saw that the principal was also there, and this man asked me in the most formal voice I had ever heard to follow them to her office, where I had never been. There was a flag, a framed photo of President Johnson. Was I in trouble for hitting the bullies with the horn?
Then these strangers told me that my mother was dead and my father was in the hospital.
It happened to be the day Lilly was set to go into town for her first-ever driver’s test. The DMV was about an hour away, near downtown El Paso. Ellery, my father, drove on the way there. She passed the test.
Lilly was driving back, on the big freeway, when their car spun out of control, flipped, and flew off a high overpass. Or so said a fresh newspaper clipping, which the principal gave me, as if that was helpful.
For years I worried that Lilly’s traumatic flashback that morning might have made her panic on the road. I was consumed by guilt. Had I been part of the problem?
Decades later, an engineer friend of mine read about a possible flaw in the model year of the car. It was a match for the events of the accident. By that time it was way too late to look into legal recourse, but I wondered, why did my parents even buy a car from Volkswagen? It wasn’t a beetle,
the model designed by Hitler, but still.
The choice must have been part of my mother’s program to find the good in Europe, in everything.
It turned out that the military man was a distant relative the police had tracked down. He was named in my mother’s will, and was stationed at Fort Bliss, the military base that makes up much of El Paso. I had never heard of him.
I was taken to the hospital to see my father, whose body was blackened in between bandages, after he had become conscious. Both of us cried uncontrollably, so hard it felt like I’d choke to death.
This memory is a wall. I remember almost nothing else from before my mother’s death. My slate was shaken clean.
Sound
I was disconnected from the world for a long time after. Endured a desolate tour of life-threatening infectious diseases, barely aware of my circumstances. I was virtually immobile for a year in that same hospital.
Ellery was devoted. He slept on a cot next to my hospital bed. The seasons cycled, and I finally started to engage with the world again. I remember paying attention to my new surroundings for the first time.
The hospital was cramped, hot, and noisy. Cracked pea-green tiles running halfway up the wall, greasy windows embedded with chicken wire, splintered frames, peeling dark green paint. Smelled like medicine and urine. Big tough nurses with tiny crosses hanging from their crinkled necks; they moved like tanks, mostly ignored everyone.
I started to read. Books propped on crimped-up bedsheets.
Then, two moments of irreversible positivity sparked in me, just because I read sequences of words.
One was the Jewish admonition to choose life
in a children’s book about Jewish culture. There was a logic to it, since death would come soon enough, no matter what, so choosing life was at least a reasonable bet. Like Pascal’s Wager, but for this life. (Not that I would have heard of Pascal or his wager as a kid.) But as I thought about it, I realized that choose life
has even more going on.
It’s so obvious that you could miss it, but the phrase tells you that life is a choice. Furthermore, it suggests that once you notice that you’ve chosen to live, then you might notice that you can probably also make further choices. I needed to hear that, because it had not even occurred to me that I had any choice at all at the time. Before reading those words, all I could do was lie there, waiting for whatever might happen next.
But then there’s an even deeper level to the phrase. You choose even though you can’t ever know what that means. This physical world we inhabit; we’re only in it because of a crazy bet we make with the unknown. Maybe there’s peace and happiness to be found in uncertainty. There isn’t anywhere else to look.
I guess you, my reader, might wonder if I’m forcing adult thoughts into my recollections of a child’s brain, but I remember this phase pretty clearly. I was obsessed with what’s usually called philosophy, and it helped.
The second bit of reading was a biography of Sidney Bechet, one of the great early New Orleans wind players. According to the book, he overcame his childhood respiratory problems by playing the clarinet. Well, I had a nasty case of pneumonia that persisted for months, along with other respiratory distresses, so I asked Ellery for a clarinet. Not only was it a great way to annoy the nurses, but my lungs started to clear.
This is starting to sound like a familiar inspirational healing narrative, but there is something else you should know. My father and I never again spoke of my mother.
Silence is not forgetting in intimate settings. Just the opposite. We still lit Yahrzeit candles; we cried for years.
Decades later, I realized that both my parents had no choice but to put those who died out of mind much of the time. It was the only way to make space for life, for there were so many who had died so horribly.
Ellery had an aunt who was entirely mute, but she wasn’t born that way. As a girl she had survived by keeping absolutely silent while her big sister, who she clung to, was slain by sword where they hid under a bed during a pogrom.
To Ellery, Lilly’s death was one of many. Therapists, daytime TV hosts, and social networks all counsel that we should talk. It’s a luxury when you can afford to do it.
Outlasting Cruelty
When I emerged after my long dormancy, hosting one disease after another, I was fat, but didn’t know it at all. I was numb. When I finally went back to school and the kids laughed so cruelly, only then was I suddenly aware.
Normally, taunts from children would be traumatic, but there was more. Juvenile cowboy bullies bragged about how they drowned a tiny Chicano kid in the neighborhood swimming pool, an event that the adult world had officially registered as an accident, though everyone knew.
The bullies said I