Virtual Worlds

The Age of Em

Posted by Peter on May 24, 2016
Posted in: Artificial Intelligence, Book Reviews, Economics, Miscellaneous, Virtual Worlds. Tagged: , , , , .

Book review: The Age of Em: Work, Love and Life when Robots Rule the Earth, by Robin Hanson.

This book analyzes a possible future era when software emulations of humans (ems) dominate the world economy. It is too conservative to tackle longer-term prospects for eras when more unusual intelligent beings may dominate the world.

Hanson repeatedly tackles questions that scare away mainstream academics, and gives relatively ordinary answers (guided as much as possible by relatively standard, but often obscure, parts of the academic literature).

Assumptions

Hanson’s scenario relies on a few moderately controversial assumptions. The assumptions which I find most uncertain are related to human-level intelligence being hard to understand (because it requires complex systems), enough so that ems will experience many subjective centuries before artificial intelligence is built from scratch. For similar reasons, ems are opaque enough that it will be quite a while before they can be re-engineered to be dramatically different.

Hanson is willing to allow that ems can be tweaked somewhat quickly to produce moderate enhancements (at most doubling IQ) before reaching diminishing returns. He gives somewhat plausible reasons for believing this will only have small effects on his analysis. But few skeptics will be convinced.

Some will focus on potential trillions of dollars worth of benefits that higher IQs might produce, but that wealth would not much change Hanson’s analysis.

Others will prefer an inside view analysis which focuses on the chance that higher IQs will better enable us to handle risks of superintelligent software. Hanson’s analysis implies we should treat that as an unlikely scenario, but doesn’t say what we should do about modest probabilities of huge risks.

Another way that Hanson’s assumptions could be partly wrong is if tweaking the intelligence of emulated Bonobos produces super-human entities. That seems to only require small changes to his assumptions about how tweakable human-like brains are. But such a scenario is likely harder to analyze than Hanson’s scenario, and it probably makes more sense to understand Hanson’s scenario first.

Wealth

Wages in this scenario are somewhat close to subsistence levels. Ems have some ability to restrain wage competition, but less than they want. Does that mean wages are 50% above subsistence levels, or 1%? Hanson hints at the former. The difference feels important to me. I’m concerned that sound-bite versions of book will obscure the difference.

Hanson claims that “wealth per em will fall greatly”. It would be possible to construct a measure by which ems are less wealthy than humans are today. But I expect it will be at least as plausible to use a measure under which ems are rich compared to humans of today, but have high living expenses. I don’t believe there’s any objective unit of value that will falsify one of those perspectives [1].

Style / Organization

The style is more like a reference book than a story or an attempt to persuade us of one big conclusion. Most chapters (except for a few at the start and end) can be read in any order. If the section on physics causes you to doubt whether the book matters, skip to chapter 12 (labor), and return to the physics section later.

The style is very concise. Hanson rarely repeats a point, so understanding him requires more careful attention than with most authors.

It’s odd that the future of democracy gets less than twice as much space as the future of swearing. I’d have preferred that Hanson cut out a few of his less important predictions, to make room for occasional restatements of important ideas.

Many little-known results that are mentioned in the book are relevant to the present, such as: how the pitch of our voice affects how people perceive us, how vacations affect productivity, and how bacteria can affect fluid viscosity.

I was often tempted to say that Hanson sounds overconfident, but he is clearly better than most authors at admitting appropriate degrees of uncertainty. If he devoted much more space to caveats, I’d probably get annoyed at the repetition. So it’s hard to say whether he could have done any better.

Conclusion

Even if we should expect a much less than 50% chance of Hanson’s scenario becoming real, it seems quite valuable to think about how comfortable we should be with it and how we could improve on it.

Footnote

[1] – The difference matters only in one paragraph, where Hanson discusses whether ems deserve charity more than do humans living today. Hanson sounds like he’s claiming ems deserve our charity because they’re poor. Most ems in this scenario are comfortable enough for this to seem wrong.

Hanson might also be hinting that our charity would be effective at increasing the number of happy ems, and that basic utilitarianism says that’s preferable to what we can do by donating to today’s poor. That argument deserves more respect and more detailed analysis.

Synthetic Worlds

Posted by Peter on October 25, 2006
Posted in: Book Reviews, Virtual Worlds. Tagged: , .

Book review: Synthetic Worlds: The Business and Culture of Online Games by Edward Castronova
Castranova is one of the first intellectuals to notice the importance of new societies that are being created in cyberspace. Much of this book is devoted to (sometimes redundant) explanations of why they are more than just games.
Around the middle of the book, he switches from describing a typical world for the benefit of those who doubt the importance of virtual worlds to describing how to design good worlds. This is where I started to find the book interesting and the questions thought-provoking, but the answers often unconvincing.
His most important discussion is about the near-anarchy that prevails in most virtual societies. He attributes this partly to the “Customer Service State” of for-profit world builders who are too cheap to pay for as much government as he assumes citizens want. But he seems to believe this is too inevitable to be worth much analysis. His more interesting question is why don’t the world’s citizens organize a government of their own? His answer is that citizens don’t have enough power over each other to enforce laws they might create. But he doesn’t convince me this is true (are boycotts useless? is repeatedly killing an outlaw not punishment?), nor does he explain why the designer face little pressure to change the design of the world to make it easier to enforce laws (what would happen if the world were designed to enable one person to effectively banish a person she doesn’t like from her view of the world?). I suspect part of the answer is that there’s less demand for government than he expects. I see some hints that his desire for government in cyberspace is a simple reflection of his desire for government in the real world. Yet I’d expect the analysis of whether government is desirable to be nontrivially affected by such differences as whether poverty and death cause much harm.
He claims “A fun economy should have property, theft, and jail too”, but only gives a few cryptic hints about what theft and jail add to an economy.
He claims “there should be no goods which never depreciate”, and partly justifies that by pointing to some benefits of a continuing need to produce new goods, but leaves me wondering why the rule should be universal or even close to universal.
He hints at the desirability of creating p2p virtual societies so that control over them can be decentralized instead of being determined by a corporate owner, but I’m disappointed that he fails to analyze whether this is practical.
One insight I liked was this description of how to deal with the desire for everyone to have high status: “How do you make a world in which everyone is in the top 10 percent? The answer: AI.”
He has a disturbing idea about the military uses of virtual worlds – an aggressor need not be hampered by unfamiliarity with the land he’s invading if he has unlimited ability to practice the invasion in simulation.
He has some ideas about how virtual worlds might help deal with threats such as grey goo, but doesn’t develop them as well as I would like. His ideas on using virtual worlds to make AIs more friendly appear to anthropomorphise AI in a rather naive and dangerous manner.

Accelerating Change Conference

Posted by Peter on September 26, 2005
Posted in: Artificial Intelligence, Health, Science and Technology, Virtual Worlds. Tagged: , , .

I was somewhat disappointed by the latest Accelerating Change Conference, which might have been great for people who have never been to that kind of conference before, but didn’t manage enough novelty to be terribly valuable to those who attended the first one. Here are a few disorganized tidbits I got from it.
Bruno Olshausen described our understanding of the neuron as pre-newtonian, and said a neuron might be as complex as a pentium.
Joichi Ito convinced me that Wikipedia has a wider range of uses than my stereotype of it as a dictionary/encyclopedia suggested. For example, its entry on Katrina seems to be a better summary of the news than what I can get via the traditional news media.
Cory Ondrejka pointed out the negative correlation between the availability of violent video games and some broad measure of U.S. crime. He hinted this might say something about causation, but reminded people of the appropriate skepticism by noting the correlation between the decline in pirates and global warming.
Someone reported that Second Life is growing at an impressive pace. I’ve tried it a little over a somewhat flaky wireless connection and wasn’t too excited; I’ll try to get my iBook connected to my dsl line and see if a more reliable connection makes it nicer.
Tom Malone talked about how declining communications costs first enabled the creation of large companies with centralized hierarchies and are now decentralizing companies. His view of Ebay was interesting – he pointed out that it could be considered a retailer with one of the largest number of employees, except that it has outsourced most of its employees (i.e. the people who make a living selling through Ebay). He also mentioned that Intel has some internal markets for resources such as manufacturing capacity.
Daniel Amen criticized modern psychiatry for failing to look at the brain for signs of physical damage. He provided strong anecdotal evidence that the brain imaging services he sell can sometimes tell people how to fix mental problems that standard psychiatry can’t diagnose, but left plenty of doubt as to whether his successes are frequent enough to justify his fees.
T. Colin Campbell described some evidence that eating animal protein is unhealthy. He didn’t convince me that he was a very reliable source of information, but his evidence against casein (a milk protein) sounded fairly strong.
One odd comment from Robin Raskin (amidst an annoying amount of thoughtless sensationalism) was that kids don’t use email anymore. They send about two emails per day [i.e. they’ve switch to IM]. The idea that sending two emails per day amounts to abandoning email makes me wonder to what extent I’m out of touch with modern communication habits.
An amusing joke, attributed to Eric Drexler:
Q: Why did Douglas Hofstadter cross the road?
A: To make this joke possible.

Accelerating Change Conference

Posted by Peter on November 11, 2004
Posted in: Freedom, Investing, Virtual Worlds. Tagged: , .

The 2004 Accelerating Change Conference focused much more on current changes than last year’s attempts at providing long-term visions led me to expect.

The one topic that excited me was a virtual world called Second Life. While it might sound superficially like just a virtual Burning Man, the designers are serious enough about their nationbuilding to encourage commerce, both within the system and via currency exchanges such as The Gaming Open Market with other worlds. Their VP of Product Development Cory Ondrejka described Hernando de Soto’s book The Mystery of Capital as "must reading". They have been careful to insure that people have few incentives to take disputes arising in the virtual world to meatspace courts. For instance, they once banned a vandal from the game who owned a fair amount of land; they auctioned off the land and sent him a check for most of the proceeds – $1600.

Some of their customers are doing well enough in the virtual world that the company that runs Second Life has trouble offering them a salary good enough to compete with what they’re making in virtual life.

They don’t seem as concerned about the highly deflationary effects of their monetary policy as I expect they ought to be. Why will people buy their land (the sale of which seems to be their main source of income) if they can earn a safe and sure return by just holding the local currency?

The responsiveness of the company to citizen complaints (e.g. simplifying and later abolishing taxes in response to tax revolts) is fairly strong evidence that a non-monopolistic dictator is better than a democracy with monopoly power.