Bostrom on the Hardness of Evolving Intelligence

At 38,000 feet somewhere above Missouri, returning from a one day trip to Washington D.C., it is easy to take Nick Bostrom’s point that bird flight is not the end-all of what is possible for airborne objects and mechanical contrivances like airplanes in his paper, How Hard is Artificial Intelligence? Evolutionary Arguments and Selection Effects. His efforts to try to bound and distinguish the evolution of intelligence as either Hard or Not-Hard runs up against significant barriers, however. As a practitioner of the art, finding similarities between a purely physical phenomena like flying and something as complex as human intelligence falls flat for me.

But Bostrom is not taking flying as more than a starting point for arguing that there is an engineer-able possibility for intelligence. And that possibility might be bounded by a number of current and foreseeable limitations, not least of which is that computer simulations of evolution require a certain amount of computing power and representational detail in order to be a sufficient simulation. His conclusion is that we may need as much as another 100 years of improvements in computing technology just to get to a point where we might succeed at a massive-scale evolutionary simulation (I’ll leave to the reader to investigate his additional arguments concerning convergent evolution and observer selection effects).

Bostrom dismisses as pessimistic the assumption that a sufficient simulation would, in fact, require a highly detailed emulation of some significant portion of the real environment and the history of organism-environment interactions:

A skeptic might insist that an abstract environment would be inadequate for the evolution of general intelligence, believing instead that the virtual environment would need to closely resemble the actual biological environment in which our ancestors evolved … However, such extreme pessimism seems unlikely to be well founded; it seems unlikely that the best environment for evolving intelligence is one that mimics nature as closely as possible.

Read the rest

Randomness and Meaning

The impossibility of the Chinese Room has implications across the board for understanding what meaning means. Mark Walker’s paper “On the Intertranslatability of all Natural Languages” describes how the translation of words and phrases may be achieved:

  1. Through a simple correspondence scheme (word for word)
  2. Through “syntactic” expansion of the languages to accommodate concepts that have no obvious equivalence (“optometrist” => “doctor for eye problems”, etc.)
  3. Through incorporation of foreign words and phrases as “loan words”
  4. Through “semantic” expansion where the foreign word is defined through its coherence within a larger knowledge network.

An example for (4) is the word “lepton” where many languages do not have a corresponding concept and, in fact, the concept is dependent on a bulwark of advanced concepts from particle physics. There may be no way to create a superposition of the meanings of other words using (2) to adequately handle “lepton.”

These problems present again for trying to understand how children acquire meaning in learning a language. As Walker points out, language learning for a second language must involve the same kinds of steps as learning translations, so any simple correspondence theory has to be supplemented.

So how do we make adequate judgments about meanings and so rapidly learn words, often initially with a course granularity but later with increasingly sharp levels of focus? What procedure is required for expanding correspondence theories to operate in larger networks? Methods like Latent Semantic Analysis and Random Indexing show how this can be achieved in ways that are illuminating about human cognition. In each case, the methods provide insights into how relatively simple transformations of terms and their occurrence contexts can be viewed as providing a form of “triangulation” about the meaning of words.… Read the rest

The Comets of Literary Cohesion

Every few years, with the hyperbolic regularity of Kahoutek’s orbit, I return to B.R. Myers’ 2001 Atlantic essay, A Reader’s Manifesto, where he plays the enfant terrible against the titans of serious literature. With savagery Myers tears out the elliptical heart of Annie Proulx and then beats regular holes in Cormac McCarthy and Don DeLillo in a conscious mockery of the strained repetitiveness of their sentences.

I return to Myers because I currently have four novels in process. I return because I hope to be saved from the delirium of the postmodern novel that wants to be written merely because there is nothing really left to write about, at least not without a self-conscious wink:

But today’s Serious Writers fail even on their own postmodern terms. They urge us to move beyond our old-fashioned preoccupation with content and plot, to focus on form instead—and then they subject us to the least-expressive form, the least-expressive sentences, in the history of the American novel. Time wasted on these books is time that could be spent reading something fun.

Myers’ essay hints at what he sees as good writing, quoting Nabakov, referencing T.S. Eliot, and analyzing the controlled lyricism of Saul Bellow. Evaporating the boundaries between the various “brows” and accepting that action, plot, and invention are acceptable literary conceits also marks Myers’ approach to literary analysis.

It is largely an atheoretic analysis but there is a hint at something more beneath the surface when Myers describes the disdain of European peasants for the transition away from the inscrutable Latin masses and benedictions and into the language of the common man: “Our parson…is a plain honest man… But…he is no Latiner.” Myers counts the fascination with arabesque prose, with labeling it as great even when it lacks content, as derived from the same fascination that gripped the peasants: majesty is inherent in obscurity.… Read the rest

The Sooner We Are All Mongrels, the Better

E.O. Wilson charges across the is-ought barrier with a zeal undiminished by his advancing years and promotes genetic diversity as a moral good in The Social Conquest of Earth:

Perhaps it is time…to adopt a new ethic of racial and hereditary variation, one that places value on the whole of diversity rather than on the differences composing the diversity. It would give proper measure to our species’ genetic variation as an asset, prized for the adaptability it provides all of us during an increasingly uncertain future. Humanity is strengthened by a broad portfolio of genes that can generate new talents, additional resistance to diseases, and perhaps even new ways of seeing reality. For scientific as well as moral reasons, we should learn to promote human biological diversity for its own sake instead of using it to justify prejudice and conflict.

This follows an analysis of the relative genetic differences between various racial groups of humans, concluding that subsaharan Africa contains the highest genetic diversity among human groups. Yet almost everything in our social and biological history suggests that we have formed social structures specifically to prevent out-breeding and limit the expansion of our genetic pool. This has always been a thorny subject for selfish genetics: why risk pairing your alleles with unknowns guessed at through proximal sexual clues like body symmetry or the quality of giant peacock tails? The risk of outbreeding is apparently lower than the risk of diverse infectious agents according to a common current theory, but we also see culture as overriding even the strongest outbreeding motivation by imposing mating rules based on familial and tribal power struggles. At the worst, we even see inbreeding depression in populations that consolidate power through close marriages (look at the sex-linked defect lineages in European royal families) or through long religious prohibitions on marrying outside of relatively small populations of the faithful.… Read the rest

John Gray on Jonathan Haidt

Excellent discussion (and review) of Jonathan Haidt’s The Righteous Mind: Why Good People are Divided by Politics and Religion by John Gray in The New Republic. Gray is skeptical of intellectual history but even more skeptical of scientism, or the attempt to apply scientific reasoning to the complexities of human politics. Summing up concerning evolutionary psychology:

Haidt’s attempt to apply evolutionary psychology is yet one more example of the failures of scientism. There is no line of evolutionary development that connects our hominid ancestors with the emergence of the Tea Party. Human beings are not amoebae that have somehow managed to turn themselves into clever primates. They are animals with a history, part of which consists of creating cultures that are widely divergent. Using evolutionary psychology to explain current political conflicts represents local and ephemeral differences as perennial divisions in the human mind. It is hard to think of a more stultifying exercise in intellectual parochialism.

E.O. Wilson, Sam Harris, and David Sloan Wilson undoubtedly also included. The trouble arises in trying to connect the dots in too simple a contour. Haidt’s observations about flavors of moral feelings among liberals and conservatives is interesting and perhaps useful. But, as Gray suggests, it is where this naturalism ignores the cascading complexities of history that trouble arises. And when it tries to crawl onto the shores of policy and normative ethics, Gray takes even greater exception; the is-ought barrier is unassailable.

There are some assumptions by Gray that could use some critiquing. He quotes Haidt’s favorable perspective on utilitarianism and contrasts it with Berlin’s values pluralism. Gray is skeptical that culture war topics like abortion or gay rights can be cast into a utilitarian form and are better entertained through a recognition that a divergent moral landscape is the inevitable product of the complexities that culture hath wrought.… Read the rest

Eusociality, Errors, and Behavioral Plasticity

I encountered an error in E.O. Wilson’s The Social Conquest of Earth where the authors intended to assert an alternative to “kin selection” but instead repeated “multilevel selection,” which is precisely what the authors wanted to draw a distinction with. I am sympathetic, however, if for no other reason than I keep finding errors and issues with my own books and papers.

The critical technical discussion from Nature concerning the topic is available here. As technical discussion, the issues debated are fraught with details like how halictid bees appear to live socially, but are in fact solitary animals that co-exist in tunnel arrangements.

Despite the focus on “spring-loaded traits” as determiners for haplodiploid animals like bees and wasps, the problem of big-brained behavioral plasticity keeps coming up in Wilson’s book. Humanity is a pinnacle because of taming fire, because of the relative levels of energy available in animal flesh versus plant matter, and because of our ability to outrun prey over long distances (yes, our identity emerges from marathon running). But these are solutions that correlate with the rapid growth of our craniums.

So if behavioral plasticity is so very central to who we are, we are faced with an awfully complex problem in trying to simulate that behavior. We can expect that there must be phalanxes of genes involved in setting our developmental path (our nature and the substrate for our nurture). We should, indeed, expect that almost no cognitive capacity is governed by a small set of genes, and that all the relevant genes work in networks through polygeny, epistasis, and related effects (pleiotropy). And we can expect no easy answers as a result, except to assert that AI is exactly as hard as we should have expected, and progress will be inevitably slow in understanding the mind, the brain, and the way we interact.… Read the rest

Mental Religious Math

The Los Angeles Times reports on an article from Science that shows that analytical thinking and religious belief may be inversely proportional. That may not be news to some, but at least one of the example problems (that the religious failed to complete at higher rates than the non-religious) is quite interesting:

A bat and a ball cost $1.10 in total. The bat costs $1.00 more than the ball. How much does the ball cost?

Here there is an initial intuitive leap that says that $1 more than 10 cents is precisely $1.10. Therefore, the ball costs $0.10 or 10 cents. It is easy and clear, but the math undermines that result:

Bat + Ball = $1.10

Bat = Ball + $1.00

(Ball + $1.00) + Ball = $1.10

2*Ball + $1.00 = $1.10

2*Ball = $0.10

Ball = $0.05

Bat = $1.05

This result makes sense if one considers that the cost of the bat must be greater than $1.00 because it is $1.00 more than the ball (and not $1.00 itself). But it is obscured by the initial intuitive leap based on simple subtraction.

But that example is a pretty hard one to reconcile concerning historical and faith-based judgments. I doubt that there is good reason to suspect that mathematical prowess and intuitive dispositions about the costs of things correlates with faith decisions because I suspect that there are other reasons that the faithful believe what they believe. Specifically, most religious faithful believe because they were told to believe by their parents or community. The fact that they do so doesn’t seem to translate into mathematical prowess or ineptness. They may very well score more poorly on these kinds of results because of other individual differences like that those who are more predisposed to critical analytical skills are less likely to have come from highly religious backgrounds, and vice versa.… Read the rest

Brain Size and Fitness

An interesting data point taken from E.O. Wilson’s The Social Conquest of Earth: bigger brains mean better adaptation to new environments. That seems trivial in a way because it is part of the “folk” evolutionary theory that seems to flow naturally from the assumption of human uniqueness and our ostensive position at the apex of the evolutionary mountain.

But it doesn’t have to be that way. A very narrowly adapted organism could conceivably outcompete an intelligent generalist. The generalist requires massive physiological commitments to the energetic requirements of behavioral plasticity. The specialist is economical, efficient. So it has largely been an article of projective faith in folk theory that the human condition is explainable.

So it is always refreshing when I learn that there is empirical evidence that brings clarity to issues like this:

Big brains are hypothesized to enhance survival of animals by facilitating flexible cognitive responses that buffer individuals against environmental stresses. Although this theory receives partial support from the finding that brain size limits the capacity of animals to behaviourally respond to environmental challenges, the hypothesis that large brains are associated with reduced mortality has never been empirically tested. Using extensive information on avian adult mortality from natural populations, we show here that species with larger brains, relative to their body size, experience lower mortality than species with smaller brains, supporting the general importance of the cognitive buffer hypothesis in the evolution of large brains.

From Sol et. al., Big-brained birds survive better in nature. The emphasis in the title on “nature” suggests that perhaps they fail in captivity? Avian ennui?… Read the rest

Signals and Noise: Chapter 7 (Parsimony)

Monotony is the essential character of those late nights, so familiar to Zach and all his fellows. Monotony, but restful and calm, withholding the sharp edges and the intaglios of faces that define everyday interactions, while still remaining a part of the web of life. He could send an AetherNote or email and get a response, but without the complexities of the face had he been talking to the person. There were gigabytes of missed nuance, pursing lips, pauses, dilating pupils, flush responses—all lost behind the veil of electronica. Moreover, he could pause for that brief moment without any awkwardness, and they could pause as well, waiting for the ideas to filter out of the calamity of neural collisions. When everyone can order thoughts a hair faster than ever before in history, yet still interact deep into the night like they were sitting at a pub or around a campfire, there is an acceleration of competitiveness, a capacity for intellectual posturing. The new assholes, the new religionists, the new atheists, the new technologists, the strident politicos, the snarky personalities—everyone primps and props their online identities behind this veil of witty pretense, hearts racing as they snap at the refresh icon, waiting for the cannonball retort.

Democratizing it is, but with the side effect of drowning out the instant, unfiltered and emotive response on the one hand, and the dramatically conditioned and elaboratively intellectualized riposte on the other. There was too much lag for spontaneity and too little for detailed flourish. It is a channel that emphasizes bluster and bombast in securely short constructs. And thought followed suit. Thought on the average got better, but the best thought was drowned out by the long tails of opinions washing through them like the wake of a whale.… Read the rest