Informational Chaff and Metaphors

chaffI received word last night that our scholarship has received over 1400 applications, which definitely surprised me. I had worried that the regional restriction might be too limiting but Agricultural Sciences were added in as part of STEM so that probably magnified the pool.

Dan Dennett of Tufts and Deb Roy at MIT draw parallels between informational transparency in our modern world and biological mechanism in Scientific American (March 2015, 312:3). Their article, Our Transparent Future (related video here; you have to subscribe to read the full article), starts with Andrew Parker’s theory that the Cambrian Explosion may have been tied to the availability of light as cloud cover lifted and seas became transparent. An evolutionary arms race began for the development of sensors that could warn against predators, and predators that could acquire more prey.

They continue on drawing parallels to biological processes, including the concept of squid ink and how a similar notion, chaff, was used to mask radar signatures as aircraft became weapons of war. The explanatory mouthful of the Multiple Independent Reentry Vehicle (MIRV) with dummy warheads to counter anti-ballistic missiles were likewise a deceptive way of reducing the risk of interception. So Dennett and Roy “predict the introduction of chaff made of nothing but megabytes of misinformation,” designed to deceive search engines of the nature of real info.

This is a curious idea. Search engine optimization (SEO) is a whole industry that combines consulting with tricks and tools to try to raise the position of vendors in the Google rankings. Being in the first page of listings can be make-or-break for retail vendors, and they pay to try to make that happen. The strategies are based around trying to establish links to the vendor from individuals and other pages to try to game the PageRank algorithm.… Read the rest

Evolutionary Optimization and Environmental Coupling

Red QueensCarl Schulman and Nick Bostrom argue about anthropic principles in “How Hard is Artificial Intelligence? Evolutionary Arguments and Selection Effects” (Journal of Consciousness Studies, 2012, 19:7-8), focusing on specific models for how the assumption of human-level intelligence should be easy to automate are built upon a foundation of assumptions of what easy means because of observational bias (we assume we are intelligent, so the observation of intelligence seems likely).

Yet the analysis of this presumption is blocked by a prior consideration: given that we are intelligent, we should be able to achieve artificial, simulated intelligence. If this is not, in fact, true, then the utility of determining whether the assumption of our own intelligence being highly probable is warranted becomes irrelevant because we may not be able to demonstrate that artificial intelligence is achievable anyway. About this, the authors are dismissive concerning any requirement for simulating the environment that is a prerequisite for organismal and species optimization against that environment:

In the limiting case, if complete microphysical accuracy were insisted upon, the computational requirements would balloon to utterly infeasible proportions. However, such extreme pessimism seems unlikely to be well founded; it seems unlikely that the best environment for evolving intelligence is one that mimics nature as closely as possible. It is, on the contrary, plausible that it would be more efficient to use an artificial selection environment, one quite unlike that of our ancestors, an environment specifically designed to promote adaptations that increase the type of intelligence we are seeking to evolve (say, abstract reasoning and general problem-solving skills as opposed to maximally fast instinctual reactions or a highly optimized visual system).

Why is this “unlikely”? The argument is that there are classes of mental function that can be compartmentalized away from the broader, known evolutionary provocateurs.… Read the rest

The Rise and Triumph of the Bayesian Toolshed

Bayes LawIn Asimov’s Foundation, psychohistory is the mathematical treatment of history, sociology, and psychology to predict the future of human populations. Asimov was inspired by Gibbon’s Decline and Fall of the Roman Empire that postulated that Roman society was weakened by Christianity’s focus on the afterlife and lacked the pagan attachment to Rome as an ideal that needed defending. Psychohistory detects seeds of ideas and social movements that are predictive of the end of the galactic empire, creating foundations to preserve human knowledge against a coming Dark Age.

Applying statistics and mathematical analysis to human choices is a core feature of economics, but Richard Carrier’s massive tome, On the Historicity of Jesus: Why We Might Have Reason for Doubt, may be one of the first comprehensive applications to historical analysis (following his other related work). Amusingly, Carrier’s thesis dovetails with Gibbon’s own suggestion, though there is a certain irony to a civilization dying because of a fictional being.

Carrier’s methods use Bayesian analysis to approach a complex historical problem that has a remarkably impoverished collection of source material. First century A.D. (C.E. if you like; I agree with Carrier that any baggage about the convention is irrelevant) sources are simply non-existent or sufficiently contradictory that the background knowledge of paradoxography (tall tales), rampant messianism, and general political happenings at the time lead to a likelihood that Jesus was made up. Carrier constructs the argument around equivalence classes of prior events that then reduce or strengthen the evidential materials (a posteriori). And he does this without ablating the richness of the background information. Indeed, his presentation and analysis of works like Inanna’s Descent into the Underworld and its relationship to the Ascension of Isaiah are both didactic and beautiful in capturing the way ancient minds seem to have worked.… Read the rest

Active Deep Learning

BrainDeep Learning methods that use auto-associative neural networks to pre-train (with bottlenecking methods to ensure generalization) have recently been shown to perform as well and even better than human beings at certain tasks like image categorization. But what is missing from the proposed methods? There seem to be a range of challenges that revolve around temporal novelty and sequential activation/classification problems like those that occur in natural language understanding. The most recent achievements are more oriented around relatively static data presentations.

Jürgen Schmidhuber revisits the history of connectionist research (dating to the 1800s!) in his October 2014 technical report, Deep Learning in Neural Networks: An Overview. This is one comprehensive effort at documenting the history of this reinvigorated area of AI research. What is old is new again, enhanced by achievements in computing that allow for larger and larger scale simulation.

The conclusions section has an interesting suggestion: what is missing so far is the sensorimotor activity loop that allows for the active interrogation of the data source. Human vision roams over images while DL systems ingest the entire scene. And the real neural systems have energy constraints that lead to suppression of neural function away from the active neural clusters.

Read the rest

The Great Crustacean

little-lobster-costumeDavid Foster Wallace’s Joseph Frank’s Dostoevsky in Consider the Lobster is worth reading for nothing else than the following two paragraphs:

The big thing that makes Dostoevsky invaluable for American readers and writers is that he appears to possess degrees of passion, conviction, and engagement with deep moral issues that we—here, today—cannot or do not permit ourselves. Joseph Frank does an admirable job of tracing out the interplay of factors that made this engagement possible—[Dostoevsky]’s own beliefs and talents, the ideological and aesthetic climates of his day, etc. Upon his finishing Frank’s books, though, I think that any serious American reader/writer will find himself driven to think hard about what exactly it is that makes many of the novelists of our own place and time look so thematically shallow and lightweight, so morally impoverished, in comparison to Gogol or Dostoevsky (or even to lesser lights like Lermontov and Turgenev). Frank’s bio prompts us to ask ourselves why we seem to require of our art an ironic distance from deep convictions or desperate questions, so that contemporary writers have to either make jokes of them or else try to work them in under cover of some formal trick like intertextual quotation or incongruous juxtaposition, sticking the really urgent stuff inside asterisks as part of some multivalent defamiliarization-flourish or some such shit.

Part of the explanation for our own lit’s thematic poverty obviously includes our century and situation. The good old modernists, among their other accomplishments, elevated aesthetics to the level of ethics—maybe even metaphysics—and Serious Novels after Joyce tend to be valued and studied mainly for their formal ingenuity. Such is the modernist legacy that we now presume as a matter of course that “serious” literature will be aesthetically distanced from real lived life.

Read the rest

On Killing Kids

Mark S. Smith’s The Early History of God is a remarkable piece of scholarship. I was recently asked what I read for fun and had to admit that I have been on a trajectory towards reading books that have, on average, more footnotes than text. J.P. Mallory’s In Search of the Indo-Europeans kindly moves the notes to the end of the volume. Smith’s Chapter 5, Yahwistic Cult Practices, and particularly Section 3, The mlk sacrifice, are illuminating on the widespread belief that killing children could propitiate the gods. This practice was likely widespread among the Western Semitic peoples, including the Israelites and Canaanites (Smith’s preference for Western Semitic is to lump the two together ca. 1200 BC because they appear to have been culturally the same, possibly made distinct after the compilation of OT following the Exile).

I recently argued with some young street preachers about violence and horror in Yahweh’s name and by His command while waiting outside a rock shop in Old Sacramento. Human sacrifice came up, too, with the apologetics being that, despite the fact that everyone was bad back then, the Chosen People did not perform human sacrifice and therefore they were marginally better than the other people around them. They passed quickly on the topic of slavery, which was wise for rhetorical purposes, because slavery was widespread and acceptable. I didn’t remember the particulars of the examples of human sacrifice in OT, but recalled them broadly to which they responded that there were translation and interpretation errors with “burnt offering” and “fire offerings of first borns” that, of course, immediately contradicted their assertion of acceptance and perfection of the scriptures.

More interesting, though, is the question of why might human sacrifice be so pervasive, whether among Yahwists and Carthiginians or Aztecs?… Read the rest

Alien Singularities and Great Filters

Life on MarsNick Bostrom at Oxford’s Future of Humanity Institute takes on Fermi’s question “Where are they?” in a new paper on the possibility of life on other planets. The paper posits probability filters (Great Filters) that may have existed in the past or might be still to come and that limit the likelihood of the outcome that we currently observe: our own, ahem, intelligent life. If a Great Filter existed in our past—say the event of abiogenesis or prokaryote to eukaryote transition—then we can somewhat explain the lack of alien contact thus far: our existence is of very low probability. Moreover, we can expect to not find life on Mars.

If, however, the Great Filter exists in our future then we might see life all over the place (including the theme of his paper, Mars). Primitive life is abundant but the Great Filter is somewhere in our future where we annihilate ourselves, thus explaining why Fermi’s They are not here while little strange things thrive on Mars, and beyond. It is only advanced life that got squeezed out by the Filter.

Bostrom’s Simulation Hypothesis provides a potential way out of this largely pessimistic perspective. If there is a very high probability that civilizations achieve sufficient simulation capabilities that they can create artificial universes prior to conquering the vast interstellar voids needed to move around and signal with adequate intensity, it is equally possible that their “exit strategy” is a benign incorporation into artificial realities that prevents corporeal destruction by other means. It seems unlikely that every advanced civilization would “give up” physical being under these circumstances (in Teleology there are hold-outs from the singularity though they eventually die out), which would mean that there might remain a sparse subset of active alien contact possibilities.… Read the rest

Language Games

Word GamesOn The Thinking Atheist, C.J. Werleman promotes the idea that atheists can’t be Republicans based on his new book. Why? Well, for C.J. it’s because the current Republican platform is not grounded in any kind of factual reality. Supply-side economics, Libertarianism, economic stimuli vs. inflation, Iraqi WMDs, Laffer curves, climate change denial—all are grease for the wheels of a fantastical alternative reality where macho small businessmen lift all boats with their steely gaze, the earth is forever resilient to our plunder, and simple truths trump obscurantist science. Watch out for the reality-based community!

Is politics essentially religion in that it depends on ideology not grounded in reality, spearheaded by ideologues who serve as priests for building policy frameworks?

Likely. But we don’t really seem to base our daily interactions on rationality either. 538 Science tells us that it has taken decades to arrive at the conclusion that vitamin supplements are probably of little use to those of us lucky enough to live in the developed world. Before that we latched onto indirect signaling about vitamin C, E, D, B12, and others to decide how to proceed. The thinking typically took on familiar patterns: someone heard or read that vitamin X is good for us/I’m skeptical/why not?/maybe there are negative side-effects/it’s expensive anyway/forget it. The language games are at all levels in promoting, doubting, processing, and reinforcing the microclaims for each option. We embrace signals about differences and nuances but it often takes many months and collections of those signals in order to make up our minds. And then we change them again.

Among the well educated, I’ve variously heard the wildest claims about the effectiveness of chiropractors, pseudoscientific remedies, the role of immunizations in autism (not due to preservatives in this instance; due to immune responses themselves), and how karma works in software development practice.… Read the rest

Spurting into the Undiscovered Country

voyager_plaqueThere was glop on the windows of the International Space Station. Outside. It was algae. How? Now that is unclear, but there is a recent tradition of arguing against abiogenesis here on Earth and arguing for ideas like panspermia where biological material keeps raining down on the planet, carried by comets and meteorites, trapped in crystal matrices. And there may be evidence that some of that may have happened, if only in the local system, between Mars and Earth.

Panspermia includes as a subset the idea of Directed Panspermia whereby some alien intelligence for some reason sends biological material out to deliberately seed worlds with living things. Why? Well, maybe it is a biological prerogative or an ethical stance. Maybe they feel compelled to do so because they are in some dystopian sci-fi narrative where their star is dying. One last gasping hope for alien kind!

Directed Panspermia as an explanation for life on Earth only sets back the problem of abiogenesis to other ancient suns and other times, and implicitly posits that some of the great known achievements of life on Earth like multicellular forms are less spectacularly improbable than the initial events of proto-life as we hypothesize it might have been. Still, great minds have spent great mental energy on the topic to the point that elaborate schemes involving solar sails have been proposed so that we may someday engage in Directed Panspermia as needed. I give you:

Mautner, M; Matloff, G. (1979). “Directed panspermia: A technical evaluation of seeding nearby solar systems”. J. British Interplanetary Soc. 32: 419.

So we take solar sails and bioengineered lifeforms in tiny capsules. The solar sails are large and thin. They carry the tiny capsules into stellar formations and slow down due to friction.… Read the rest

Marshlands

MarshlandsIt is purely by chance that I discovered a remarkable note, penciled in a deliberate cursive, on page one hundred something of a secondhand copy of Borges’ Labyrinths. The Huns were clashing about and trampling books, but one survived—that sort of chance or magical thing—and an arrow crawled up from the text and declared “all great civilizations are built on marshes,” seemingly in praise for the despoiled monastery and its now collapsed civilization, or perhaps referring to the banks of the Danube or the arc of historiography that passed from Athens to Rome later in the page.

Regardless of the minutiae of the referents, the statement remained in my head for days as I shuffled about through my ordinary occupation and preoccupations with information theory, intelligent machines, and some spectral analysis of the statistical distribution of gut bacteria/eukaryotes. Google was fragmentary in its responses to the phrase as a query and I quit before the end of the first page, anyway, distracted by other thoughts about why marshes would be so attractive for building a civilization. The fishing should be good, admittedly, as well as the availability of reeds for various structures, but the shifting nature of land and the threat of mosquito infestation struck me as negatives. And wouldn’t clean, fresh water be better served by a mountain stream? All great cultures should be at the base of a non-volcanic snowpacked mountain.

I returned to Borges later in the week and found myself fanning through the pages like a schoolboy watching a stickfigure animation until, seventy-five pages further, below the tail of an essay on Cervantes and the inversion of authors and characters and readers, there was another brief flash off a curlicue of lead embedded in the page.… Read the rest