Bravery and Restraint

December 3, 2012December 4, 2012 Mark DavisLeave a comment

In 1997, shortly after getting married and buying our first house, I was invited to travel to Japan and spend a little over a month researching Japanese-Chinese machine translation under a grant from the Japanese Ministry of Education. It was a disorienting experience, like most non-Japanese find Japan, and the hours spent studying my translation guide helped me very little. In the mornings I would jog through downtown, around the canals, and past the temples. Days were spent writing and optimizing statistical matching algorithms for lining up runs of characters that I didn’t understand in an early incarnation of the same approach currently used in Google Translate.

I, of course, visited the Peace Memorial Park several times and toured the museum there, ultimately purchasing a slim volume of recollections from the day the bomb fell that was written in Japanese and English on facing pages. There was also one thing that struck me and I later inquired about to a Japan expert who worked in the Intelligence Community: the narrative presented in the museum was that the Japanese commoner had little understanding of the war effort; they were victims of the emperor and the elite classes. It was a moral distancing that resonated with similar arguments about the German volk being non-complicit in the Holocaust, and an argument that I found distasteful.

With this background, then, I was intrigued when I discovered that the father of my new boss wrote a memoir on being perhaps the first Westerner to enter Hiroshima following the dropping of the atomic bomb. Kenneth Harrison’s book, The Brave Japanese, was originally published in 1966, then republished in 1982 under The Road to Hiroshima due, in part, to the controversy in Australia over ascribing bravery to the Japanese.… Read the rest

Sparse Grokking

November 29, 2012November 29, 2012 Mark DavisLeave a comment

Jeff Hawkins of Palm fame shows up in the New York Times hawking his Grok for Big Data predictions. Interestingly, if one drills down into the details of Grok, we see once again that randomized sparse representations are the core of the system. That is, if we assign symbols random representational vectors that are sparse, we can sum the vectors for co-occurring symbols and, following J.R. Firth’s pithy “words shall be known by the company that they keep” start to develop a theory of meaning that would not offend Wittgenstein.

Is there anything new to Hawkins’ effort? For certain types of time-series prediction, the approach parallels artificial neural network designs, replacing the complexity of shifting, multi-epoch training regimens that, in effect, build the high-dimensional distances between co-occurring events by gradually moving time-correlated data together and uncorrelated data apart with an end-run around all the computational complexity. But then there is Random Indexing, which I’ve previously discussed, here. If one restricts Random Indexing to operating on temporal patterns, or on spatial patterns, then the results start to look like Numenta’s offering.

While there is a bit of opportunism in Hawkins latching onto Big Data to promote an application of methods he has been working on for years, there are very real opportunities for trying to mine leading indicators to help with everything from ecommerce to research and development. Many flowers will bloom, grok, die, and be reborn.… Read the rest

Bats and Belfries

November 21, 2012November 21, 2012 Mark DavisLeave a comment

Thomas Nagel proposes a radical form of skepticism in his new book, Minds and Cosmos, continuing his trajectory through subjective experience and moral realism first began with bats zigging and zagging among the homunculi of dualism reimagined in the form of qualia. The skepticism involves disputing materialistic explanations and proposing, instead, that teleological ones of an unspecified form will likely apply, for how else could his subtitle that paints the “Neo-Darwinian Concept of Nature” as likely false hold true?

Nagel is searching for a non-religious explanation, of course, because just enervating nature through fiat is hardly an explanation at all; any sort of powerful, non-human entelechy could be gaming us and the universe in a non-coherent fashion. But what parameters might support his argument? Since he apparently requires a “significant likelihood” argument to hold sway in support of the origins of life, for instance, we might imagine what kind of thinking could result in highly likely outcomes that begin with inanimate matter and lead to goal-directed behavior while supporting a significant likelihood of that outcome. The parameters might involve the conscious coordination of the events leading towards the emergence of goal-directed life, thus presupposing a consciousness that is not our own. We are back then to our non-human entelechy looming like an alien or like a strange creator deity (which is not desirable to Nagel). We might also consider the possibility that there are properties to the universe itself that result in self-organization and that either we don’t yet know or that we are only beginning to understand. Elliot Sober’s critique suggests that the 2nd Law of Thermodynamics results in what I might call “patterned” behavior while not becoming “goal-directed” per se.… Read the rest

Pressing Snobs into Hell

November 1, 2012November 1, 2012 Mark DavisLeave a comment

Paul Vitanyi has been a deep advocate for Kolmogorov complexity for many years. His book with Ming Li, An Introduction to Kolmogorov Complexity and Its Applications, remains on my book shelf (and was a bit of an investment in grad school).

I came across a rather interesting paper by Vitanyi with Rudi Cilibrasi called “Clustering by Compression” that illustrates perhaps more easily and clearly than almost any other recent work the tight connections between meaning, repetition, and informational structure. Rather than describing the paper, however, I wanted to conduct an experiment that demonstrates their results. To do this, I asked the question: are the writings of Dante more similar to other writings of Dante than to Thackeray? And is the same true of Thackeray relative to Dante?

Now, we could pursue these questions at many different levels. We might ask scholars, well-versed in the works of each, to compare and contrast the two authors. They might invoke cultural factors, the memes of their respective eras, and their writing styles. Ultimately, though, the scholars would have to get down to some textual analysis, looking at the words on the page. And in so doing, they would draw distinctions by lifting features of the text, comparing and contrasting grammatical choices, word choices, and other basic elements of the prose and poetry on the page. We might very well be able to take parts of the knowledge of those experts and distill it into some kind of a logical procedure or algorithm that would parse the texts and draw distinctions based on the distributions of words and other structural cues. If asked, we might say that a similar method might work for the so-called language of life, DNA, but that it would require a different kind of background knowledge to build the analysis, much less create an algorithm to perform the same task.… Read the rest

Intelligence versus Motivation

October 18, 2012 Mark DavisLeave a comment

Nick Bostrom adds to the dialog on desire, intelligence, and intentionality with his recent paper, The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents. The argument is largely a deconstruction of the general assumption that there is somehow an inexorable linkage between intelligence and moral goodness. Indeed, he even proposes that intelligence and motivation are essentially orthogonal (“The Orthogonality Thesis”) but that there may be a particular subset of possible trajectories towards any goal that are common (self-preservation, etc.) The latter is scoped by his “instrumental convergence thesis” where there might be convergences towards central tenets that look an awful lot like the vagaries of human moral sentiments. But they remain vagaries and should not be taken to mean that advanced artificial agents will act in a predictable manner.… Read the rest

Talking Musical Heads

September 28, 2012September 28, 2012 Mark DavisLeave a comment

David Byrne gets all scientifical in the most recent Smithsonian, digging into the developmental and evolved neuropsychiatry of musical enjoyment. Now, you may ask yourself, how did DB get so clinical about the emotions of music? And you may ask yourself, how did he get here? And you may ask yourself, how did this music get written?

…one can envision a day when all types of music might be machine-generated. The basic, commonly used patterns that occur in various genres could become the algorithms that guide the manufacture of sounds. One might view much of corporate pop and hip-hop as being machine-made—their formulas are well established, and one need only choose from a variety of available hooks and beats, and an endless recombinant stream of radio-friendly music emerges. Though this industrial approach is often frowned on, its machine-made nature could just as well be a compliment—it returns musical authorship to the ether. All these developments imply that we’ve come full circle: We’ve returned to the idea that our universe might be permeated with music.

It seems fairly obvious that the music I’m listening to right now (Arvo Part) could be automatized, but just hasn’t been so far. And this points to the future world Byrne points to, where we are permeated with music and the contrast with silence is the most sophisticated distinction that can be drawn.… Read the rest

Hirsi Ali’s Social Evolution

September 20, 2012 Mark DavisLeave a comment

Ayaan Hirsi Ali reminds us of the depressingly anti-freedom recent history of Islam in her recent Newsweek article, Muslim Rage & The Last Gasp of Islamic Hate. For Hirsi Ali, despite fatwas on Rushdie, 9/11, and the murder of her friend and collaborator, Theo von Gogh, a kernel of hope is nascent in the democracy movements that emerged from the Arab Spring: when people have to govern themselves they will, ultimately, turn towards freedom of expression, thought, and worship.

But is that hope warranted?

Is there any sense of inevitability to the liberal programme that emerged from industrialization, affluence, and education? Or is the “progress” of the West more contingent than that, built from happenstance due to the geographic separation of America from Germany and Japan in World War II combined with the widespread availability of raw materials on the American continent, leading to success in that war and the growth of American post-War power in an unbombed industrial landscape that, ironically, led in turn to the defeat of Soviet Communism, itself claiming an inevitability to the flow of history?

Azar Gat raised a parallel question in The Return of Authoritarian Great Powers (Foreign Affairs, 86 (4), pp. 59-69) when he asked whether the rise of “Authoritarian Capitalism” in the form of China and recent Russia constitutes a viable challenge to the claims of liberal democracy. If so, then the notion that there is any sense of inevitability evaporates like the suppositions of dialectical materialism.

The underlying assumptions are taken for granted among most Americans: (1) all people are the same; (2) all people want freedom; (3) authoritarianism is anti-freedom; (4) people will oppose authoritarianism. It’s a nice thought that has some resonance in, say, the history of the Eastern Block, where economic limitations combined with cronyism and foreign political control led to (4).… Read the rest

The Evolution of American Gods

September 18, 2012September 18, 2012 Mark DavisLeave a comment

Taking a break from my countdown, Simon Critchley is back in the New York Times with his fascinating analysis of Mormonism and the varied doctrines concerning reincarnation and the eventual divinity of, well, at least men. Interestingly, reading The Book of Mormon doesn’t illuminate these topics–they exist largely as exegesis through specific lectures by Joseph Smith. As Critchley notes about Smith’s lecture, the character and nature of God is finite, is a member of the Host of Heaven (or a council per the lecture), and creation in Genesis is not creation per se, but is instead some kind of reorganization of an infinite and timeless universe.

Fascinatingly strange, and compounded in its strangeness by the assertion that:

The mind or the intelligence which man possesses is co-equal [co-eternal] with God himself.

It is an evolutionary assertion that suggests our ultimate being is a divine form, and that we have the capacity to achieve this divinity through action, through works, and through effort at being good. As Critchley concludes:

…I see Joseph Smith’s apostasy as strong poetry, a gloriously presumptive and delusional creation from the same climate as Whitman, if not enjoying quite the same air quality. Perhaps Mormonism is not so far from romanticism after all. To claim that it is simply Christian is to fail to grasp its theological, poetic and political audacity. It is much more than mere Christianity.

While I doubt that this analysis will help assuage the concerns of conservative Christians about Mitt Romney’s faith, it undoubtedly serves as a touchstone for that uniquely American principle of religious freedom, and the underlying assumption (on Constitution Day), that the choice of a leader should not be tied to their choice of romantic delusions.… Read the rest

Socialistic Roidrage

September 11, 2012September 11, 2012 Mark DavisLeave a comment

Just when American politics appeared to be getting down to bare-fisted fighting we get a re-affirmation that political ideologies are largely religious from one of the papacy of modern conservatism, George Will, in his inane discovery of socialist tendencies in college football:

The collective activity of team sports came after a great collective exertion, the Civil War, and two great social changes, urbanization and industrialization.

…

Progressives saw football as training managers for the modern regulatory state. Ingrassia says that a Yale professor, the social Darwinist William Graham Sumner (who was Camp’s brother-in-law), produced one academic acolyte who thought the “English race” was establishing hegemony because it played the “sturdiest” sports.

Ummm, sure, collectivism is like sports activity and, hell, like war or industry, where people collectively work collectively together towards some outcome. It’s almost like government itself, as one astute reader noted concerning the US Constitution:

“We the People of the United States, in Order to form a more perfect Union, establish Justice, insure domestic Tranquility, provide for the common defense, promote the general Welfare.” Those damned leftists!

Now, we might claim that George Will, confused by ‘roidrage, is just scrambling for material in his strange communist witch hunt, but this has profound implications for reinterpreting American history. For instance, until the Italian Fascists resurrected the old Roman outstretched arm salute that was then picked up as “Heil Hitler” by the Nazis, the Pledge of Allegiance was saluted by school children throughout America in the same way:

And, let’s not forget that Francis Bellamy, the author of the Pledge, was a Christian Socialist advocating the redistribution of wealth for the greater good of the American Christian people.

Will is right about all this sports nonsense.… Read the rest

Evolutionary Art and Architecture

September 10, 2012 Mark DavisLeave a comment

With every great scientific advance there has been a coordinated series of changes in the Zeitgeist. Evolutionary theory has impacted everything from sociology through to literature, but there are some very sophisticated efforts in the arts that deserve more attention.

John Frazer’s Evolutionary Architecture is a great example. Now available as downloadable PDFs since it is out-of-print, Evolutionary Architecture asks the question, without fully answering it (how could it?), about how evolution-like processes can contribute to the design of structures: