Forever Uncanny

Quanta has a fair round up of recent advances in deep learning. Most interesting is the recent performance on natural language understanding tests that are close to or exceed mean human performance. Inevitably, John Searle’s Chinese Room argument is brought up, though the author of the Quanta article suggests that inferring the Chinese translational rule book from the data itself is slightly different from the original thought experiment. In the Chinese Room there is a person who knows no Chinese but has a collection of translational reference books. She receives texts through a slot and dutifully looks up the translation of the text and passes out the result. “Is this intelligence?” is the question and it serves as a challenge to the Strong AI hypothesis. With statistical machine translation methods (and their alternative mechanistic implementation, deep learning), the rule books have been inferred by looking at translated texts (“parallel” texts as we say in the field). By looking at a large enough corpus of parallel texts, greater coverage of translated variants is achieved as well as some inference of pragmatic issues in translation and corner cases.

As a practical matter, it should be noted that modern, professional translators often use translation memory systems that contain idiomatic—or just challenging—phrases that they can reference when translating new texts. The understanding resides in the original translator’s head, we suppose, and in the correct application of the rule to the new text by checking for applicability according to, well, some other criteria that the translator brings to bear on the task.

In the General Language Understand Evaluation (GLUE) tests described in the Quanta article, the systems are inferring how to answer Wh-style queries (who, what, where, when, and how) as well as identify similar texts.… Read the rest

Bullshit, Metaphors, and Political Precision

Given this natural condition of uncertainty in the meaning of words, and their critical role in communication, to say the least, we can certainly expect that as we move away from the sciences towards other areas of human endeavor we have even greater vagueness in trying to express complex ideas. Politics is an easy example. America’s current American president is a babbling bullshitter, to use the explanatory framework of the essay, On Bullshit, and he is easy to characterize as an idiot, like when he conflates Western liberalism with something going on exclusively in modern California.

In this particular case, we have to track down what “liberal” means and meant at various times, then try to suss out how that meaning is working today. At one time, the term was simply expressive of freedom with minimal government interference. Libertarians still carry a version of that meaning forward, but liberalism also came to mean something akin to a political focus on government spending to right perceived economic and social disparities (to achieve “freedom from want and despair,” via FDR). And then it began to be used as a pejorative related to that same focus.

As linguist John McWhorter points out, abstract ideas—and perhaps especially political ones—are so freighted with their pragmatic and historical background that the best we can say is that we are actively working out what a given term means. McWhorter suggests that older terms like “socialist” are impossible to put to work effectively; a newer term like “progressive” is more desirable because it carries less baggage.

An even stronger case is made by George Lakoff where he claims central metaphors that look something like Freudian abstractions govern political perspectives.… Read the rest

A Most Porous Barrier

Whenever there is a scientific—or even a quasi-scientific—theory invented, there are those who take an expansive view of the theory, broadly applying it to other areas of thought. This is perhaps inherent in the metaphorical nature of these kinds of thought patterns. Thus we see Darwinian theory influenced by Adam Smith’s “invisible hand” of economic optimization. Then we get Spencer’s Social Darwinism arising from Darwin. And E.O. Wilson’s sociobiology leads to evolutionary psychology, immediately following an activist’s  pitcher of ice water.

The is-ought barrier tends towards porousness, allowing the smuggling of insights and metaphors lifted from the natural world as explanatory footwork for our complex social and political interactions. After all, we are as natural as we are social. But at the same time, we know that science is best when it is tentative and subject to infernal levels of revision and reconsideration. Decisions about social policy derived from science, and especially those that have significant human impact, should be cushioned by a tentative level of trust as well.

E.O. Wilson’s most recent book, Genesis: The Deep Origin of Societies, is a continuation of his late conversion to what is now referred to as “multi-level selection,” where natural selection is believed to operate at multiple levels, from genes to whole societies. It remains a controversial theory that has been under development and under siege since Darwin’s time, when the mechanism of inheritance was not understood.

The book is brief and does not provide much, if any, new material since his Social Conquest of Earth, which was significantly denser and contained notes derived from his controversial 2010 Nature paper that called into question whether kin selection was overstated as a gene-level explanation of altruism and sacrifice within eusocial species.… Read the rest

Doubt at the Limit

I seem to have a central theme to many of the last posts that is related to the demarcation between science and non-science, and also to the limits of what rationality allows where we care about such limits. This is not purely abstract, though, as we can see in today’s anti-science movements, whether anti-vaccination, flat Earthers, climate change deniers, or intelligent design proponents. Just today, Ars Technica reports on the first of these. The speakers at the event, held in close proximity to a massive measles outbreak, ranged from a “disgraced former gastroenterologist” to an angry rabbi. Efforts to counter them, in the form of a letter from a county supervisor and another rabbi, may have had an impact on the broader community, but probably not the die-hards of the movement.

Meanwhile, Lee Mcyntire at Boston University suggests what we are missing in these engagements in a great piece in Newsweek. Mcyntire applies the same argument to flat Earthers that I have applied to climate change deniers: what we need to reinforce is the value and, importantly, the limits inherent in scientific reasoning. Insisting, for example, that climate change science is 100% squared away just fuels the micro-circuits in the so-called meta-cognitive strategies regions of the brains of climate change deniers. Instead, Mcyntire recommends science engages the public in thinking about the limits of science, showing how doubt and process lead us to useable conclusions about topics that are suddenly fashionably in dispute.

No one knows if this approach is superior to the alternatives like the letter-writing method by authorities in the vaccination seminar approach, and it certainly seems longer term in that it needs to build against entrenched ideas and opinions, but it at least argues for a new methodology.… Read the rest

Narcissism, Nonsense and Pseudo-Science

I recently began posting pictures of our home base in Sedona to Instagram (check it out in column to right). It’s been a strange trip. If you are not familiar with how Instagram works, it’s fairly simple: you post pictures and other Instagram members can “follow” you and you can follow them, meaning that you see their pictures and can tap a little heart icon to show you like their pictures. My goal, if I have one, is just that I like the Northern Arizona mountains and deserts and like thinking about the composition of photographs. I’m also interested in the gear and techniques involved in taking and processing pictures. I did, however, market my own books on the platform—briefly, and with apologies.

But Instagram, like Facebook, is a world unto itself.

Shortly after starting on the platform, I received follows from blond Russian beauties who appear to be marketing online sex services. I have received odd follows from variations on the same name who have no content on their pages and who disappear after a day or two if I don’t follow them back. Though I don’t have any definitive evidence, I suspect these might be bots. I have received follows from people who seemed to be marketing themselves as, well, people—including one who bait-and-switched with good landscape photography. They are typically attractive young people, often showing off their six-pack abs, and trying to build a following with the goal of making money off of Instagram. Maybe they plan to show off products or reference them, thus becoming “influencers” in the lingo of social media. Maybe they are trying to fund their travel experiences by reaping revenue from advertisers that co-exist with their popularity in their image feed.… Read the rest

Poetics and Humanism for the Solstice

There is, necessarily, an empty center to secular existence. Empty in the sense that there is no absolute answer to the complexities of human life, alone or as part of the great societies that we have created. This opens us to wild, adventurous circuits through pain, meaning, suffering, growth, and love. Religious writers in recent years have had a tendentious tendency to denigrate this fantastic adventure, as Andrew Sullivan does in New York magazine. The worst possible argument is that everything is religion insofar as we believe passionately about its value. It’s wrong if for no other reason than the position of John Gray that Sullivan quotes:

Religion is an attempt to find meaning in events, not a theory that tries to explain the universe.

Many religious people absolutely disagree with that characterization and demand an entire metaphysical cosmos of spiritual entities and corresponding goals. Abstracting religion to a symbolic labeling system for prediction and explanation robs religion, as well as reason, art, emotion, conversation, and logic, of any independent meaning at all. So Sullivan and Gray are so catholic in their semantics that the words can be replanted to justify almost anything. Moreover, the subsequent claim about religion existing because of our awareness of our own mortality is not borne out by the range of concepts that are properly considered religious.

In social change Sullivan sees a grasping towards redemption, whether in the Marxist-idolatrous left or the covertly idolatrous right, but a more careful reading of history proves Sullivan wrong on the surface, at least, if not in the deeper prescription. For instance, it is not faith in progress that has been part of the liberal social experiment since the Enlightenment, but a grasping towards actual reasons and justifications for what is desired and how to achieve it.… Read the rest

Hypersensitive Conspiracy Disorder

I was once cornered in a bar in Suva, Fiji by an Indian man who wanted to unburden himself and complain a bit. He was convinced that the United States had orchestrated the coups of 1987 in which the ethnically Fijian-dominated military took control of the country. The theory went like this: ethnic Indians had too much power for the Americans to bear as we were losing Subic Bay as a deep water naval base in the South Pacific. Suva was the best, nearest alternative but the Indians, with their cultural and political ties to New Delhi, were too socialist for the Americans. Hence the easy solution was to replace the elected government with a more pro-American authoritarian regime. Yet another Cold War dirty tricks effort, like Mossaddegh or Allende, far enough away that the American people just shrugged our collective shoulders. My drinking friend’s core evidence was an alleged sighting of Oliver North by someone, sometime, chatting with government officials. Ollie was the 4D chess grandmaster of the late 80s.

It didn’t work out that way, of course, and the coups continued into the 2000s. More amazing still was that the Berlin Wall came down within weeks of that bar meetup and the entire engagement model for world orders slid into a brief decade of deconstruction and confusion. Even the economic dominance of Japan ebbed and dissipated around the same time.

But our collective penchant for conspiracy theories never waned. And with the growth of the internet and then social media, the speed and ease of disseminating fringe and conspiratorial ideas has only increased. In the past week there were a number of news articles about the role of conspiracy theories, from a so-called “QAnon” advocate meeting with Trump to manipulation of the government by Israel’s Black Cube group.… Read the rest

Instrumentality and Terror in the Uncanny Valley

I got an Apple HomePod the other day. I have several Airplay speakers already, two in one house and a third in my separate office. The latter, a Naim Mu-So, combines Airplay with internet radio and bluetooth, but I mostly use it for the streaming radio features (KMozart, KUSC, Capital Public Radio, etc.). The HomePod’s Siri implementation combined with Apple Music allows me to voice control playlists and experiment with music that I wouldn’t generally have bothered to buy and own. I can now sample at my leisure without needing to broadcast via a phone or tablet or computer. Steve Reich, Bill Evans, Theolonius Monk, Bach organ mixes, variations of Tristan and Isolde, and, yesterday, when I asked for “workout music” I was gifted with Springsteen’s Born to Run, which I would never have associated with working out, but now I have dying on the mean streets of New Jersey with Wendy in some absurd drag race conflagration replaying over and over again in my head.

Right after setup, I had a strange experience. I was shooting random play thoughts to Siri, then refining them and testing the limits. There are many, as reviewers have noted. Items easily found in Apple Music are occasionally fails for Siri in HomePod, but simple requests and control of a few HomeKit devices work acceptably. The strange experience was my own trepidation over barking commands at the device, especially when I was repeating myself: “Hey Siri. Stop. Play Bill Evans. Stop. Play Bill Evans’ Peace Piece.” (Oh my, homophony, what will happen? It works.) I found myself treating Siri as a bit of a human being in that I didn’t want to tell her to do a trivial task that I had just asked her to perform.… Read the rest

The Universal Roots of Fantasyland

Intellectual history and cultural criticism always teeters on the brink of totalism. So it was when Christopher Hitchens was forced to defend the hyperbolic subtitle of God Is Not Great: How Religion Poisons Everything. The complaint was always the same: everything, really? Or when Neil Postman downplayed the early tremors of the internet in his 1985 Amusing Ourselves to Death. Email couldn’t be anything more than another movement towards entertainment and celebrity. So it is no surprise that Kurt Andersen’s Fantasyland: How America Went Wrong: A 500-Year History is open to similar charges.

Andersen’s thesis is easily digestible: we built a country on fantasies. From the earliest charismatic stirrings of the Puritans to the patent medicines of the 19th century, through to the counterculture of the 1960s, and now with an incoherent insult comedian and showman as president, America has thrived on inventing wild, fantastical narratives that coalesce into movements. Andersen’s detailed analysis is breathtaking as he pulls together everything from linguistic drift to the psychology of magical thinking to justify his thesis.

Yet his thesis might be too narrow. It is not a uniquely American phenomenon. When Andersen mentions cosplay, he fails to identify its Japanese contributions, including the word itself. In the California Gold Rush, he sees economic fantasies driving a generation to unmoor themselves from their merely average lives. Yet the conquistadores had sought to enrich themselves, God, and country while Americans were forming their shining cities on hills. And in mid-19th-century Europe, while the Americans panned in the Sierra, romanticism was throwing off the oppressive yoke of Enlightenment rationality as the West became increasingly exposed to enigmatic Asian cultures. By the 20th century, Weimar Berlin was a hotbed of cultural fantasies that dovetailed with the rise of Nazism and a fantastical theory of race, German volk culture, and Indo-European mysticism.… Read the rest

The Obsessive Dreyfus-Hawking Conundrum

I’ve been obsessed lately. I was up at 5 A.M. yesterday and drove to Ruidoso to do some hiking (trails T93 to T92, if interested). The San Augustin Pass was desolate as the sun began breaking over, so I inched up into triple digit speeds in the M6. Because that is what the machine is made for. Booming across White Sands Missile Range, I recalled watching base police work with National Park Rangers to chase oryx down the highway while early F117s practiced touch-and-gos at Holloman in the background, and then driving my carpool truck out to the high energy laser site or desert ship to deliver documents.

I settled into Starbucks an hour and a half later and started writing on ¡Reconquista!, cranking out thousands of words before trying to track down the trailhead and starting on my hike. (I would have run the thing but wanted to go to lunch later and didn’t have access to a shower. Neither restaurant nor diners deserve an après-run moi.) And then I was on the trail and I kept stopping and taking plot and dialogue notes, revisiting little vignettes and annotating enhancements that I would later salt in to the main text over lunch. And I kept rummaging through the development of characters, refining and sifting the facts of their lives through different sets of sieves until they took on both a greater valence within the story arc and, often, more comedic value.

I was obsessed and remain so. It is a joyous thing to be in this state, comparable only to working on large-scale software systems when the hours melt away and meals slip as one cranks through problem after problem, building and modulating the subsystems until the units begin to sing together like a chorus.… Read the rest