Flooding the Mystery Zone with Cynicism

The Mystery of the FoxI just finished planting one of my two urban garden plots here in Southern New Mexico. The circles had been left unattended and later covered with weed-control fabric that I topped with rock a few years ago when I visited from our Arizona home and discovered a vexing and disturbing collection of items buried in the soil. There was a child’s ball, a partially melted white candle, some marbles, a variety of small bones and strange animal remains, indeterminate masses of red and brown, unusual feces, and large pork chop bones. A shrine to strange, ancient deities? The remains of an ancient civilization? Our security camera coverage and the gates and fencing ruled out human activity. So we were left with wild animals, specifically gray foxes with long bushy tails that appear integrated into our little downtown community. We see them on the cameras early in the morning hours, typically, and they do some rather odd things, so the notion that they were collecting interesting items and burying them did not seem unreasonable. We also observed one fox flipping a piece of torn paper plate in the air in front of an unimpressed cat crouching nearby. Foxes will sometimes do similar jumping behavior as a method for mesmerizing their prey, but why bury a melted candle? Perhaps it smelled just enough like food that the fox thought it might come in handy during lean times later. And the child’s toy ball? Plastic odors might also resemble food. Maybe.

The New Mexico foxes, skunks, raccoons, and, I’m informed, some formerly pet coatimundi that wander in the area (but we’ve never seen), as well as the javelina, coyotes, deer, bobcats, and foxes around our Arizona forest home, are certainly influential in my Tusker Long project that tries to tackle an alien world where the worker slave animals have broken from their chains of servitude and simplicity to dominate society and come to grips with their own limits, prejudices, and historical animosities (perfectly wrong word, that).… Read the rest

Distributed Contexts in the Language Game

The meaning of words and phrases can be a bit hard to pin down. Indeed, the meaning of meaning itself is problematical. I can point to a dictionary and say, well, there is where we keep the meanings of things, but that is just a record of the way in which we use the language. I’m personally fond of a kind of philosophical perspective on this matter of meaning that relies on a form of holism. That is, words and their meanings are defined by our usages of them, our historical interactions with them in different contexts, and subtle distinctive cues that illuminate how words differ and compare. Often, but not always, the words are tied to things in the world, as well, and therefore have a fastness that resists distortions and distinctions.

This is, of course, a critical area of inquiry when trying to create intelligent machines that deal with language. How do we imbue the system with meaning, represent it within the machine, and apply it to novel problems that show intelligent behavior? In approaching the problem, we must therefore be achieving some semblance of intelligence in a fairly rigorous way since we are simulating it with logical steps.

The history of philosophical and linguistic interest in these topics is fascinating, ranging from Wittgenstein’s notion of a language game that builds up rules of use to Firth’s expansion to formalization of collocation of words as critical to meaning. In artificial intelligence, this concept of collocation has been expanded further to include interchangeability of contexts. Thus, boat and ship occur in more similar contexts than boat and bank.

A general approach to acquiring these contexts is based on the idea of dimensionality reduction in various forms.… Read the rest

Intelligent Borrowing

There has been a continuous bleed of biological, philosophical, linguistic, and psychological concepts into computer science since the 1950s. Artificial neural networks were inspired by real ones. Simulated evolution was designed around metaphorical patterns of natural evolution. Philosophical, linguistic, and psychological ideas transferred as knowledge representation and grammars, both natural and formal.

Since computer science is a uniquely synthetic kind of science and not quite a natural one, borrowing and applying metaphors seems to be part of the normal mode of advancement in this field. There is a purely mathematical component to the field in the fundamental questions around classes of algorithms and what is computable, but there are also highly synthetic issues that arise from architectures that are contingent on physical realizations. Finally, the application to simulating intelligent behavior relies largely on three separate modes of operation:

  1. Hypothesize about how intelligent beings perform such tasks
  2. Import metaphors based on those hypotheses
  3. Given initial success, use considerations of statistical features and their mappings to improve on the imported metaphors (and, rarely, improve with additional biological insights)

So, for instance, we import a simplified model of neural networks as connected sets of weights representing some kind of variable activation or inhibition potentials combined with sudden synaptic firing. Abstractly we already have an interesting kind of transfer function that takes a set of input variables and has a nonlinear mapping to the output variables. It’s interesting because being nonlinear means it can potentially compute very difficult relationships between the input and output.

But we see limitations, immediately, and these are observed in the history of the field. For instance, if you just have a single layer of these simulated neurons, the system isn’t fundamentally complex enough to compute any complex functions, so we add a few layers and then more and more.… Read the rest

The Twin Earth Dissonance Conspiracy

I came of age with some of the mid-to-late 20th century literature that took conspiracies as truss work for calculated paranoia, from Pynchon’s Gravity’s Rainbow to Philip K. Dick’s identity shuffling, and on to the obscurely psychedelic Illuminati books by Robert Shea and Robert Anton Wilson. They were undoubtedly influenced by the dirty tricks and mind control fantasies and realities of the Cold War, from thallium and LSD poisoning plots against Fidel Castro to the Manchurian Candidate and John Birchers; from Dr. Strangelove to ratfucking in the Nixon-era Republican Party.

The fiction paralleled and mimicked those realities but it was also infused with a kind of magical realism where the ideas permeated through the characters in a nexus of paranoia and fantasy. The reader was admitted to eccentric ways of structuring the history of the world and the motives of unseen forces acting through organizations, governments, and powerful people.

While endlessly fun, the fictional forms were also an inoculation: no mundane conspiracy could possibly capture that pulse of inside knowledge of a mystic firmament of lies and outlandish goals canopied above our earth-chained heads.

But here I am again, though much less amused and more fearful.

I think I read ten different reporting and opinion pieces today on the topic of Marjorie Taylor Greene, the shock-curiosity of the day who amplified QAnon, Jewish space lasers, political assassination fantasies, and likely a range of yet-to-be-discovered subjects of scorn and ridicule. Most analysts agree that such fantastical and angry ideas are methods for manipulating gullible people. They are tools for the acquisition of power over others.

The whole project feels like an alternative reality so late in America’s evolution, like we’ve transitioned to a Counter-Earth or Bizarro Htrae or Nabakov’s AntiTerra.… Read the rest

Type 2 Modular Cognitive Responsibility for a New Year

Brain on QI’m rebooting a startup that I had set aside a year ago. I’ve had some recent research and development advances that make it again seem worth pursuing. Specifically, the improved approach uses a deep learning decision-making filter of sorts to select among natural language generators based on characteristics of the interlocutor’s queries. The channeling to the best generator uses word and phrase cues, while the generators themselves are a novel deep learning framework that integrates ontologies about specific domain areas or motives of the chatbot. Some of the response systems involve more training than others. They are deeper and have subtle goals in responding to the query. Others are less nuanced and just engage in non-performative casual speech.

In social and cognitive psychology there is some recent research that bears a resemblance to this and also is related to contemporary politics and society. Well, cognitive modularity at the simplest is one area of similarity. But within the scope of that is the Type 1/Type 2 distinction, or “fast” versus “slow” thinking. In this “dual process” framework decision-making may be guided by intuitive Type 1 thinking that relates to more primitive, older evolutionary modules of the mind. Type 1 evolved to help solve survival dilemmas that require quick resolution. But inferential reasoning developed more slowly and apparently fairly late for us, with the impact of modern education strengthening the ability of these Type 2 decision processes to override the intuitive Type 1 decisions.

These insights have been applied in remarkably interesting ways in trying to understand political ideologies, moral choices, and even religious identity. For instance, there is some evidence that conservative political leanings correlates more with Type 1 processes.… Read the rest

Consequentia Roquentia

I just invented a new Voltairian muse for consideration. Dr. Roquentia, after Sartre’s lead in Nausea, is the opposite of Dr. Pangloss, convinced that we are in a state of perpetual, inevitable decline. Dr. R. is unmoved by evidence to the contrary concerning improvements in society because he can always sense unease and emptiness in this change.

I thought of the good doctor not while reading the boorish WSJ hit piece on Jill Biden for being labeled “Dr.” because she has only a PhD rather than an MD. It’s an acceptable editorial convention, but hardly one that should be irritating enough to belittle the owner of the title. Dr. R. would lose the honorific, too, being merely an advanced student of the jeremiad in his own narcissistic pursuit of identity.

No, instead I thought of this new caricature while reading National Review to catch up on what is troubling one corner of the conservative mind here as Our Glorious Leader tries to subvert democracy. There are always unwritten assumptions in NR opinion pieces, as if the righteous world lurks just out of reach in the shadows. In this one, there is a quick slap for “intersectional” scholarship, or perhaps just how it might influence public discourse or policy. More centrally, though, the background zeitgeist is the assumption that it is a moral good for children to be raised to be religious like their parents, and that American society is diminished by the reduction in religiosity in America of late. Dr R, sensing a comfortable decline into misery, laments perhaps a bit too ironically given that the recovery from religionless nihilism was central to Nausea.

The author, Cameron Hildritch, might be surprised to learn that there is an alternative and less ideological way of regarding secularized education.… Read the rest

Autonomous Ethical Reasoning

I got my first run in today after two months off. It was refreshing in that I was finally moving beyond the pain, but it also gave me that runner’s high oxygenation that lifts my spirit and fuels my thoughts. My wife and I decided a change of lockdown venue was in order so we relocated to New Mexico (after completing and checking our ballots in Arizona, I will note). My run took me up into the local mountain range and around an iconic rock formation. A coyote was sniffing around the trail until I spooked him. Some things are constant across the West, including the numinous sense of peace and calm that overtook me while I recovered under some trees and watched a few fanned-out contrails slowly drift in the high winds.

The fragility of American democracy keeps coming up in the run-up to tomorrow’s elections. Hostility, disinformation, legal actions, disruption, and general uncertainty have overtaken what was once a fairly simple process (Florida in 2000 notwithstanding).

Richard Just wrote a long-form piece in The Washington Post Magazine titled How Religion Can Help Put Our Democracy Back Together, though the title is shockingly more certain than the actual article that rebuilding is possible. Here are some of the ideas that Just circulates:

  1. If we were all a bit more attuned to the great mysteries that religions promote we would be more humble in our political engagement.
  2. Perhaps our shift away from religious involvement means that we instead idolatrously attach to political leaders.
  3. We have become obsessed with politics and lost the sense of inner peace that religions can provide.
  4. Religious communities are trust building, unlike other kinds of community involvement.
Read the rest

Measuring Belief and Quackery

While reviewing reporting on the RNC this afternoon, I found myself curious about the protocols at news organizations with respect to their editorial boards. For instance, does the Washington Post editorial board require that claimed facts within all opinion pieces are not clearly disputed? Does the New York Times? I suspect yes, which is what we see in the lawsuit filed by Sarah Palin against the New York Times concerning the suggestion that Palin’s campaign was relevant to the shooting of Gabby Giffords. There was at least a debate that rose to the level of the Opinion Editor, if not the board.

I was investigating this because I am curious how WaPo handles Trumpy columnists like Mark Thiessen and Hugh Hewitt, who are mostly cheerleaders without baggage for the current president, with only occasional whataboutisms and other distracting suggestions about Biden’s candidacy. They don’t defend lies and cons. They just cheer. Meanwhile, the board itself came down hard on the repeated falsehoods of Pamela Bondi and the ongoing slaughter of truth in the service of the Trump 2020 campaign.

The mainstream press represents Trump and cronies as conmen and women, manipulative, self-serving, corrupt, cruel, ignorant, ineffectual, morally questionable, and out-and-out liars. And the press uses facts to do so. Yet Trump maintains a remarkable following despite this evidence, with many quizzical onlookers at a loss as to the psychology of Trump’s followers.

In this modern example, there are many, many resources that can be used to fact check and form opinions. Yet people choose to rely on only a few and discount others as being biased.

I was recently reading some fairly detailed Bayesian analysis by philosophers concerning Hume’s argument against miracles.… Read the rest

One Shot, Few Shot, Radical Shot

Exunoplura is back up after a sad excursion through the challenges of hosting providers. To be blunt, they mostly suck. Between systems that just don’t work right (SSL certificate provisioning in this case) and bad to counterproductive support experiences, it’s enough to make one want to host it oneself. But hosting is mostly, as they say of war, long boring periods punctuated by moments of terror as things go frustratingly sideways. But we are back up again after two hosting provider side-trips!

Honestly, I’d like to see an AI agent effectively navigate through these technological challenges. Where even human performance is fleeting and imperfect, the notion that an AI could learn how to deal with the uncertain corners of the process strikes me as currently unthinkable. But there are some interesting recent developments worth noting and discussing in the journey towards what is named “general AI” or a framework that is as flexible as people can be, rather than narrowly tied to a specific task like visually inspecting welds or answering a few questions about weather, music, and so forth.

First, there is the work by the OpenAI folks on massive language models being tested against one-shot or few-shot learning problems. In each of these learning problems, the number of presentations of the training data cases is limited, rather than presenting huge numbers of exemplars and “fine tuning” the response of the model. What is a language model? Well, it varies across different approaches, but typically is a weighted context of words of varying length, with the weights reflecting the probabilities of those words in those contexts over a massive collection of text corpora. For the OpenAI model, GPT-3, the total number of parameters (words/contexts and their counts) is an astonishing 175 billion using 45 Tb of text to train the model.… Read the rest