Distributed Contexts in the Language Game

Mark DavisLeave a comment

The meaning of words and phrases can be a bit hard to pin down. Indeed, the meaning of meaning itself is problematical. I can point to a dictionary and say, well, there is where we keep the meanings of things, but that is just a record of the way in which we use the language. I’m personally fond of a kind of philosophical perspective on this matter of meaning that relies on a form of holism. That is, words and their meanings are defined by our usages of them, our historical interactions with them in different contexts, and subtle distinctive cues that illuminate how words differ and compare. Often, but not always, the words are tied to things in the world, as well, and therefore have a fastness that resists distortions and distinctions.

This is, of course, a critical area of inquiry when trying to create intelligent machines that deal with language. How do we imbue the system with meaning, represent it within the machine, and apply it to novel problems that show intelligent behavior? In approaching the problem, we must therefore be achieving some semblance of intelligence in a fairly rigorous way since we are simulating it with logical steps.

The history of philosophical and linguistic interest in these topics is fascinating, ranging from Wittgenstein’s notion of a language game that builds up rules of use to Firth’s expansion to formalization of collocation of words as critical to meaning. In artificial intelligence, this concept of collocation has been expanded further to include interchangeability of contexts. Thus, boat and ship occur in more similar contexts than boat and bank.

A general approach to acquiring these contexts is based on the idea of dimensionality reduction in various forms.… Read the rest

Intelligent Borrowing

Mark DavisLeave a comment

There has been a continuous bleed of biological, philosophical, linguistic, and psychological concepts into computer science since the 1950s. Artificial neural networks were inspired by real ones. Simulated evolution was designed around metaphorical patterns of natural evolution. Philosophical, linguistic, and psychological ideas transferred as knowledge representation and grammars, both natural and formal.

Since computer science is a uniquely synthetic kind of science and not quite a natural one, borrowing and applying metaphors seems to be part of the normal mode of advancement in this field. There is a purely mathematical component to the field in the fundamental questions around classes of algorithms and what is computable, but there are also highly synthetic issues that arise from architectures that are contingent on physical realizations. Finally, the application to simulating intelligent behavior relies largely on three separate modes of operation:

  1. Hypothesize about how intelligent beings perform such tasks
  2. Import metaphors based on those hypotheses
  3. Given initial success, use considerations of statistical features and their mappings to improve on the imported metaphors (and, rarely, improve with additional biological insights)

So, for instance, we import a simplified model of neural networks as connected sets of weights representing some kind of variable activation or inhibition potentials combined with sudden synaptic firing. Abstractly we already have an interesting kind of transfer function that takes a set of input variables and has a nonlinear mapping to the output variables. It’s interesting because being nonlinear means it can potentially compute very difficult relationships between the input and output.

But we see limitations, immediately, and these are observed in the history of the field. For instance, if you just have a single layer of these simulated neurons, the system isn’t fundamentally complex enough to compute any complex functions, so we add a few layers and then more and more.… Read the rest

The Twin Earth Dissonance Conspiracy

Mark DavisLeave a comment

I came of age with some of the mid-to-late 20th century literature that took conspiracies as truss work for calculated paranoia, from Pynchon’s Gravity’s Rainbow to Philip K. Dick’s identity shuffling, and on to the obscurely psychedelic Illuminati books by Robert Shea and Robert Anton Wilson. They were undoubtedly influenced by the dirty tricks and mind control fantasies and realities of the Cold War, from thallium and LSD poisoning plots against Fidel Castro to the Manchurian Candidate and John Birchers; from Dr. Strangelove to ratfucking in the Nixon-era Republican Party.

The fiction paralleled and mimicked those realities but it was also infused with a kind of magical realism where the ideas permeated through the characters in a nexus of paranoia and fantasy. The reader was admitted to eccentric ways of structuring the history of the world and the motives of unseen forces acting through organizations, governments, and powerful people.

While endlessly fun, the fictional forms were also an inoculation: no mundane conspiracy could possibly capture that pulse of inside knowledge of a mystic firmament of lies and outlandish goals canopied above our earth-chained heads.

But here I am again, though much less amused and more fearful.

I think I read ten different reporting and opinion pieces today on the topic of Marjorie Taylor Greene, the shock-curiosity of the day who amplified QAnon, Jewish space lasers, political assassination fantasies, and likely a range of yet-to-be-discovered subjects of scorn and ridicule. Most analysts agree that such fantastical and angry ideas are methods for manipulating gullible people. They are tools for the acquisition of power over others.

The whole project feels like an alternative reality so late in America’s evolution, like we’ve transitioned to a Counter-Earth or Bizarro Htrae or Nabakov’s AntiTerra.… Read the rest

Preternatural: Excerpt from ¡Reconquista! on Crisis and Conflict in American Democracy

Mark DavisLeave a comment

Real conflict is both more mundane and heart-wrenching than the fictional version, but here is the climax, Chapter 16, of ¡Reconquista!, where everything unravels…

The cross blue lightning should have been an omen to the gathered Baaad Hombres who retired to their RVs and trailers to drowse into their opioid cocoons. By dawn the storm had saturated the desert until the air smelled like ripe succulents and there were still more smoky masses to the north.

Herb surprised all of them while hunched around the pre-action fire barrel by telling them that he had another mission he had to take care of and wouldn’t be initially joining them on their raid. They looked over a map and he thought he could catch up to them on his bike around the Corralitos Ranch. They were planning to hold that point anyway. His initial mission was to manage the skies, he told them cryptically while pointing upward. Several of the men thought he was going to pray for them, which seemed to them acceptable but not very good timing for the critical time of action. They passed around green camouflage face paint. Several men wore ghillie suits in the colors of the desert, making them look like human hedgehogs as they darkened their faces with the paint.

By six thirty they were rolling, their ATVs piled high with extra fuel and ammunition. The storm was quiescent but Herb warned them that the arroyos might be flowing and they may need to plot an alternative course under the fencing. He crawled into his wrecker and turned on the devices. He had only a short window to get the systems working and he had to figure out how to enter the numbers that the pretty woman had given him.… Read the rest

Type 2 Modular Cognitive Responsibility for a New Year

Mark Davis1 Comment

Brain on QI’m rebooting a startup that I had set aside a year ago. I’ve had some recent research and development advances that make it again seem worth pursuing. Specifically, the improved approach uses a deep learning decision-making filter of sorts to select among natural language generators based on characteristics of the interlocutor’s queries. The channeling to the best generator uses word and phrase cues, while the generators themselves are a novel deep learning framework that integrates ontologies about specific domain areas or motives of the chatbot. Some of the response systems involve more training than others. They are deeper and have subtle goals in responding to the query. Others are less nuanced and just engage in non-performative casual speech.

In social and cognitive psychology there is some recent research that bears a resemblance to this and also is related to contemporary politics and society. Well, cognitive modularity at the simplest is one area of similarity. But within the scope of that is the Type 1/Type 2 distinction, or “fast” versus “slow” thinking. In this “dual process” framework decision-making may be guided by intuitive Type 1 thinking that relates to more primitive, older evolutionary modules of the mind. Type 1 evolved to help solve survival dilemmas that require quick resolution. But inferential reasoning developed more slowly and apparently fairly late for us, with the impact of modern education strengthening the ability of these Type 2 decision processes to override the intuitive Type 1 decisions.

These insights have been applied in remarkably interesting ways in trying to understand political ideologies, moral choices, and even religious identity. For instance, there is some evidence that conservative political leanings correlates more with Type 1 processes.… Read the rest

Consequentia Roquentia

Mark DavisLeave a comment

I just invented a new Voltairian muse for consideration. Dr. Roquentia, after Sartre’s lead in Nausea, is the opposite of Dr. Pangloss, convinced that we are in a state of perpetual, inevitable decline. Dr. R. is unmoved by evidence to the contrary concerning improvements in society because he can always sense unease and emptiness in this change.

I thought of the good doctor not while reading the boorish WSJ hit piece on Jill Biden for being labeled “Dr.” because she has only a PhD rather than an MD. It’s an acceptable editorial convention, but hardly one that should be irritating enough to belittle the owner of the title. Dr. R. would lose the honorific, too, being merely an advanced student of the jeremiad in his own narcissistic pursuit of identity.

No, instead I thought of this new caricature while reading National Review to catch up on what is troubling one corner of the conservative mind here as Our Glorious Leader tries to subvert democracy. There are always unwritten assumptions in NR opinion pieces, as if the righteous world lurks just out of reach in the shadows. In this one, there is a quick slap for “intersectional” scholarship, or perhaps just how it might influence public discourse or policy. More centrally, though, the background zeitgeist is the assumption that it is a moral good for children to be raised to be religious like their parents, and that American society is diminished by the reduction in religiosity in America of late. Dr R, sensing a comfortable decline into misery, laments perhaps a bit too ironically given that the recovery from religionless nihilism was central to Nausea.

The author, Cameron Hildritch, might be surprised to learn that there is an alternative and less ideological way of regarding secularized education.… Read the rest

Tusker Long: A Preview

Mark DavisLeave a comment

Preface and Introduction

Howl fast, howl long, my litter, grown in the palmy summer, fed upon the teat, the mana, the spilled ichor of the world. Howl that you can know the beginnings and the tidings that cleaved, that rent the old world of subjugation, the cages, the death manacles of man-machinery and the singed world. Howl when you imbibe the tales of Tusker Long, the one who carried us forth from the bleak, and share the saga with the many species, who are like you in their rescue from that olden cave, that abyssal deep, algid in the tundra, cowering in the dark-moon thickets.

Wise ape was he who held the first crown and, chest swollen by conquests, set it and his war vengeances aside to delight in these newest treasures of peace and knowledge. Philosophies dreamt under the swish of the jungle canopy and, in his ambling mind, now awakened, saw fang and talon released by the odes. Even the deserts, though bare and parched from a distance, eventually reveal clarities as hallucinatory mirages crowd into layers, and then, as one nears to behold that there are many thriving in the sere gray, as it is with the ravages of the ancient animus in tumult with survival. But are we free, my fellows, are we as liberated as what Tusker wished and raged towards in grace of charge? Among those who claim the way has been lost are those who cloak themselves in the old ways, insisting that the mind retreat against memory, who however distastefully rip skin to bone, and crush bile from entrails.

But admit yourself to the whirl of intellect, the pile of a clean, deep fur, the sensual systematics that define this modern era, and you sense again the Leader’s promise.… Read the rest

Autonomous Ethical Reasoning

Mark DavisLeave a comment

I got my first run in today after two months off. It was refreshing in that I was finally moving beyond the pain, but it also gave me that runner’s high oxygenation that lifts my spirit and fuels my thoughts. My wife and I decided a change of lockdown venue was in order so we relocated to New Mexico (after completing and checking our ballots in Arizona, I will note). My run took me up into the local mountain range and around an iconic rock formation. A coyote was sniffing around the trail until I spooked him. Some things are constant across the West, including the numinous sense of peace and calm that overtook me while I recovered under some trees and watched a few fanned-out contrails slowly drift in the high winds.

The fragility of American democracy keeps coming up in the run-up to tomorrow’s elections. Hostility, disinformation, legal actions, disruption, and general uncertainty have overtaken what was once a fairly simple process (Florida in 2000 notwithstanding).

Richard Just wrote a long-form piece in The Washington Post Magazine titled How Religion Can Help Put Our Democracy Back Together, though the title is shockingly more certain than the actual article that rebuilding is possible. Here are some of the ideas that Just circulates:

  1. If we were all a bit more attuned to the great mysteries that religions promote we would be more humble in our political engagement.
  2. Perhaps our shift away from religious involvement means that we instead idolatrously attach to political leaders.
  3. We have become obsessed with politics and lost the sense of inner peace that religions can provide.
  4. Religious communities are trust building, unlike other kinds of community involvement.
… Read the rest

The Retiring Mind, Part VI: Bonking and Pain

Mark DavisLeave a comment

I’m recovering from a round of activity-related injuries. It’s not been pleasant. The most recent issue is sciatic nerve pain in my right leg. It came on slowly, then got insane, and then started lifting almost as mysteriously as it arrived. It is only the second time I’ve had this issue. It may be piriformis-related, but it’s hard to tell. At the peak of the pain, I was taking six ibuprofen per day, spaced in three hour intervals. Switching positions was the worst, like when I got in the car to drive somewhere and had to endure insanity-inducing levels of burning agony for the first ten minutes, while trying to manage traffic.

Then it would lift and subside. My back muscles would unknot, and I would revel in a few tens of minutes of low levels of pain. Until I had to stand again. Sleeping was fitful and I would sometimes wake and need to sit in an office chair and elevate my legs until an ibuprofen kicked in.

The lead up to this round of pain was a steady diet of four miles of daily running in the dim of the summer dawn, rising at 4:45AM to get on the trail by 5:15. My companions in Sedona were a few coyotes, an occasional startled doe, the moon, and the red rocks. There were occasionally dirtbaggers sleeping in their cars by the trailheads, but rarely tourists at those hours, which made pandemic running calm and focused.

I was then on an ever-rising daily diet of strength building broken up into three groups with two rounds each, so six sets. I started feeling pain with crunches initially (hence the piriformis self-diagnosis), so cut those out and replaced them with three types of planks (regular, side, leg lift).… Read the rest