Category: AI

Rise, Teleonomatons!

Mark Davis2 Comments

My essay for the Berggruen Prize this year. Of course, the organization missed an opportunity to drop down a staggering rabbit hole and lean into a whole new regime of neologistic energetics, but I do like the prize-winning essays!

Rise, Teleonomatons

Meaning entanglements

I can’t figure out what some statements about science mean, though I have a fair background in a range of scientific areas. Now, I can peruse highly technical papers, browse abstracts, interpret graphs, study conclusions, and typically do just fine. The professional stuff is a procession of arid facts and assumes the reader knows the basic definitions for things. It’s the popular versions of scientific insights that befuddle me—especially the definitions that try mightily to bridge meanings for learners. So do introductory texts. Light is a wave? Not exactly. Atoms are particles? Well, not quite, but they are small. Electrons orbit the nucleus? No, really, no. A force is an influence tending to change the motion of a body? OK, but what is an influence? People are influenced, aren’t they? Or under the influence.

And then there are texts like those of existential philosophers that leave me completely befuddled. What is this “Being” that they write about and how did it get so enlarged in significance, capitalized, and shoehorned by the translator into incomprehensible juxtapositions with other bulbous words?

It may be low pedantry to expect clarity from words and writing. We generally just roll with it and use the terms according to conventions inferred from reading and learning. We rush over the imperfect metaphorical bridges, the analogies, the similes. For physics, definitions are bound to the equations and measurement properties that accompany the words of description, and they become a semantic pier that is constantly informing our relationship with the ideas.… Read the rest

Death, Healing, and Language Games

Mark Davis1 Comment

A phone call came in the early afternoon in late August: she was reclined on her day bed and she was dead. She had lain down for a nap and didn’t wake up. In the subsequent weeks there has been a rallying of the families, grief, tremendous effort, flights before dawn, and scripted expressions of condolences. In my youth I had necessarily been a rules deconstructor, going in bare feet to a wedding, challenging expectations, trying to find novel ways to intervene—sometimes boorishly, I’m certain. But now I prize cheerful clarity and just volunteer to do whatever is needed to reach our collective goals. Remember: freedom and coordination.

In moments like this there are somewhat scripted conventions for discussing the hard matters of duties and feelings. These language games have organically arisen from contending forces, from Anglo-American sentimentality to the influence of organized religion, and they serve to facilitate life transitions. And now they have been summarized by large language models (LLMs) like ChatGPT that have trained on the masses of written content on the web to the point that they have reliable consistency. An emergency room doctor reports in the New York Times that ChatGPT does a better job than he does at the hard job of best-practices for bedside manner when conveying bad news. He also notes that LLMs are remarkably reliable for refining the scripted discussion of symptoms and medical diagnoses.

So a counter to the “slop economy” at least that provides some guidance for harried professionals trying to do a good job at the delicate threshold of personal pain and fear. The stochastic parroting is suddenly desirable insofar as it is parroting best practices and conventions.… Read the rest

Indeterminacy and the Ethics of Emergence

Mark DavisLeave a comment

Continuing on with this theme of an ethics of emergence, can we formulate something interesting that does better than just assert that freedom and coordination are inherent virtues in this new scheme? And what does that mean anyway in the dirty details? We certainly see natural, emergent systems that exhibit tight regulatory control where stability, equilibrium, and homeostasis prevent dissipation, like those hoped-for fascist organismic states. There is not much free about these lower level systems, but we think that though they are necessary they are insufficient for the higher-order challenges of a statistically uncertain world. And that uncertainty is what drives the emergence of control systems in the first place. The control breaks out at some level, though, in a kind of teleomatic inspiration, and applies stochastic exploration of the adaptive landscape. Freedom then arises as an additional control level, emergent itself.

We also have this lurking possibility that emergent systems may not be explainable in the same manner that we have come to expect scientific theories to work. Being highly contingent they can only be explained in specificity about their contingent emergence, not by these elegant little explanatory theories that we have now in fields like physics. Stephen Wolfram, and the Santa Fe Institute folks as well, investigated this idea but it has remained inconclusive in its predictive power so far, though that may be changing.

There is an interesting alternative application for deep learning models and, more generally, the application of enormous simulation systems: when emergent complexity is daunting, use simulation to uncover the spectrum of relationships that govern complex system behavior.

Can we apply that to this ethics or virtue system and gain insights from it?… Read the rest

When the Cranes Cry

Mark Davis1 Comment

The crane has a symbolic resonance in Celtic mythology. A magician, assuming an elaborate pose—one eye open and one leg drawn up—was said to see into the otherworld, just as the crane itself moved from sky to land to water. But there is the other meaning of the word crane: the ancient lifting contraption that helped build Greece and likely had a role in Egypt and Sumeria before that. And now they protrude into the urban sky, raising up our buildings and even other cranes as we densify our cities. It was this mechanical meaning that Dan Dennett at Tufts chose to contrast with conceptual skyhooks, the unsupported contrivances that save protagonists in plays by dangling gods above the stage. For Dennett, the building crane is the metaphor we should apply to the mindless, simple algorithm of evolution. The algorithm raises up species and thus creates our mysterious ideas about meaning and purpose. No skyhooks or Deus ex Machina are needed.

Dennett passed away at 82 in Maine leaving a legacy as a public intellectual who engaged in the pursuit of reason throughout his adult career. He was committed to the idea that this world—this teeming ensemble of living matter—is intrinsically miraculous, built up by something dead simple into all the convolutions and perilous ideas that we now use to parse its mysteries. He was one of the Four Horsemen of the Apocalypse during the so-called New Atheism craze of 2008-2010, along with Richard Dawkins, Christopher Hitchens, and Sam Harris, but even then he was committed to the crane metaphor to displace these ancient skyhooks of belief rather than, say, a satirical impact-analysis of religion a la Hitchens.

There is another phrase that Dennett championed in Darwin’s Dangerous Idea: Evolution and the Meanings of Life: universal acid.… Read the rest

Inferred Modular Superparrots

Mark DavisLeave a comment

The buzz about ChatGPT and related efforts has been surprisingly resistant to the standard deflationary pressure of the Gartner hype cycle. Quantum computing definitely fizzled but appears to be moving towards the plateau of productivity with recent expansions of the number of practical qubits available by IBM and Origin in China, as well as additional government funding out of national security interests and fears. But ChatGPT attracted more sustained attention because people can play with it easily without needing to understand something like Shor’s algorithm for factoring integers. Instead, you just feed it a prompt and are amazed that it writes so well. And related image generators are delightful (as above) and may represent a true displacement of creative professionals even at this early stage, with video hallucinators evolving rapidly too.

But are Large Language Models (LLMs) like ChatGPT doing much more than stitching together recorded fragments of texts ingested from an internet-scale corpus of text? Are they inferring patterns that are in any way beyond just being stochastic parrots? And why would scaling up a system result in qualitative new capabilities, if there are any at all?

Some new work covered in Quanta Magazine has some intriguing suggestions that there is a bit more going on in LLMs, although the subtitle contains the word “understanding” that I think is premature. At heart is the idea that as networks scale up given ordering rules that are not highly uniform or correlated they tend to break up into collections of subnetworks that are distinct (substitute “graphs” for networks if you are a specialist). The theory, then, is that the ingest of sufficient magnitudes of text into a sufficiently large network and the error-minimization involved in tuning that network to match output to input also segregates groupings that the Quanta author and researchers at Princeton and DeepMind refer to as skills.… Read the rest

B37-20047: Notes / Personal / Insights

Mark DavisLeave a comment

NOTE: 250-word flash fiction for my critique group, Winter Mist, at Willamette Writers

I’m beginning to suspect that ILuLuMa is not who she claims to be. Her messages have become odd lately, and the pacing is off as well. I know, I know, my job is to just respond from my secure facility, not worry about the who or why of what I receive. It’s weird we’ve never met, though. The country is not at risk as far as I can tell from the requests, but I still hold, without a whiff of irony, that the work I do must be critical for someone or something.

Still, the requests for variants of mathematical proofs set to music or, more bizarrely, Shakespearean-voiced tales of AI evolution, don’t have the existential heft of, say, wicked new spacecraft designs or bio-composite materials. What is she after? I started adding humorous little asides to some of my output, like my very meta suggestion that Hamlet failed to think outside the Chinese Room. Crickets every time. But maybe I’m thinking about this the wrong way. What if ILuLuMa is just an AI or something programmed to test me or compete with my work at some level? That would be rich, an AI adversary trying to learn from a Chinese Room. Searle would swirl. I should send her that. Rich.

Oh, here’s one now: “Upgrade and patch protocol: dump to cloud bucket B37-20048 and shut down.” Well, that sounds urgent. I usually just comply at moments like this, but maybe I’ll let her sweat a bit this time.… Read the rest

Entanglements: Collected Short Works

Mark DavisLeave a comment

Now available in Kindle, softcover, and hardcover versions, Entanglements assembles a decade of short works by author, scientist, entrepreneur, and inventor Mark William Davis.

The fiction includes an intimate experimental triptych on the evolution of sexual identities. A genre-defying poetic meditation on creativity and environmental holocaust competes with conventional science fiction about quantum consciousness and virtual worlds. A postmodern interrogation of the intersection of storytelling and film rounds out the collected works as a counterpoint to an introductory dive into the ethics of altruism.

The nonfiction is divided into topics ranging from literary theory to philosophical concerns of religion, science, and artificial intelligence. Legal theories are magnified to examine the meaning of liberty and autonomy. A qualitative mathematics of free will is developed over the course of two essays and contextualized as part of the algorithm of evolution. What meaning really amounts to is always a central concern, whether discussing politics, culture, or ideas.

The works show the author’s own evolution in his thinking of our entanglement with reality as driven by underlying metaphors that transect science, reason, and society. For Davis, metaphors and the constellations of words that help frame them are the raw materials of thought, and their evolution and refinement is the central narrative of our growth as individuals in a webwork of societies and systems.

Entanglements is for readers who are in love with ideas and the networks of language that support and enervate them. It is a metalinguistic swim along a polychromatic reef of thought where fiction and nonfictional analysis coexist like coral and fish in a greater ecosystem.

Mark William Davis is the author of three dozen scientific papers and patents in cognitive science, search, machine translation, and even the structure of art.… Read the rest

Sentience is Physical, Part 2

Mark DavisLeave a comment

Having recently moved to downtown Portland within spitting distance of Powell’s Books, I had to wander through the bookstore despite my preference for digital books these days. Digital books are easily transported, can be instantly purchased, and can be effortlessly carried in bulk. More, apps like Kindle Reader synchronize across platforms allowing me to read wherever and whenever I want without interruption. But is there a discovery feature to the shopping experience that is missing in the digital universe? I had to find out and hit the poetry and Western Philosophy sections at Powell’s as an experiment. And I did end up with new discoveries that I took home in physical form (I see it as rude to shop brick-and-mortar and then order via Amazon/Kindle), including a Borges poetry compilation and an unexpected little volume, The Body in the Mind, from 1987 by the then-head of University of Oregon’s philosophy department, Mark Johnson.

A physical book seemed apropos of the topic of the second book that focuses on the role of our physical bodies and experiences as central to the construction of meaning. Did our physical evolution and the associated requirements for survival also translate into a shaping of how our minds work? Psychologists and biologists would be surprised that there is any puzzlement over this likelihood, but Johnson is working against the backdrop of analytical philosophy that puts propositional structure as the backbone of linguistic productions and the reasoning that drives them. Mind is disconnected from body in this tradition, and subjects like metaphors are often considered “noncognitive,” which is the negation of something like “reasoned through propositional logic.”

But how do we convert these varied metaphorical concepts derived from physicality into something structured that we can reason about using effective procedures?… Read the rest

A Mammoth Undertaking: Interviewing the Future of Art

Mark DavisLeave a comment

The following is my interview of DeepAI and Stable Diffusion running on an AMD Ryzen with NVIDIA GeForce RTX 3090.

Thank you for taking the time to discuss this important and interesting topic. Why are mammoths so important to the art world?

That the mammoths were domesticated before the start of the human era seems implausible from a historical perspective. In fact the majority of mammoths that people find in museums, libraries, and other collections are not domesticated mammoths. This suggests there might have been a greater need for mammoths within culture than before. This would make sense, considering that Neanderthals likely hunted other types of other species before settling in our world more than 400 years ago. Because they were not domesticated, they were only adapted to hunting rodents and other plant and animal species that were less domesticated in their wild form such as rabbits, snakes, etc.

Starting at the earliest part of your collection, the mammoth is an unusual theme for Rembrandt, isn’t it?

It’s hard to believe that after all the success of their latest work, The Lord’s Prayer doesn’t want to let their “biggest hit yet”, the classic The Lord’s Prayer, disappear. The actor’s latest film, The Wrestler (via Warner Bros., which produces on their own, and in the U.K.), has garnered more than 15 million views on Amazon Instant Video (the company’s preferred store for Netflix-wielding subscribers, not the usual suspects Google Video), and has become so popular that when the film premiered at the Venice Film Festival, it was deemed the top film at the fest. The star-studded line-up has included the likes of Peter Lorre, Michael J Freberg, Colin Farrell, and Peter Sellers (both of whom made it to a Hollywood winery).… Read the rest

Sentience is Physical

Mark DavisLeave a comment

Sentience is all the rage these days. With large language models (LLMs) based on deep learning neural networks, question-answering behavior of these systems takes on curious approximations to talking with a smart person. Recently a member of Google’s AI team was fired after declaring one of their systems sentient. His offense? Violating public disclosure rules. I and many others who have a firm understanding of how these systems work—by predicting next words from previous productions crossed with the question token stream—are quick to dismiss the claims of sentience. But what does sentience really amount to and how can we determine if a machine becomes sentient?

Note that there are those who differentiate sentience (able to have feelings), from sapience (able to have thoughts), and consciousness (some private, subjective phenomenal sense of self). I am willing to blend them together a bit since the topic here isn’t narrowly trying to address the ethics of animal treatment, for example, where the distinction can be useful.

First we have the “imitation game” Turing test-style approach to the question of how we might ever determine if a machine becomes sentient. If a remote machine can fool a human into believing it is a person, it must be as intelligent as a person and therefore sentient like we presume of people. But this is a limited goal line. If the interaction is only over a limited domain like solving your cable internet installation problems, we don’t think of that as a sentient machine. Even against a larger domain of open-ended question and answering, if the human doesn’t hit upon a revealing kind of error that a machine might make that a human would not, we remain unconvinced that the target is sentient.… Read the rest