Author: Mark Davis

Entrepreneur, scientist, engineer, and author. Bent on worldwide understanding.

Free Will and Algorithmic Information Theory (Part II)

Mark DavisLeave a comment
Bad monkey

So we get some mild form of source determinism out of Algorithmic Information Complexity (AIC), but we haven’t addressed the form of free will that deals with moral culpability at all. That free will requires that we, as moral agents, are capable of making choices that have moral consequences. Another way of saying it is that given the same circumstances we could have done otherwise. After all, all we have is a series of if/then statements that must be implemented in wetware and they still respond to known stimuli in deterministic ways. Just responding in model-predictable ways to new stimuli doesn’t amount directly to making choices.

Let’s expand the problem a bit, however. Instead of a lock-and-key recognition of integer “foodstuffs” we have uncertain patterns of foodstuffs and fallible recognition systems. Suddenly we have a probability problem with P(food|n) [or even P(food|q(n)) where q is some perception function] governed by Bayesian statistics. Clearly we expect evolution to optimize towards better models, though we know that all kinds of historical and physical contingencies may derail perfect optimization. Still, if we did have perfect optimization, we know what that would look like for certain types of statistical patterns.

What is an optimal induction machine? AIC and variants have been used to define that machine. First, we have Solomonoff induction from around 1960. But we also have Jorma Rissanen’s Minimum Description Length (MDL) theory from 1978 that casts the problem more in terms of continuous distributions. Variants are available, too, from Minimum Message Length, to Akaike’s Information Criterion (AIC, confusingly again), Bayesian Information Criterion (BIC), and on to Structural Risk Minimization via Vapnik-Chervonenkis learning theory.

All of these theories involve some kind of trade-off between model parameters, the relative complexity of model parameters, and the success of the model on the trained exemplars.… Read the rest

A Southwestern History of Western Music

Mark DavisLeave a comment

Growing up in New Mexico I had an unusual collection of childhood experiences. My father was a professor of engineering at New Mexico State but had done post-docs in astrophysics at the Naval Observatory in Washington D.C. after a doctorate at University of Wisconsin at Madison. I rode along to cosmic ray observatories high in the mountains and joined him at Los Alamos National Laboratory during summer consulting gigs. He introduced an exotic young fellow professor and his wife to me after I became fascinated by insect vision and ideas for simulating how bugs see the world. That, in turn, led to me living with the couple (he with a doctorate in EE and graduate students in evolutionary biology; her with a doctorate in plant physiology doing cancer research) after my father died young. I slept under a workbench while they started a business and built early word processor systems, pivoted to commercial time sharing, then to consulting on weather monitoring systems for White Sands Missile Range.

I was always in special programs and doing science fairs, taking art classes at the university, and whatnot until it became uncool for me for some reason. In a perhaps not unexpected series of intersections by high school I had a collection of friends who were bright and precocious in their interests in a way that I thought perfectly normal at the time. They graduated early, investigated radical ideas and movements in the special collections of the college library, and we variously started university while still in high school. Later, in grad school, an equally creative collection of souls poured themselves into performance art projects and shows that were poorly attended but perhaps only because they were so radical and innovative that even the arts community felt at sea with all the new media forms we were inventing.… Read the rest

Free Will and Algorithmic Information Theory

Mark Davis1 Comment

I was recently looking for examples of applications of algorithmic information theory, also commonly called algorithmic information complexity (AIC). After all, for a theory to be sound is one thing, but when it is sound and valuable it moves to another level. So, first, let’s review the broad outline of AIC. AIC begins with the problem of randomness, specifically random strings of 0s and 1s. We can readily see that given any sort of encoding in any base, strings of characters can be reduced to a binary sequence. Likewise integers.

Now, AIC states that there are often many Turing machines that could generate a given string and, since we can represent those machines also as a bit sequence, there is at least one machine that has the shortest bit sequence while still producing the target string. In fact, if the shortest machine is as long or a bit longer (given some machine encoding requirements), then the string is said to be AIC random. In other words, no compression of the string is possible.

Moreover, we can generalize this generator machine idea to claim that given some set of strings that represent the data of a given phenomena (let’s say natural occurrences), the smallest generator machine that covers all the data is a “theoretical model” of the data and the underlying phenomena. An interesting outcome of this theory is that it can be shown that there is, in fact, no algorithm (or meta-machine) that can find the smallest generator for any given sequence. This is related to Turing Incompleteness.

In terms of applications, Gregory Chaitin, who is one of the originators of the core ideas of AIC, has proposed that the theory sheds light on questions of meta-mathematics and specifically that it demonstrates that mathematics is a quasi-empirical pursuit capable of producing new methods rather than being idealistically derived from analytic first-principles.… Read the rest

The Elusive in Art and Artificial Intelligence

Mark DavisLeave a comment
Per caption.
Deep Dream (deepdreamgenerator.com) of my elusive inner Van Gogh.

How exactly deep learning models do what they do is at least elusive. Take image recognition as a task. We know that there are decision-making criteria inferred by the hidden layers of the networks. In Convolutional Neural Networks (CNNs), we have further knowledge that locally-receptive fields (or their simulated equivalent) provide a collection of filters that emphasize image features in different ways, from edge detection to rotation-invariant reductions prior to being subjected to a learned categorizer. Yet, the dividing lines between a chair and a small loveseat, or between two faces, is hidden within some non-linear equation composed of these field representations with weights tuned by exemplar presentation.

This elusiveness was at least part of the reason that neural networks and, generally, machine learning-based approaches have had a complicated position in AI research; if you can’t explain how they work, or even fairly characterize their failure modes, maybe we should work harder to understand the support for those decision criteria rather than just build black boxes to execute them?

So when groups use deep learning to produce visual artworks like the recently auctioned work sold by Christie’s for USD 432K, we can be reassured that the murky issue of aesthetics in art appreciation is at least paired with elusiveness in the production machine.

Or is it?

Let’s take Wittgenstein’s ideas about aesthetics as a perhaps slightly murky point of comparison. In Wittgenstein, we are almost always looking at what are effectively games played between and among people. In language, the rules are shared in a culture, a community, and even between individuals. These are semantic limits, dialogue considerations, standardized usages, linguistic pragmatics, expectations, allusions, and much more.… Read the rest

Happy 2019!

Mark DavisLeave a comment

And to start off the New Year, I’m experimenting with Instagram. Here are a few Sedona images:

[wdi_feed id=”1″]

Meanwhile, here are my current projects for 2019:

Quintessence of Rust (QOR): Post-apocalyptic and post-cyberpunk novel series set in a future world devastated by climate change. Begun in 2018, I expect to complete the first book by summer 2019. Here’s a sample:

The jungle is so overwhelmingly alive some days that the air is a vibrating green shroud. The vines strangle up through the canopy trees towards a wan shimmer. The heat becomes toxic where the gray skies break through and the violet and rust of the fungal mounds heap like domes. A low drone warns of bloodsucking swarms of gigantic flies, startling the naked rodents out along paths and down through root mazes into protective huddles in the cooling mud, while the women stoke smudge fires and call the painted children close. And then the sound passes, and the clucks and snorts begin again, at first with hesitancy against the silence of the moist envelop, then more, and then with greater intensity, until the music of the day is restored. The hunters return by lunch to await the afternoon rains that slide and drop in pachinko-ball rivulets through the thousand feet of piled and layered life.

Fifty feet up, where the tree splits its ancient trunk into three equal parts, atop the accumulated detritus of hundreds of years that became yet another pad of spongy jungle, the high apartments begin. Layer upon layer of wooden hovels, connected by ropes woven from vine fibers, wedged by pins and slotted bamboo, build like a rectilinear wasp nest, splitting off and then recoupling higher still, for two hundred feet more.

… Read the rest

Poetics and Humanism for the Solstice

Mark Davis4 Comments

There is, necessarily, an empty center to secular existence. Empty in the sense that there is no absolute answer to the complexities of human life, alone or as part of the great societies that we have created. This opens us to wild, adventurous circuits through pain, meaning, suffering, growth, and love. Religious writers in recent years have had a tendentious tendency to denigrate this fantastic adventure, as Andrew Sullivan does in New York magazine. The worst possible argument is that everything is religion insofar as we believe passionately about its value. It’s wrong if for no other reason than the position of John Gray that Sullivan quotes:

Religion is an attempt to find meaning in events, not a theory that tries to explain the universe.

Many religious people absolutely disagree with that characterization and demand an entire metaphysical cosmos of spiritual entities and corresponding goals. Abstracting religion to a symbolic labeling system for prediction and explanation robs religion, as well as reason, art, emotion, conversation, and logic, of any independent meaning at all. So Sullivan and Gray are so catholic in their semantics that the words can be replanted to justify almost anything. Moreover, the subsequent claim about religion existing because of our awareness of our own mortality is not borne out by the range of concepts that are properly considered religious.

In social change Sullivan sees a grasping towards redemption, whether in the Marxist-idolatrous left or the covertly idolatrous right, but a more careful reading of history proves Sullivan wrong on the surface, at least, if not in the deeper prescription. For instance, it is not faith in progress that has been part of the liberal social experiment since the Enlightenment, but a grasping towards actual reasons and justifications for what is desired and how to achieve it.… Read the rest

Tomorrow’s Prologue (or, On the Quantum Consciousness of Cows)

Mark DavisLeave a comment

Tomorrow’s Prologue is my 2017 entry to the X Prize science fiction contest, Seat 14C. The set-up is simple: a plane disappears during arrival to SFO and then reappears 20 years later. From the perspective of seat 14C, tell a story…

Tendrils of clouds reached up into the cold dark of the Aleutian night. My noise-canceling headphones turned the ubiquitous roar of the aircraft into a chronic background hiss, a tinnitus intruding on the still life of snowy islands nestled below us. I turned on my LED lamp and pulled the device from my carry-on bag, setting it on my side table. It was inadvertently beautiful; every edge and cone of the small machine, from the milled aluminum topped by circlets of palladium to the glowing organic band near its base, were designed for a specific purpose by my laboratory in Tokyo. If any consideration of aesthetics found their way into the design, it was Kinji-san ad-libbing on the functionality. It had a dual back there, too, one that shared a portion of entangled photons that had been separated from one another at birth. I connected a USB-C cable to my laptop and ran a brief diagnostic. It began to radiate cold. All systems were within operating specs, so I tried Shor’s algorithm, transferring the model for a thousand-digit factorization to the machine. A flight attendant noiselessly brushed past me, prepping for breakfast service. The initial run seemed to work so I pulled up the quantum consciousness simulator that I had been developing and gave it a go. I knew it was incomplete, but I had to debug it eventually.

There was a strange popping sensation and flash, not like ears under altitude change, but like the whole plane had shuddered for a brief moment.… Read the rest

Indifference and the Cosmos

Mark DavisLeave a comment

I am a political independent, though that does not mean that I vote willy-nilly. I have, in fact, been reliably center left for most of my adult life, save one youthfully rebellious moment when I voted Libertarian, more as a statement than a commitment to the principles of libertarianism per se. I regret that vote now, given additional exposure to the party and the kinds of people it attracts. To me, the extremes of the American political system build around radical positions, and the increasingly noxious conspiracy theories and unhinged rhetoric is nothing like the cautious, problem-solving utopia that might make me politically happy, or at least wince less.

Some might claim I am indifferent. I would not argue with that. In the face of revolution, I would require a likely impossible proof of a better outcome before committing. How can we possibly see into such a permeable and contingent future, or weigh the goods and harms in the face of the unknown? This idea of indifference, as a tempering of our epistemic insights, serves as a basis for an essential idea in probabilistic reasoning where it even has the name, the principle of indifference, or, variously, and in contradistinction with Leibniz’s principle of sufficient reason, the principle of insufficient reason.

So how does indifference work in probabilistic reasoning? Consider a Bayesian formulation: we inductively guess based on a combination of a priori probabilities combined with a posteriori evidences. What is the likelihood of the next word in an English sentence being “is”? Indifference suggests that we treat each word as likely as any other, but we know straight away that “is” occurs much more often than “Manichaeistic” in English texts because we can count words.… Read the rest

Structure and Causality in Political Revolutions

Mark DavisLeave a comment

Can political theories be tested like scientific ones? And if they can, does it matter? Alexis Papazoglou argues in the New Republic that, even if they can be tested, it is less important than other factors in the success of the political theory. In his signal case, the conflict between anti-globalist populists and the conventional international order is questioned as resulting in clear outcomes that somehow will determine the viability of one theory versus the other. It’s an ongoing experiment. Papazoglou breaks down the conflict as parallel to the notion that scientific processes ultimately win on falsifiability and rationality. In science, as per Kuhn’s landmark The Structure of Scientific Revolutions, the process is more paradigmatic agendas, powerful leaders, and less calculated rationality.

The scientific process may have been all of those things, of course, and may continue to be so in the future, but there are ongoing developments that make it less likely that sociological factors will dominate. And this is why the comparison with political theories is perhaps wrongheaded. There may be a community of political theorists but they are hardly the primary architects and spectators of politics, unlike science and scientists. We are all political actors, yet very few have the time or inclination to look carefully at the literature on the threat of successful authoritarian Chinese civilization versus Western liberal democracy, for instance. But we are not all scientific actors, despite being governed by the reality of the world around us. Politics yells and seethes while science quietly attends a conference. Even the consequences of science are often so gradualistic in their unfolding that we barely notice them; see the astonishing progress on cancer survival in the past decades and note the need for economic discounting for global climate change, where the slow creep of existential threats are somehow given dollar values.… Read the rest