Causing Incoherence to Exist

Mark Davis1 Comment

I was continuing discussion on Richard Carrier vs. the Apologists but the format of the blog posting system made a detailed conversation difficult, so I decided to continue here. My core argument is that the premises of Kalam are incoherent. I also think some of the responses are as well.

But what do we mean by incoherent?

Richard interpreted that to mean logically impossible, but my intent was that incoherence is a property of the semantics of the words. Statements are incoherent when they don’t make sense or only make sense with a very narrow and unwarranted reading of the statement. The following argument follows a fairly standard analytic tradition analysis of examining the meaning of statements. I am currently fond of David Lewis’s school of thought on semantics, where the meaning of words exist as a combination of mild referential attachment, coherence within a network of other words, and, importantly, some words within that network achieve what is called “reference magnetism” in that they are tied to reality in significant ways and pull at the meaning of other words.

For instance, consider Premise 1 of a modern take on Kalam:

All things that begin to exist have a cause.

OK, so what does begin to exist mean? And how about cause? Let’s unpack “begin to exist,” first. We might say in our everyday world of people that, say, cars begin to exist at some point. But when is that point? For instance, is it latent in the design for the car? Is it when the body panels are attached on the assembly line? Is it when the final system is capable of car behavior? That is, when all the parts that were in fact designed are fully operational?… Read the rest

Two Points on Penrose, and One On Motivated Reasoning

Mark Davis1 Comment

Sir Roger Penrose is, without doubt, one of the most interesting polymaths of recent history. Even where I find his ideas fantastical, they are most definitely worth reading and understanding. Sean Carroll’s Mindscape podcast interview with Penrose from early January of this year is a treat.

I’ve previously discussed the Penrose-Hameroff conjectures concerning wave function collapse and their implication of quantum operations in the micro-tubule structure of the brain. I also used the conjecture in a short story. But the core driver for Penrose’s original conjecture, namely that algorithmic processes can’t explain human consciousness, has always been a claim in search of support. Equally difficult is pushing consciousness into the sphere of quantum phenomena that tend to show random, rather than directed, behavior. Randomness doesn’t clearly relate to the “hard problem” of consciousness that is about the experience of being conscious.

But take the idea that since mathematicians can prove things that are blocked by Gödel incompleteness, our brains must be different from Turing machines or collections of them. Our brains are likely messy and not theorem proving machines per se, despite operating according to logico-causal processes. Indeed, throw in an active analog to biological evolution based on variation-and-retention of ideas and insights that might actually have a bit of pseudo-randomness associated with it, and there is no reason to doubt that we are capable of the kind of system transcendence that Penrose is looking for.

Note that this doesn’t in any way impact the other horn of Penrose-Hameroff concerning the measurement problem in quantum theory, but there is no reason to suspect that quantum collapse is necessary for consciousness. It might flow the other way, though, and Penrose has created the Penrose Institute to look experimentally for evidence about these effects.… Read the rest

Narcissism, Nonsense and Pseudo-Science

Mark Davis5 Comments

I recently began posting pictures of our home base in Sedona to Instagram (check it out in column to right). It’s been a strange trip. If you are not familiar with how Instagram works, it’s fairly simple: you post pictures and other Instagram members can “follow” you and you can follow them, meaning that you see their pictures and can tap a little heart icon to show you like their pictures. My goal, if I have one, is just that I like the Northern Arizona mountains and deserts and like thinking about the composition of photographs. I’m also interested in the gear and techniques involved in taking and processing pictures. I did, however, market my own books on the platform—briefly, and with apologies.

But Instagram, like Facebook, is a world unto itself.

Shortly after starting on the platform, I received follows from blond Russian beauties who appear to be marketing online sex services. I have received odd follows from variations on the same name who have no content on their pages and who disappear after a day or two if I don’t follow them back. Though I don’t have any definitive evidence, I suspect these might be bots. I have received follows from people who seemed to be marketing themselves as, well, people—including one who bait-and-switched with good landscape photography. They are typically attractive young people, often showing off their six-pack abs, and trying to build a following with the goal of making money off of Instagram. Maybe they plan to show off products or reference them, thus becoming “influencers” in the lingo of social media. Maybe they are trying to fund their travel experiences by reaping revenue from advertisers that co-exist with their popularity in their image feed.… Read the rest

Theoretical Reorganization

Mark DavisLeave a comment

Sean Carroll of Caltech takes on the philosophy of science in his paper, Beyond Falsifiability: Normal Science in a Multiverse, as part of a larger conversation on modern theoretical physics and experimental methods. Carroll breaks down the problems of Popper’s falsification criterion and arrives at a more pedestrian Bayesian formulation for how to view science. Theories arise, theories get their priors amplified or deflated, that prior support changes due to—often for Carroll—coherence reasons with other theories and considerations and, in the best case, the posterior support improves with better experimental data.

Continuing with the previous posts’ work on expanding Bayes via AIT considerations, the non-continuous changes to a group of scientific theories that arrive with new theories or data require some better model than just adjusting priors. How exactly does coherence play a part in theory formation? If we treat each theory as a binary string that encodes a Turing machine, then the best theory, inductively, is the shortest machine that accepts the data. But we know that there is no machine that can compute that shortest machine, so there needs to be an algorithm that searches through the state space to try to locate the minimal machine. Meanwhile, the data may be varying and the machine may need to incorporate other machines that help improve the coverage of the original machine or are driven by other factors, as Carroll points out:

We use our taste, lessons from experience, and what we know about the rest of physics to help guide us in hopefully productive directions.

The search algorithm is clearly not just brute force in examining every micro variation in the consequences of changing bits in the machine. Instead, large reusable blocks of subroutines get reparameterized or reused with variation.… Read the rest

Free Will and Algorithmic Information Theory (Part II)

Mark DavisLeave a comment
Bad monkey

So we get some mild form of source determinism out of Algorithmic Information Complexity (AIC), but we haven’t addressed the form of free will that deals with moral culpability at all. That free will requires that we, as moral agents, are capable of making choices that have moral consequences. Another way of saying it is that given the same circumstances we could have done otherwise. After all, all we have is a series of if/then statements that must be implemented in wetware and they still respond to known stimuli in deterministic ways. Just responding in model-predictable ways to new stimuli doesn’t amount directly to making choices.

Let’s expand the problem a bit, however. Instead of a lock-and-key recognition of integer “foodstuffs” we have uncertain patterns of foodstuffs and fallible recognition systems. Suddenly we have a probability problem with P(food|n) [or even P(food|q(n)) where q is some perception function] governed by Bayesian statistics. Clearly we expect evolution to optimize towards better models, though we know that all kinds of historical and physical contingencies may derail perfect optimization. Still, if we did have perfect optimization, we know what that would look like for certain types of statistical patterns.

What is an optimal induction machine? AIC and variants have been used to define that machine. First, we have Solomonoff induction from around 1960. But we also have Jorma Rissanen’s Minimum Description Length (MDL) theory from 1978 that casts the problem more in terms of continuous distributions. Variants are available, too, from Minimum Message Length, to Akaike’s Information Criterion (AIC, confusingly again), Bayesian Information Criterion (BIC), and on to Structural Risk Minimization via Vapnik-Chervonenkis learning theory.

All of these theories involve some kind of trade-off between model parameters, the relative complexity of model parameters, and the success of the model on the trained exemplars.… Read the rest

A Southwestern History of Western Music

Mark DavisLeave a comment

Growing up in New Mexico I had an unusual collection of childhood experiences. My father was a professor of engineering at New Mexico State but had done post-docs in astrophysics at the Naval Observatory in Washington D.C. after a doctorate at University of Wisconsin at Madison. I rode along to cosmic ray observatories high in the mountains and joined him at Los Alamos National Laboratory during summer consulting gigs. He introduced an exotic young fellow professor and his wife to me after I became fascinated by insect vision and ideas for simulating how bugs see the world. That, in turn, led to me living with the couple (he with a doctorate in EE and graduate students in evolutionary biology; her with a doctorate in plant physiology doing cancer research) after my father died young. I slept under a workbench while they started a business and built early word processor systems, pivoted to commercial time sharing, then to consulting on weather monitoring systems for White Sands Missile Range.

I was always in special programs and doing science fairs, taking art classes at the university, and whatnot until it became uncool for me for some reason. In a perhaps not unexpected series of intersections by high school I had a collection of friends who were bright and precocious in their interests in a way that I thought perfectly normal at the time. They graduated early, investigated radical ideas and movements in the special collections of the college library, and we variously started university while still in high school. Later, in grad school, an equally creative collection of souls poured themselves into performance art projects and shows that were poorly attended but perhaps only because they were so radical and innovative that even the arts community felt at sea with all the new media forms we were inventing.… Read the rest

Free Will and Algorithmic Information Theory

Mark Davis1 Comment

I was recently looking for examples of applications of algorithmic information theory, also commonly called algorithmic information complexity (AIC). After all, for a theory to be sound is one thing, but when it is sound and valuable it moves to another level. So, first, let’s review the broad outline of AIC. AIC begins with the problem of randomness, specifically random strings of 0s and 1s. We can readily see that given any sort of encoding in any base, strings of characters can be reduced to a binary sequence. Likewise integers.

Now, AIC states that there are often many Turing machines that could generate a given string and, since we can represent those machines also as a bit sequence, there is at least one machine that has the shortest bit sequence while still producing the target string. In fact, if the shortest machine is as long or a bit longer (given some machine encoding requirements), then the string is said to be AIC random. In other words, no compression of the string is possible.

Moreover, we can generalize this generator machine idea to claim that given some set of strings that represent the data of a given phenomena (let’s say natural occurrences), the smallest generator machine that covers all the data is a “theoretical model” of the data and the underlying phenomena. An interesting outcome of this theory is that it can be shown that there is, in fact, no algorithm (or meta-machine) that can find the smallest generator for any given sequence. This is related to Turing Incompleteness.

In terms of applications, Gregory Chaitin, who is one of the originators of the core ideas of AIC, has proposed that the theory sheds light on questions of meta-mathematics and specifically that it demonstrates that mathematics is a quasi-empirical pursuit capable of producing new methods rather than being idealistically derived from analytic first-principles.… Read the rest

The Elusive in Art and Artificial Intelligence

Mark DavisLeave a comment
Per caption.
Deep Dream (deepdreamgenerator.com) of my elusive inner Van Gogh.

How exactly deep learning models do what they do is at least elusive. Take image recognition as a task. We know that there are decision-making criteria inferred by the hidden layers of the networks. In Convolutional Neural Networks (CNNs), we have further knowledge that locally-receptive fields (or their simulated equivalent) provide a collection of filters that emphasize image features in different ways, from edge detection to rotation-invariant reductions prior to being subjected to a learned categorizer. Yet, the dividing lines between a chair and a small loveseat, or between two faces, is hidden within some non-linear equation composed of these field representations with weights tuned by exemplar presentation.

This elusiveness was at least part of the reason that neural networks and, generally, machine learning-based approaches have had a complicated position in AI research; if you can’t explain how they work, or even fairly characterize their failure modes, maybe we should work harder to understand the support for those decision criteria rather than just build black boxes to execute them?

So when groups use deep learning to produce visual artworks like the recently auctioned work sold by Christie’s for USD 432K, we can be reassured that the murky issue of aesthetics in art appreciation is at least paired with elusiveness in the production machine.

Or is it?

Let’s take Wittgenstein’s ideas about aesthetics as a perhaps slightly murky point of comparison. In Wittgenstein, we are almost always looking at what are effectively games played between and among people. In language, the rules are shared in a culture, a community, and even between individuals. These are semantic limits, dialogue considerations, standardized usages, linguistic pragmatics, expectations, allusions, and much more.… Read the rest

Happy 2019!

Mark DavisLeave a comment

And to start off the New Year, I’m experimenting with Instagram. Here are a few Sedona images:

[wdi_feed id=”1″]

Meanwhile, here are my current projects for 2019:

Quintessence of Rust (QOR): Post-apocalyptic and post-cyberpunk novel series set in a future world devastated by climate change. Begun in 2018, I expect to complete the first book by summer 2019. Here’s a sample:

The jungle is so overwhelmingly alive some days that the air is a vibrating green shroud. The vines strangle up through the canopy trees towards a wan shimmer. The heat becomes toxic where the gray skies break through and the violet and rust of the fungal mounds heap like domes. A low drone warns of bloodsucking swarms of gigantic flies, startling the naked rodents out along paths and down through root mazes into protective huddles in the cooling mud, while the women stoke smudge fires and call the painted children close. And then the sound passes, and the clucks and snorts begin again, at first with hesitancy against the silence of the moist envelop, then more, and then with greater intensity, until the music of the day is restored. The hunters return by lunch to await the afternoon rains that slide and drop in pachinko-ball rivulets through the thousand feet of piled and layered life.

Fifty feet up, where the tree splits its ancient trunk into three equal parts, atop the accumulated detritus of hundreds of years that became yet another pad of spongy jungle, the high apartments begin. Layer upon layer of wooden hovels, connected by ropes woven from vine fibers, wedged by pins and slotted bamboo, build like a rectilinear wasp nest, splitting off and then recoupling higher still, for two hundred feet more.

… Read the rest

Poetics and Humanism for the Solstice

Mark Davis4 Comments

There is, necessarily, an empty center to secular existence. Empty in the sense that there is no absolute answer to the complexities of human life, alone or as part of the great societies that we have created. This opens us to wild, adventurous circuits through pain, meaning, suffering, growth, and love. Religious writers in recent years have had a tendentious tendency to denigrate this fantastic adventure, as Andrew Sullivan does in New York magazine. The worst possible argument is that everything is religion insofar as we believe passionately about its value. It’s wrong if for no other reason than the position of John Gray that Sullivan quotes:

Religion is an attempt to find meaning in events, not a theory that tries to explain the universe.

Many religious people absolutely disagree with that characterization and demand an entire metaphysical cosmos of spiritual entities and corresponding goals. Abstracting religion to a symbolic labeling system for prediction and explanation robs religion, as well as reason, art, emotion, conversation, and logic, of any independent meaning at all. So Sullivan and Gray are so catholic in their semantics that the words can be replanted to justify almost anything. Moreover, the subsequent claim about religion existing because of our awareness of our own mortality is not borne out by the range of concepts that are properly considered religious.

In social change Sullivan sees a grasping towards redemption, whether in the Marxist-idolatrous left or the covertly idolatrous right, but a more careful reading of history proves Sullivan wrong on the surface, at least, if not in the deeper prescription. For instance, it is not faith in progress that has been part of the liberal social experiment since the Enlightenment, but a grasping towards actual reasons and justifications for what is desired and how to achieve it.… Read the rest