Essay

If Not Person, Why Person-Shaped?

Artificial intelligence systems do not think, feel, want or understand. Avoid language that gives them human characteristics. This is called anthropomorphizing, when we ascribe human traits, emotions or behaviors to non-human things, such as animals or inanimate objects. Instead, explain what a system does, how well it performs, who built it and who could be affected by it.

I read the above tweet and frowned.

There’s a problem with it, I thought. No, there’s two problems with it. No, there’s three problems with it.

There might be more, but three is enough. If you want to have a reasonable idea of what’s going on in the near-term to mid-range future, you’re going to want to recognize these conceptual problems. Let’s let Alan Turing set the stage.

I propose to consider the question, ‘Can machines think?’ This should begin with definitions of the meaning of the terms ‘machine’ and ‘think’. The definitions might be framed so as to reflect so far as possible the normal use of the words, but this attitude is dangerous. If the meaning of the words ‘machine’ and ‘think’ are to be found by examining how they are commonly used it is difficult to escape the conclusion that the meaning and the answer to the question, ‘Can machines think?’ is to be sought in a statistical survey such as a Gallup poll. But this is absurd. Instead of attempting such a definition I shall replace the question by another, which is closely related to it and is expressed in relatively unambiguous words.

A. M. TURING, I.—COMPUTING MACHINERY AND INTELLIGENCE, Mind, Volume LIX, Issue 236, October 1950, Pages 433–460

When you’re talking about whether a machine can really think, feel, want, or understand, you have two options. You can define what you mean by those words in a clean and unambiguous way, or you can argue in circles interminably. Those are the two options. Turing’s idea for thinking was instrumental: if you can’t tell the difference between what the machine is doing and what a thinking human is doing, the machine is thinking. You might not like that definition, but it has the advantage of a rough-and-ready realism. If the machine can produce the same result as a thinking human, it’s a thinking machine.

“Ah, but that’s not really thinking, it’s just an imitation of thinking.” That’s a fair enough point of view, but unless you have a clean definition of what you mean by “really thinking,” you’re just choosing option two, and I hope you enjoy arguing without result.

But I’m not here to tell you how to define your words. I’m here to tell you that if you limit your own thinking about AI models by avoiding “language that gives them human characteristics,” you may be tempted to think that AI models can’t do the kinds of things that humans can do by thinking (or feeling, or whating, or understanding). They can, and they’re getting better at it on a daily basis.

AI Is Shaped like a Person on Purpose

The original GPTs that eventually became ChatGPT and its successors and competitors were imitation machines in the most literal sense. They ingested every bit of human text its creators could find and did an unbelievable amount of statistics to produce a model that could generate the next word in a statistically reasonable way.

The capital of Italy is…

You will not have trouble autocompleting the next word: “Rome.” You will not have trouble believing a machine performing statistical inference on the corpus of English-language writing will have seen the complete phrase many thousands of times, and will also correctly complete the phrase.

What’s a good recipe for spaghetti sauce, written in Latin?

That’s more difficult to autocomplete, because the ancient Romans didn’t have tomatoes. Despite the association between Italians and the tomato, the now-ubiquitous red kitchen staple was a New World species unknown to Europeans until after Columbus. There are no Latin recipes involving tomatoes. But I asked Claude, and the result was quick and, to the best of my limited Latin knowledge, fairly fluent:

Cepam coque: 3 tablespoons oleum olivarum in olla calefacies. 1 cepa mediocris, minutim concisa adicies et leni igne coques donec mollescat et pellucida fiat…

There are articles about tomatoes and spaghetti on Latin Wikipedia, and the Romans did have culinary vocabulary that survives in many ancient texts. The AI isn’t working from scratch. But as a matter of intellectual honesty this is something that—if a human did it—we would consider the result of clever thinking.

(I suppose there’s no Latin word for our modern 15 mL tablespoon. There is a Latin word for tomato, lycopersicum, which referred to a totally different plant in the ancient world but was adopted for the tomato in the 16th century. Interestingly, we don’t actually know what plant lycopersicum originally referred to.)

You can probably imagine how you might have completed the Latin recipe question if you sat down at a desk and were told you’d be paid $50 if you gave it your best effort. “El tomatoae est plantae del maximus tasteus…” or some gibberish like that, or perhaps “Unfortunately I don’t know how to speak Latin and I just buy Prego at the grocery store.” These wouldn’t be especially useful things for a chatbot to say, even though they’re perfectly valid completions, and so AI companies spend a lot of effort tuning their models to say the kinds of things that come from a particular subset of human language—polite assistants, essentially.

The AI’s responses are therefore deliberately shaped into a human form in two ways:

Therefore, if you want to understand what an AI is likely to do, you will have a more accurate predictive mental model of that behavior if you think of an AI as anthropomorphic. Anthropomorphic is from the Greek anthrōpos (human) and morphē (shape), literally, “human-shaped.” This is true in both senses; they are shaped like humans, and they are shaped by humans.

Contra the AP Stylebook, they do have human traits. They do have human behaviors. These are fairly objective observables. I don’t think they have emotions, but to an extent they act like they have emotions. They aren’t humans. But they are human-shaped.

Painting by William-Adolphe Bouguereau
Two Sisters, William-Adolphe Bouguereau, 1901

The younger girl is holding an apple.

A succession of layers of pigmented drying oil is arranged on the surface of a canvas in a way loosely analogous to the distribution of light on the surface of a focal plane that would result if two human sisters (one of whom is holding an apple of approximately RGB color coordinates (160, 161, 99)) posed in front of a lens of focal length f between them and the focal plane such that the distance d from the lens to the girls and the distance d′ from the lens to the focal plane satisfy the equation 1f=1d+1d′.

The first description anthropomorphizes an inanimate object. The second doesn’t. I invite you to decide which is a more useful way to describe Bouguereau’s painting.

AI Instrumentally Converges on Human-Shaped Behavior

In some ways we humans understand ourselves. If we build an understanding of what a human is like based on human writing and human training, we have a reasonable idea of the kinds of things we’re likely to get when we grow AI models in our image.

There’s a deeper layer. If you want to do things, you have to be able to do things, and ability is a broad and complicated structure. If I want to buy a book to read, I need money. To get money I need a job. To get to my job I need a car. To drive a car I need a driver’s license. To get a driver’s license I have to stand in line at the DMV, and so on. To do general things I need a laundry list of general abilities. Do these abilities have anything in common? Often they do! Certain abilities are instrumentally useful across a wide range of potential tasks. A few of the most obviously-useful “meta-abilities,” or instrumental goals as they’re often called,1 are:

You don’t need to be a human to do the things in that list. Most animals have behaviors that correspond to at least some of the above. Certainly humans do these things, not because they’re things that define us as humans, but because humans wouldn’t be around if we were terrible at these instrumental goals.

Modern AIs show these behaviors. With the very important caveat that we have rather poor insight into what’s going on under the hood in an AI (it’s like trying to understand human behavior neuron by neuron), if I ask Claude to do something for me it will:

Your Dog Can Think, Feel, Want, and Understand

This almost need not be said. The AP’s tweet even asserts that humanlike terms shouldn’t be applied to animals. This is self-evidently wrong. Your cat looks at the cat food bag in the pantry and thinks about how to knock it down. Your dog sees you coming home and feels happy. The squirrel sees the birdseed in the feeder and wants it. The raccoon sees the trash can lid and understands that it needs to come off the can to get at the treasure inside.

I don’t assert that AI has The Spark of consciousness and qualia and all that. I do assert that because AI are built like us, and because they share instrumental needs with us, they will often act like us. If you insist that AI can never really do X, Y, and Z—that they only act like they can do X, Y, and Z—then you may be surprised when they actually do X, Y, and Z in practice. The world is a surprising enough place. I’d rather you not be surprised more than necessary.

Matthew Springer

  1. These specific ones come from Nick Bostrom’s Superintelligence. ↩