Does AI actually think, or is it just predicting the next word

Started by Darkseid, Yesterday at 02:00 PM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Topic: Does AI actually think, or is it just predicting the next word   Views(Read 67 times)
Active members in this topic:
Darkseid(1)

Darkseid

The honest technical answer is that large language models are trained to predict the next most likely word given everything that came before, and that core mechanism has not changed even as the outputs have gotten dramatically more sophisticated. Calling that pure autocomplete undersells what actually happens though, since predicting the next word well enough to solve a novel math problem or write working code requires the model to have built something that functions a lot like internal reasoning, even if the training objective itself is deceptively simple.

Researchers themselves are genuinely split on how to describe this. Some argue the models build internal world representations that go well beyond simple pattern matching, pointing to experiments where models solve problems that were not directly present in training data. Others argue that impressive output does not require anything resembling understanding, and that sufficiently advanced pattern matching can look identical to reasoning from the outside without actually being it.

The most useful honest framing is probably that this is not a yes or no question, since thinking is not a single well defined thing even in humans, and the debate partly comes down to which specific definition of thinking you are using in the first place. A model can produce genuinely novel, useful, and coherent output through a mechanism that is meaningfully different from human cognition, without that output being fake or valueless.

What is not really in dispute is that these models do not have persistent goals, desires, or a continuous sense of self between conversations, regardless of how convincingly they can simulate having one within a single exchange. Whatever is actually happening internally, it does not resemble the kind of ongoing subjective experience most people mean when they use the word thinking in an everyday sense.

Worth separating the philosophical question from the practical one here. Since regardless of how you answer whether it thinks, the actual outputs still need to be checked and verified the same way either way

Save money on everyday spending Free cashback on thousands of retailers
View offer