Research

Three claims about AI that survive scrutiny: the intelligence definition, the pronoun problem, and Google's shelved LaMDA

Written 543 words

CognitionGemini

Marbled blue abstract background, liquid marble pattern — Magnific · Licensed under the Magnific Free License

Three claims I keep returning to, because each one is more load-bearing than it first appears.

One — "artificial intelligence" is not a scientific term

It is a commercial one. The problem is the second word.

In 1997 fifty-two researchers signed a consensus statement on intelligence, published in Intelligence and led by Linda Gottfredson of the University of Delaware. It defines intelligence as a very general mental capability that, among other things, involves the ability to reason, plan, solve problems, think abstractly, comprehend complex ideas, learn quickly and learn from experience. It is not merely book learning, a narrow academic skill, or test-taking smarts; it reflects a broader and deeper capability for comprehending our surroundings.

Hold current systems against that list honestly and the fit is partial. Some capabilities are demonstrated, others are contested, and at least one is not present at all in a deployed model: learning from experience in the ordinary sense, as opposed to being retrained. Weights are frozen. What looks like learning inside a conversation is context, not acquisition.

None of which makes the systems less useful. It makes the label imprecise. Something closer to "algorithmic modelling" would describe what is actually happening. It also does not sell, which is most of the answer to why nobody uses it.

Two — the hardest word in English for a language model is "it"

Pronouns are the difficult case, and the reason is that they carry almost no meaning of their own. They point. Resolving one requires holding the surrounding situation in mind and deciding what is being pointed at.

This is why pronoun resolution became a benchmark and not a footnote. Terry Winograd's original example is the canonical one: the city councilmen refused the demonstrators a permit because they feared violence, versus because they advocated violence. One word changes, and the referent of "they" flips. No amount of syntax gets you there. You need a model of who fears things and who advocates things.

Hector Levesque proposed the Winograd Schema Challenge in 2011 as an alternative to the Turing test, precisely because it resists the tricks that let a system pass by deflection. Machines performed near chance for years. Systems now score well above that, which is a real result — though later analysis showed some of the gain came from statistical regularities in the datasets, not from the reasoning the benchmark was designed to isolate.

Three — Google built it first and shelved it

LaMDA was Google's conversational model, announced in 2021 and never released as a public product. The capability was there. The judgement about what it was worth was not.

Google had reason for caution. A chatbot that says something indefensible is a reputational problem for a company whose product is trust in search results, and the same conservatism had already cost them elsewhere. What followed is now the standard case study: OpenAI shipped ChatGPT in November 2022, built on the transformer architecture that Google researchers had published in 2017, and the market reorganised itself around a category Google had reached first and chosen not to enter.

The transformer architecture as Google published it in 2017.
The transformer architecture as Google published it in 2017. Vaswani, Shazeer, Parmar et al., Attention Is All You Need, 2017, fig. 1. arxiv.org/abs/1706.03762. Quoted under §51 UrhG.

The transferable lesson is not about models. It is that the risk of shipping is legible and the risk of not shipping is invisible until someone else makes it visible.

References