CHAPTER 13/Overall

Summary

Recurring waves, a map of predictions, and what we still don't know

Lay the four booms on top of each other and the same pattern seems to repeat. But is it really a fixed pattern? We put the predictions this site has collected onto a single map and check that the answer changes with how far ahead the prediction looked, how the predictions were chosen, and how they were counted. Finally, we gather everything that is still not known.

011956–2026 · The four waves

Stacking the four waves

Did the four booms repeat the same pattern?

This site marked off the four booms using the same standard. The triggers are the 1956 workshop, the use of AI in companies and Japan's Fifth Generation Computer project in 1980–1982, the 2012 image-recognition competition, and the 2022 release of generative AI.

The figure on the right lines up the expectation, prediction, reality and winter of each boom. Press "Align by trigger year" and the four lines start from the same position. Expectations swell, a prediction of the form “by this year” appears, the year comes and the prediction is not fulfilled as stated, and a winter arrives. In some places it does look like that.

But look closely and the differences are large too. The first winter came at different times in different countries (Chapter 5). Between the third and fourth booms there was no winter; even the figure in Japan's 2024 white paper from the Ministry of Internal Affairs and Communications says (translated). Most of the fourth boom's predictions have not yet reached their target year.

offset=year of event − trigger year
trigger year
1956, 1980, 2012, 2022 (the dividing points used on this site)
What you think you knowThe popular story:The history of AI repeats the same pattern every time
The original source says:Laid side by side the booms look alike, but how a winter arrives, and whether one arrived at all, differs from boom to boom. When researchers checked the market-research firm's chart of peaks and troughs of expectation, it did not follow the standard pattern (spread 11 of this chapter).

What the figure shows:Aligning 4 booms by their triggering years shows some similar sequences of expectations, predictions, and winters. But winters arrived in different ways, with none between the third and fourth booms, so looking similar does not make a fixed law.

021957–2023 · This time it's real

“This time it's real,” said four times

How did people in the middle of a boom see their own time?

In every boom, people at the time felt “this time it's real.” First boom: in a 1957 talk, Herbert Simon and Allen Newell said that . Second boom: on the exhibition floor of an AI conference in 1984, a brochure for an AI tool boasted (the same conference held a panel in which researchers worried about ).

Third boom: the blurb for a book by Yutaka Matsuo (shown as 2018) wrote (translated). Fourth boom: in 2023, Matsuo said it is (translated).

On the cards on the right, move the After slider and what happened next appears.

years after=year of event − year said
“This time it's real” is a name used by this site. The words on the cards are the words of the original sources

What the figure shows:During every boom, people felt that this time their own era was the real thing. What happened afterward differed from boom to boom.

031950–2052 · A map of predictions

A map of predictions

When were AI predictions made, and how many years ahead did they look?

On the right, we plotted the predictions this site has checked against original sources as points, bands and other marks, using the 47 that have both the year they were made and a target year (“by this year”). This is the map of predictions. The horizontal axis is the year said, the vertical axis is the target year. The dotted diagonal line is where year said equals target year. The farther a point lies above the line, the more distant the prediction.

Move the This year slider and predictions whose deadline has ended are shown in blue, while those still pending and those with no deadline end are shown in purple. Press a point or band to see what it says and what happened afterward.

The points are not colored by right or wrong, because what counts as being right differs from prediction to prediction (for example, Alan Turing's 1950 prediction was about telling humans from machines after of questioning, while the 2002 bet was about a test of 24 hours in total).

years ahead=target year − year said
target year
the year specified in the prediction (predictions with no year are left out)

What the figure shows:Placing 47 predictions with both a statement year and a target year on 1 chart shows which target years have passed and which are still ahead. Success and failure are not color-coded, because each prediction uses a different definition of success.

04Distribution and median

How far ahead have predictions looked?

Predictions of “how many more years” cluster at how many years ahead?

For the 47 predictions on the map, we counted target year − year said (how many years ahead) and drew the distribution (how the values are spread out) as a bar chart. The most common range is 5 to 9 years ahead. The middle value (the median) is 9 years ahead, and by period, the later the prediction was made after 2000, the nearer the future it looks at.

The median is the middle value when the numbers are lined up in order. Unlike the mean, it hardly moves even if a single extreme value such as 100 years ahead is added. In the figure on the right, switch "Include an outlier prediction (from 50 years out)" and compare how the mean and the median move.

However, the records on this site are a selection of the famous predictions the chapters cover, not every prediction made in the world. The way they are chosen changes the distribution (next spread).

median=the middle value when lined up from smallest mean=total ÷ count
years ahead
target year − year said

What the figure shows:Among 47 predictions, the most common horizon is 5–9 years ahead, and the median is 9 years. An extreme prediction such as 100 years ahead barely changes the median but greatly changes the mean.

Median for each period of saying
05How the sample is chosen

Collecting only the famous predictions

If we collect predictions differently, does the “how many years ahead” answer change too?

The predictions that survive in history books and on this site are not all the predictions. Bold predictions that people talked about later are the ones most likely to be recorded. This is called selection bias.

The figure on the right is a world of 400 predictions made up by this site. We decide that bold predictions about the near future are more likely to become famous, and pick out only the famous ones. Raise the Fame bias (nearer futures) slider and the median “years ahead” of the selected predictions drifts away from the median of the whole set.

A 2012 study examined 95 collected predictions and found that was the most common. In 2016, AI Impacts pointed out errors in this list, removing duplicates and summaries of surveys and correcting it to 65 predictions. What you collect and what you remove changes what you are counting.

chance of being selected ∝ fame bias
The model's predictions and the way fame bias is set were made up by this site

What the figure shows:If bold, near-term predictions are more likely to become famous and survive, the median time horizon from famous predictions alone moves away from the median for all predictions.

The distribution of “years ahead” for all predictions and for the selected ones
062012 · A data error

The note at the top of the paper

What if a famous study's conclusion came from misreading the data?

A 2012 paper collected 95 predictions of when AI would arrive. It found that was the most common prediction, and that the predictions of experts and non-experts could not be told apart. “AI predictions are always 15 to 25 years away” became a much-quoted line.

The first page of the paper as published now carries a note: . The error was a misreading of the column that separates experts from non-experts (pointed out by AI Impacts in 2016).

The figure on the right is a small table made by this site. Shift the “Expert?” column down one row at a time, and the difference between the averages of the two groups changes. Misreading just one column makes the conclusion “they can't be told apart” appear and disappear.

group difference=expert mean − non-expert mean
The numbers in the model's table were made up by this site (they are not the numbers in the original list)
What you think you knowThe popular story:AI predictions are always 15 to 25 years away
The original source says:The original paper now carries the note . But the error concerns how experts were classified, and the note does not tell us whether the 15-to-25-year finding itself collapsed.

What the figure shows:Shifting the expert-status column by just 1 row changes the difference between the 2 groups' means, making a conclusion of no distinguishable difference appear or disappear. The 2012 paper now carries a note about data errors.

072022 · The corrected list

Does the year said link to years ahead?

Has the way people say “how many more years” changed between old and new predictions?

In the list AI Impacts corrected (65 predictions), the median time for human-level AI to appear was 2033 or 2037 (there are two ways to read it). Comparing predictions from before and after 2000 also gives similar distributions of “how many more years,” and the correlation between the year of the prediction and the number of years was small, 0.13.

Correlation is how strongly two numbers move together. It lies between −1 and 1, and the closer to 0, the weaker the relationship. The figure on the right plots this site's 47 predictions, with the year said on the horizontal axis and years ahead on the vertical axis, and calculates the correlation on the spot. For this site's 47 predictions it is about −0.34 (later predictions look at nearer futures). But the predictions were collected differently, so it cannot be compared directly with 0.13. Drag a point and you can see how a single outlier moves the correlation a lot.

r=Σ(x − x̄)(y − ȳ) / √{ Σ(x − x̄)2 · Σ(y − ȳ)2 }
x
year said
y
years ahead
x̄ and ȳ
the mean of each

What the figure shows:Correlation measures how 2 numbers move together, and is about −0.34 for this site's 47 predictions. But 1 extreme point can change it greatly, and it cannot be compared directly with AI Impacts' 0.13, based on a differently collected set.

081843–2025 · Realized late

Predictions don't only miss

What happened afterward to predictions that did not come true by the target year?

In 1843, Ada Lovelace wrote that (she meant the Analytical Engine). The Analytical Engine itself was never built, but about 110 years later, in 1956, a movement of a string quartet composed by a computer was performed. In 1957, Herbert Simon and Allen Newell predicted that within 10 years a computer would be world chess champion. A computer beat a world champion in a game about 40 years later, in 1997.

Some predictions came true within the deadline. The International Mathematical Olympiad gold-medal level, which in 2022 was judged to have a probability below 8% to above 16%, was reached in July 2025 (Chapter 12).

The figure on the right puts the year said, the target year and the year it actually happened on a single line. When we line up the delays, some are decades late and some came within the deadline. But whether what “actually happened” is the same thing the prediction meant has to be checked one by one.

delay=year it actually happened − target year
For predictions with no target year, we count from the year said

What the figure shows:Some predictions missed their target years but came true decades later, while others were met by their deadlines. Each case still needs checking to see whether what happened matches what was predicted.

092005–2026 · The speed line

1019 by 2025

What is the source of the prediction about simulating a brain in 2025 that appears in a national teaching guide?

(translated), wrote a 2020 teaching guide for teachers of the high-school “Information II” course (Japan's advanced informatics subject). The source is a figure in Ray Kurzweil's 2005 book. It draws a line along which supercomputer speed (FLOPS: the number of decimal-point calculations per second) doubles every 1.2 years, and where the line reaches 1019 FLOPS it puts the label for the speed needed to simulate the neurons of a brain (2025). It is not a brain simulation itself; it is a forecast of speed.

Let's check the answer. On the same yardstick as the original figure (the TOP500 ranking), even the No. 1 machine in November 2025 reached 1.809 exa (1018) FLOPS, about one fifth of 1019 (1/5.5). On another yardstick that mixes in lower-precision calculations, three machines exceeded it. Try moving Years to double in the figure on the right.

speed(t)=1016 × 2(t − 2013) / T
T
years to double (1.2 in the original figure)
t
year. In the original figure it is 1016 in 2013

What the figure shows:The claim of fully simulating a brain in 2025 began as an extrapolation of supercomputer speed. A small change in doubling time shifts the year for reaching 10 to the power of 19 greatly, and the actual number 1 computer has not reached it yet.

102005→2020 · Telephone game

Where did the label's wording change?

What changed between a label on an English figure and a sentence in a Japanese teaching guide?

① The figure in Ray Kurzweil's 2005 book (in English). ② A figure in materials presented by Mr. Kitani at a Ministry of Internal Affairs and Communications meeting on February 13, 2014. Its heading is (translated). ③ The figure in the Ministry's 2014 white paper on information and communications. ④ A sentence in the national teaching guide for teachers of “Information II” in 2020.

Two things changed. The word (translated) was added, which the 2025 label (neuron simulation for uploading) did not have. The 2013 label became (translated). The teaching guide sentence opens with the caveat (translated).

Step through the figure on the right one label at a time, and ideas that stayed, ideas that vanished and ideas that were added get marked.

ideas that stayed=ideas in the earlier label ∩ ideas in the next label
∩
what is in both (how the ideas are divided up is this site's own)
What you think you knowThe popular story:By 2025 a computer will be able to imitate a whole human brain, as a prediction
The original source says:The original figure overlays the year when the speed line of supercomputers reaches 1019 FLOPS with an estimate that this is what simulating a brain's neurons requires. It does not say that anyone will simulate a brain in 2025.

What the figure shows:As an English diagram label became text in Japanese teaching materials, “fully” was added and the idea of being needed for brain functional simulation became “performance capable of achieving human-like intelligent processing” (translated), though the original diagram did not say anyone would simulate a brain in 2025. Unlike chapter 12's Japanese-to-Japanese message chain, characters hardly overlap across English and Japanese, so comparing ideas instead, using retained ideas = previous label's ideas ∩ next label's ideas, reveals that only 2 ideas, the speed forecast and 2025, remained across all 4 labels while the surrounding wording changed.

112016 · Peaks and troughs

Is the hype-cycle chart true?

Does every new technology pass from a peak of expectation through a trough of disillusionment?

The market-research firm Gartner's Hype Cycle is a chart of how expectations for a new technology rise, fall into a trough of disillusionment, and eventually settle down. According to a 2016 study, the chart is built by combining two curves: a bell-shaped curve for people's expectations and an S-shaped curve for the technology's maturing. In the figure on the right, change “Peak height” or “Start of maturity” and the depth and position of the trough change.

When that study checked Gartner's own past records, the actual course of events and the pattern in the chart did not match. “The same flow every time” is a shape that appears when you line things up, and it is not a fixed law.

In the same company's view for Japan, artificial intelligence was placed in the “Trough of Disillusionment” in 2019. In 2025 generative AI was positioned at the (translated), and one news headline wrote (translated) (in the chart, it sits at the boundary between the peak and the disillusionment phase).

expectation=bell curve+S-curve
The heights and speeds of the model's curves are numbers chosen by this site
What you think you knowThe popular story:Every new technology goes from a peak of expectation through a trough of disillusionment and then settles
The original source says:When researchers checked the actual records, it did not follow the standard pattern.

What the figure shows:The diagram of expectation peaks and valleys adds a bell-shaped curve of human expectations to an S-shaped curve of technology, and changing their heights or speeds deepens the valley or makes it disappear. Checking actual records did not support saying that they followed this pattern.

12Yardsticks

How do you measure a winter?

Can an be decided by a number?

The years of the differ by source (Chapter 5). Japan's national white paper calls the 1970s a (translated), and Nils Nilsson (2010), who wrote a history of AI, called about 1975–1985 . An early use of the term dates from 1984, when it was the name of the worst thing that might be coming.

The figure on the right applies a winter rule to the number of statements in the Japanese Diet in which “AI” appeared in the sense of artificial intelligence (counted by this site from the Diet minutes). A year counts as a winter when the count has fallen from a peak by at least the threshold. With the threshold at 30%, the drop from 593 in 2019 to 336 in 2021 becomes a winter. But this site has found no source that called this period a winter. The reason for the decline in 2020–2021 cannot be pinned to one cause either (it overlaps with the years the infectious disease spread).

Whether a winter is declared changes with what you count and where you draw the threshold. Seen through research funding, there is also a view that there has been no break since the third boom.

winter ⇔ (peak count − count that year) ÷ peak count ≥ threshold
threshold
a ratio this site sets provisionally
2026 is left out because the year is not over

What the figure shows:Calling a period a winter depends on what is counted and where the threshold is set. With a 30% threshold for parliamentary mentions, 2020–2021 becomes a winter, but no source calling that period a winter has been found.

132025– · Think for yourself

Will a winter come? Just the materials

Will a winter come after the fourth boom?

This site does not give an answer. It only lays out the materials.

Materials suggesting a winter may come: in October 2025, the Bank of England wrote that focused on AI. In the view of a Japanese research firm (2025), generative AI is near the top of the peak of expectations.

Materials suggesting a winter may not come: at a 2023 roundtable of the Japanese Society for Artificial Intelligence, because funding had not been cut off since the third boom and led into the generative AI boom, voices said (translated) and (translated).

Place cards of materials on the scale on the right. The tilt depends on how you place them.

difference in placement=number of cards on the “may come” side − number of cards on the “may not come” side
Each card has the same weight. The reader decides where to place it

What the figure shows:This site lays out evidence without giving an answer. Which evidence readers put on each side changes how their balance tilts.

14From every chapter

Gathering everything we still don't know

What in the history of AI is still not known?

Every chapter of this site ends with “What we still don't know.” The figure on the right gathers them onto one sheet. Press a tile to see what is inside.

What is happening inside today's large AI systems (Chapter 12). How fast progress will be from here (Chapter 12). Whether a winter will come (Chapters 12 and 13). How to measure an (Chapter 5). What it means for a machine to or to “understand” (Chapters 2 and 5). From what point we can say something was “written by AI” (Chapter 10). The amount of computation needed for the workings of a whole human brain (estimates differ greatly by who estimates). What a machine would have to do to be called human-level AI (the standards differ by person and company).

There are two kinds of things we don't know. Those where the sources have not yet been found (such as figures for 1970s AI research funding, lined up by country and by year), and those where even the experts do not yet have an answer. Press "Split view" and the colors separate.

what we don't know=things whose sources haven't been found+things experts have no answer to yet
The way of dividing them was done by this site

What the figure shows:There are 2 kinds of unknowns: cases where sources have not yet been found, and questions for which even experts have no answer yet.

15Confidence grades

How far has this site checked?

How certain are the events on this site?

Every event carries a confidence grade. Events checked in the original source down to the page or section are “Verified in the original source.” Events where the original source could not be opened but two or more reliable summaries agree are “Confirmed in a secondary summary.” Events backed by only one summary, or where sources disagree and the disagreement is unresolved, are “Weakly confirmed.” Unchecked recollections are “From memory,” and judgments with no source are “Estimate.”

The bars on the right count all the records by chapter, colored by grade. Choose how it was checked with the buttons and checkboxes below, and a decision tree that follows the rules step by step gives the grade.

grade=rules (is it an estimate? → is it from memory? → was it checked to the place in the original source? → how many summaries are there?)
A
Verified in the original source
B
Confirmed in a secondary summary
C
Weakly confirmed
D
From memory
E
Estimate

What the figure shows:Events on this site receive confidence grades 1 at a time, from A to E, by following the checking rules in order. The grade marks how far an event has been checked, rather than whether the source itself is correct.

16Predictions you can check

Write a prediction you can check

What does a prediction that can be checked later actually say?

The predictions whose answers came out clearly had set their rules in advance. The 2022 forecast for the International Mathematical Olympiad said at which competition, and under what rules, a result would count as gold. The 2002 bet on the Turing test fixed even the number of judges and the time of 24 hours in total.

By contrast, predictions with no year, or whose key words are not defined, are hard to check. Shane Legg, who in 2011 predicted the year of human-level AGI, himself wrote .

In the figure on the right, choose the items to write on a prediction card: the deadline, what would count as being right, who judges, and probability. The more of them you fill in, the easier the prediction is to check. The number in the figure counts the items filled in; whether their content is specific needs to be checked separately. At the end, write one prediction of your own and wait for its target year.

proportion of items written=number of items written ÷ 4
The four items are a yardstick chosen by this site

What the figure shows:Having all 4 elements, a year, a definition of success, a judge, and a probability, makes a prediction easier to check later. Predictions with clear outcomes had set their rules beforehand.

Closing

Starting from what we still don't know

Stack the four booms and the same flow shows up again and again: expectations rise, a prediction of the form “by this year” appears, and in that year it is not fulfilled in the form predicted. But how a winter arrives differs from boom to boom, and there was no winter between the third and fourth booms. “The same flow every time” is just how things look when you line them up; it is not a fixed law.

Analysis of predictions also changes with how they are chosen and counted. The famous 2012 study carries a note about a data error, and the sentence in the national teaching guide saying that by 2025 performance would reach the level needed to fully simulate a human brain turned out, when traced to its source, to be a forecast of speed. Change the yardstick and the answer changes.

There is still a great deal we don't know. What is happening inside today's large AI systems. How fast progress will go from here. Whether a winter will come after the fourth boom. This site does not give an answer. It hands you the materials and the ways to check them. When the target year comes, please check the answer with your own hands.