CHAPTER 06/1975–1990

The Second Boom Begins

Writing experts' knowledge into computers (1975–1990)

What if we wrote the rules inside an expert's head as rules, so that a computer could think like an expert? In the 1980s this idea was put to work in factories and subways, and in Japan it was called a “boom”. Open the sources, and behind it you always find the work of collecting rules and keeping them fixed.

011965–1977 · The power of knowledge

The Power Is in the Knowledge

Does a clever computer need good ways of thinking, or a huge amount of knowledge?

In 1965, Edward Feigenbaum and his colleagues, who had moved to Stanford University, built the experience of chemists reading mass-spectrometry data into DENDRAL, a program that lists every possible molecular structure. They wrote it as rules, and the candidates were narrowed down. In an example from Nilsson (2010), 14,715,813 structures were cut to about 1,284,792 by the rules about the data, and to just one when another measurement was added.

The figure on the right lines up 6 parts of 3 kinds in 729 possible ways and narrows them by adding rules. The more knowledge is added, the more the number of things to check shrinks, by orders of magnitude.

In a 1970 paper the three authors wrote: In 1977, Feigenbaum called the work of moving experts' knowledge into computers knowledge engineering, and summed it up as .

Nleft ≈ N × r₁ × r₂ × … × rk
N
number of all candidates
ri
fraction that remains after rule i (≈ is a rough guide when the rules do not affect each other)
What you think you knowThe popular story:A government white paper (2016) says (translated)
The original source says:the one that turned experts' experience into rules was DENDRAL (from 1965), which came first, and in the title of a 1993 paper a person involved calls DENDRAL . The answer changes depending on where you start counting expert systems.

What the figure shows:Chapter 4's DENDRAL generated all candidates and removed those that did not fit its knowledge; this chapter changes the viewpoint, keeping the same elimination procedure but showing that adding expert knowledge as if–then cards, 1 at a time, reduces the remaining candidates by multiplication until far fewer remain. Intelligence therefore comes from plentiful knowledge more than clever reasoning methods, as in the 1970 paper and the 1977 statement “in the knowledge is the power.”

021972–1978 · MYCIN

Confidence Factors for

How do you connect rules that contain a ?

From about 1972, Edward Shortliffe and his colleagues at Stanford University built MYCIN, a program that advises doctors on choosing drugs for bacterial infections. They wrote doctors' knowledge as rules of the form: if (the lab result is ...) then (the germ is probably ...). The rules numbered about 200 at first and about 500 by 1978.

Each rule carries a confidence factor (from −1 to +1) that says how sure it is. When a condition is uncertain, multiply the rule's confidence factor by how certain the condition is. In an example from the developers' book, a rule with confidence factor 0.7 whose condition is 0.6 certain gives 0.42. When other rules support the same conclusion, they are added together with the formula below.

In the figure on the right (a bicycle example, not a medical one), adding weak rules pushes the confidence toward 1, however weak they are. The book says it chose this way of adding by intuition, not by probability theory. A textbook cited by Nilsson (2010) says that as the rules grew in number, the confidence factors of other rules also had to be corrected.

combined confidence = x + y(1 − x)
x
confidence so far
y
confidence given by the new rule (the rule's confidence × how certain its condition is; with two or more conditions, the lowest certainty)

What the figure shows:Rules carry certainty factors that are weakened by multiplication when their conditions are uncertain. Combining rules supporting the same conclusion brings certainty closer to 1 even if each rule is weak, using a combination method chosen intuitively.

Number of rules used, and the combined confidence
031970s · Inference engines

Forward and Backward

When there are many rules, which rule does the machine use first?

A program that is given experts' knowledge as rules and produces answers along with the reasons is called an expert system. The part that chains the rules together to reach an answer is the inference engine. The book by the people who made MYCIN (1984) divided the ways of chaining into two. Forward (from the data) starts from the known facts and links the rules from the “if” to the “then”. Backward (from the goal) starts from the goal to be checked, traces back, and asks only for the facts that are missing. MYCIN mostly worked backward, and was also described as a program that gathers evidence.

Compare the two in the figure on the right (a bicycle example). Forward asks every question and then uses the rules, while backward asks only the questions related to the goal.

In MYCIN the collection of rules (the knowledge base) and the inference engine were separate, so an empty shell with the medical rules removed, EMYCIN (E is for empty), was built, and used for consultation systems such as tax planning.

Forward: facts → conclusion  Backward: goal → question
Forward
go from the “if” (condition) to the “then” (conclusion)
Backward
trace back from the “then” to the “if”, and ask only about what is missing

What the figure shows:Forward reasoning asks for all known facts before connecting rules, while backward reasoning starts from the goal and asks only for missing facts. Backward reasoning asks far fewer questions.

041970s · Explanation

A Machine You Can Ask “Why?”

How can people come to trust the answer a machine gives?

MYCIN's developers made explaining its reasons an important goal from the start. When MYCIN asked a question, the user could type WHY (why are you asking?). MYCIN then showed the higher goal it was checking and the rule that connects that goal to the question. Repeating WHY climbed higher still. Typing HOW (how did you find that out?) showed the rule it had used, or that the user had given that answer.

The figure on the right is a bicycle consultation. Answer the questions and press "Why?" a few times. In the figure, the chain of rules being checked appears.

In backward reasoning, every question comes up to check the condition of some rule. That is why the reason can be answered with a chain of rules.

Why? → higher goal + rule How? → rule / answer
Goal
the conclusion being checked right now
Chain
the links of rules from the goal down to the question

Chapter 18 of the book has an example of a WHY and HOW exchange. It is a medical example, so the figure uses a bicycle instead.

What the figure shows:In a machine that follows rules backward, every question checks a condition in a rule. It can therefore answer “Why are you asking?” by showing the chain of rules.

051974 · Frames

Knowledge as Templates of Situations

Why does hearing just “birthday party” make you think of cake and presents?

In June 1974, Marvin Minsky of MIT put forward, in his report , the idea that when people meet a new situation, they pull a structure called a frame out of memory and adjust its details to fit reality. A frame is , and it has empty slots. The slots are temporarily filled with the values that are usually true (default values). The report gave the example of going to a child's birthday party.

In the figure on the right, have it read the story one sentence at a time. The values that are written fill the slots, and for what is not written it assumes the default values, with a . If a value differs from the default, it turns purple.

Minsky noted that he wrote it , and in the last section he wrote: . He did not build a frame system himself; students built them a few years later (Nilsson 2010).

What you think you knowThe popular story:“Second-boom AI means writing lots of knowledge as ‘if ... then ...’ rules or logical formulas” is how it tends to be lumped together
The original source says:frames, one of the leading ideas of the same period, tried to represent knowledge as templates that hold expectations of how things usually are.

What the figure shows:A frame is “a data-structure for representing a stereotyped situation”: a template for a common scene, with blanks provisionally filled with usual values. Reading a story fills in what is stated, uses default values to make tentative guesses about unstated parts, and allows differences to be noticed.

061979 · How MYCIN scored

Scoring with the Names Hidden

How can we fairly check whether a machine's answer is good?

In an evaluation in 1979, 10 prescriptions were collected for each of 10 meningitis patients: from MYCIN, from five Stanford infectious-disease faculty, from an infectious-disease fellow, from an internal-medicine resident, from a medical student, and the treatment actually given. Eight infectious-disease specialists from outside Stanford scored them one by one without being able to tell whose prescription it was (8 raters × 100 = 800 ratings).

65% of MYCIN's prescriptions were , against 42.5–62.5% (average 55.5%) for the five faculty. In the cases where most of the specialists accepted the prescription, MYCIN had 7 out of 10. In the figure on the right, switch the standard and reveal the names.

Even so, the book by its builders (1984) says . They had also wanted over 90% approval from most of the specialists before routine use.

What you think you knowThe popular story:“MYCIN was more accurate than specialists, but it was not used in hospitals because of legal and liability problems” is what people tend to say
The original source says:the reasons given in the builders' book are the cost and staffing of adding knowledge, the wish to move on to the next research, and above all, in their words, performance, for ordinary reasons. Most of these were problems of usability and effort.

What the figure shows:When prescriptions were rated without revealing who wrote them, MYCIN's prescriptions were judged as good as, or better than, those of medical teachers. Even so, it was not used in routine clinical care.

071979–1982 · PROSPECTOR

Weighing the Odds with Multipliers

How can you estimate an ore deposit underground from clues on the surface?

SRI's PROSPECTOR was an AI that advised geologists searching for minerals, and an analysis of how well it performed was presented at the international conference in Tokyo in 1979. Its rules linked together into an inference network: a rock with crystal-shaped cavities is a sign of sulfides, and barite above sulfides may mean a massive sulfide deposit, and so on.

Unlike MYCIN's confidence factors, PROSPECTOR used probability and Bayes' rule. For each rule the expert gives two numbers: how many times the odds multiply when the condition is true (LS), and how many times when it is not (LN). In the figure on the right, pressing a clue sends the change through the network and the probability changes (the multipliers are numbers made up for this site).

In 1982, from map data for Mount Tolman (Washington State), it drew a map of how promising the area was for molybdenum deposits, on a scale from +5 to −5.

odds ← odds × LS (yes) or × LN (no)  probability = odds ÷ (1 + odds)
odds
chance it happens ÷ chance it does not
LS, LN
two multipliers decided by the expert
What you think you knowThe popular story:“PROSPECTOR found an ore deposit that humans had not found” is what people tend to say
The original source says:by the developers' account, it was at a place where a mining company had already found the deposit by drilling more than 200 holes, and it picked out and . And . This is confirmed only through the book of one of the developers.

What the figure shows:PROSPECTOR estimated the chance of a mineral deposit by multiplying the odds by expert-chosen factors, LS for a yes clue and LN for a no clue. The probability rises and falls as the network of rules is followed.

081980 · R1 (XCON)

Noticing the Missing Parts

What kind of rules turn a computer order into an assembly diagram?

John McDermott of Carnegie Mellon University built R1 (called XCON inside the company), which decides the configuration of parts from orders for DEC's VAX computers. One machine normally has about 90 parts, and orders often left out parts that were needed. R1 noticed this, filled the gaps, and drew up the layout. From January 1980 it was used in everyday work at DEC's factory.

R1 looked at its working notes, found all the rules whose conditions fit, ran one of them, and repeated this. In the 1980 paper it had 772 rules. One order took 1,056 rule runs on average, and the computing time averaged 2.5 minutes. In the figure on the right (the parts and rules are an example made up for this site), press "Run once".

① Find every rule whose conditions are met → ② Pick one → ③ Run it and rewrite the notes → ①
Working notes
the current task (checking, placing, connecting) and the information known so far

What the figure shows:R1 repeatedly reads working notes, finds rules whose conditions are met, executes 1, and updates the notes. In doing so, it notices and supplies components missing from an order.

091981 · Japan

Translating by Example Sentences

Can we translate without writing out all the rules of grammar?

Makoto Nagao of Kyoto University wrote that earlier machine translation had a contradiction: of its translation ability. So he proposed a system that, like a person learning a foreign language, holds many pairs of example sentences in English and Japanese. It looks for the example sentence most similar to the sentence to be translated, and swaps in words to translate it. This idea was written in a manuscript for a NATO conference in October 1981. That conference was held the week after the international Fifth Generation conference in Tokyo (October 19–22).

In the manuscript's example, from the example sentence A man eats vegetables. (人は野菜をたべる。), He eats potatoes. is translated as (彼はじゃがいもをたべる。). That works because man and he, and vegetable and potato, are close in the thesaurus. Acid eats metal. is not close to this example, so a different example is needed (酸は金属を侵す。). Try it in the figure on the right.

The opening essay of a 2015 society journal says that from this (translated), research grew into translation that uses huge amounts of text data and statistics.

What you think you knowThe popular story:“Makoto Nagao's 1984 paper started machine translation from examples” is what people say
The original source says:the idea was already written in the October 1981 conference manuscript. It appeared in print in 1984.

What the figure shows:The system finds the example sentence most similar to the sentence to translate and substitutes related words using a thesaurus. Without a similar example it cannot translate, so adding examples increases the range of sentences it can handle.

101982–1986 · Japan

Which Boom Is This?

In 1980s Japan, what was the AI craze called at the time?

In the National Diet Library's full-text search, a magazine from October 1982 already has the sentence (translated). The same magazine the next month called the boom of about 20 years earlier (translated). In 1985, a book has (translated), the Diet has (translated) (meaning that now is the second boom), and a magazine feature is titled (translated), so the way of counting was all over the place.

The trigger also differed from writer to writer: the Fifth Generation project, MYCIN's success, Feigenbaum's knowledge engineering, and tools for building AI were all named. Even in the middle of the boom there were cool voices saying (translated).

In July 1986, more than 700 people gathered and the Japanese Society for Artificial Intelligence was founded. Its prospectus noted that the United States has had the AAAI since 1980, but (translated). In the figure on the right, look at the names one at a time.

What the figure shows:During the 1980s AI boom itself, writers already called it the first boom, the second boom, or a return, with different ways of counting and different explanations of what started it.

111984 · Hopes and warnings

Two Rooms at the Same Conference

In the middle of the boom, did the people selling AI and the people researching it see the same future?

In August 1984, the American Association for Artificial Intelligence (AAAI) held its conference at the University of Texas at Austin. In the exhibition hall, the brochure for TIMM, an AI tool that builds in experts' knowledge, boasted and said that expert systems do not get sick, quit, or take early retirement. To a reporter, the voices of the sellers sometimes sounded like .

In a discussion at the same conference, “The Dark Ages of AI”, the chair John McDermott laid out a . Within about five years, America's Strategic Computing program fails, Japan's Fifth Generation gets stuck, new companies go bankrupt, funding dries up, and everyone changes the name of their research. He said some people call this . In the figure on the right, move through the years and see which item happened when.

What you think you knowThe popular story:“The 1984 discussion predicted the AI winter exactly (a warning that came true)” is what people tend to say
The original source says:the chair himself said . Much of the scenario did happen afterward, but not all at once five years later.

What the figure shows:At the same 1984 conference, the exhibition declared “We’ve built a better brain,” while a discussion room considered a “worst case scenario.” Many parts of that scenario later happened, but not all at once 5 years later.

121983–1984 · Common sense

Amniotic Fluid in a Male Patient

Can a machine notice that something is “wrong” when no rule says so?

A footnote in the MYCIN book (1984) tells this story. John McCarthy entered amniotic fluid as the culture site (the source of the specimen) for a male patient, and MYCIN did not notice the mistake and accepted it. This was because the common sense that everyone knows, that men have no amniotic fluid, was written nowhere in the rules.

In his 1984 piece , McCarthy pointed out that MYCIN has no view of what happens after a treatment, and cannot even answer . Nilsson (2010) uses the word brittle for the weakness of such systems.

In the figure on the right (a bicycle consultation), choose an impossible answer. Adding common-sense rules lets the system notice, but as the kinds of answers grow, the number of pairs to check for compatibility increases sharply.

number of pairs to check = n(n − 1) / 2
n
number of kinds of answers (facts). With n=100 there are 4,950 pairs, and with 1,000 there are 499,500
What you think you knowThe popular story:“There is a story that McCarthy teased MYCIN (a rumor)” is what has been passed down
The original source says:MYCIN's own developers give as the source in a footnote of their 1984 book. But this story does not appear in McCarthy's own 1984 piece.

What the figure shows:A machine does not know common sense absent from its rules, such as men not having amniotic fluid, so it accepts impossible answers. Adding common-sense rules lets it notice, but the number of combinations to check grows rapidly.

131985 · Prediction

Common Sense, One Encyclopedia's Worth

How many years would it take to write in all of common sense?

In 1985, Douglas Lenat and his colleagues at MCC in Austin, Texas announced the CYC project. It is an attempt to overcome the of expert systems and the difficulty of acquiring knowledge with a large body of common sense. Over the next 10 years they would write the knowledge of a one-volume encyclopedia (about 30,000 entries) and the common sense underneath it. About 400 entries would be written carefully by themselves, and the rest copied and corrected by many typists. The effort was . They also wrote that if they had not got there in about 10 years, they would drastically rethink the project.

In 2023, Lenat and Gary Marcus called CYC , and wrote that its knowledge base is made of tens of millions of hand-written assertions, built over 40 years and 2,000 person-years. Move through the years in the figure on the right.

But the 150 person-years were for the people typing in the encyclopedia, and the 2,000 person-years for the whole knowledge base, so the scope of the count is not the same. How much common sense is enough is unknown in 1985, and unknown today.

person-years = number of people × number of years  2,000 person-years ÷ 40 years = 50 people on average
Person-year
the amount of work one person does in one year

What the figure shows:The 1985 CYC plan aimed to write an encyclopedia's worth of common sense in 10 years and about 150 person-years. By 2023, it had taken 40 years and 2,000 person-years, though the 2 totals cover different scopes.

141982–1987 · Japan

Translation Software and an “Illusion”

How far could machine translation by rules be used in the 1980s?

In fiscal 1982, the national machine translation project Mu (of the Science and Technology Agency) began. It aimed to show that abstracts of scientific and technical papers could be translated between Japanese and English. It was led by Makoto Nagao and others at Kyoto University, and continued until 1986. They built grammars and dictionaries for three stages: analyze the sentence, convert its structure into the form of the other language, and generate the sentence.

Companies also released translation software (Fujitsu's ATLAS in 1984, Hitachi's HICATS/JE from May 1986, and others). In September 1987 at the machine translation summit in Hakone, Nagao said that . To users' expectation that he answered , and said that companies' exaggerated advertising was one cause. Mazda used it to translate maintenance manuals. At first only 40% of the translations were , but after adjusting it with Fujitsu, the accuracy reached about 80%, it reported.

In the figure on the right, try adding a dictionary of technical terms. Sentences from the manual become translatable, but the translation of ordinary sentences does not change.

What you think you knowThe popular story:“Machine translation came to be used in real work much later (translation by deep learning in the 2010s)” is what people tend to think
The original source says:according to the record of the 1987 meeting, more than ten companies in Japan were selling translation software, and some companies, like Mazda, used it to translate manuals.

What the figure shows:Adding a subject dictionary let a rule-based translator handle that subject's texts, such as maintenance manuals, but ordinary sentences remained beyond it. The idea that it could translate any sentence was an illusion.

151985 · Japan

A Robot That Accompanies Your Singing

If a person starts singing a little higher, how does the accompaniment keep up?

Several research labs at Waseda University began preparing in 1980, and from 1981 built WABOT-2, a robot that plays musical instruments. Rather than a robot that does everything, they narrowed the goal to (translated), which takes both dexterity and intelligence. It talks with people in Japanese, reads a commercially printed score with a camera in about 15 seconds, and plays an electronic organ with the fingers of both hands and both feet. It has 50 degrees of freedom in total, and used 53 small computers for motion control alone.

To follow a singer, it makes note data on the spot from the singing voice and compares it with the stored score to find the gap. When the gap went over a set value (the threshold), it transposed the piece to match the voice in the next performance. Pitch is written in base 12, where the upper digit shows the octave and the lower digit the semitone. The control that ties everything together was written as if-then rules. In the figure on the right, move the singer's gap.

number of semitones = 12 × log₂(frequency of the singing ÷ frequency of the note in the score)
log₂
the power to which 2 is raised to get that number
Frequency doubled
1 octave (12 semitones)
What you think you knowThe popular story:“The one that played the electronic organ at the Tsukuba Expo was Waseda University's WABOT-2” is what people tend to say
The original source says:in the developers' papers of 1985 and 1987, the performer at the Japanese Government Pavilion theme hall of the Science Expo was WASUBOT, built by Sumitomo Electric Industries on the basis of WABOT-2.

What the figure shows:WABOT-2 converted singing into note data and compared it with a stored score; when the difference exceeded a threshold, it transposed the music in its next performance to match the singing.

161965 · Fuzzy sets

From How Many cm Is Someone “Tall”?

Where is the boundary of a “tall person”? How many cm?

In 1965, Lotfi Zadeh of the University of California, Berkeley, in his paper , described collections with no clear boundary, such as , by a number from 0 to 1 (the degree of membership) that says how much each element belongs. As an example of the , the paper gives values such as f(10) = 0.2 and f(100) = 0.95.

He also set rules for calculating. “Not A” is 1 − f, “A or B” is the larger, and “A and B” is the smaller. In the figure on the right, compare an ordinary set that jumps from 0 to 1 at 175 cm with a smooth fuzzy set. The paper also says that this is a completely different idea from statistics.

In 1980 he looked back and said that he had known from the start that the word fuzzy has a belittling ring.

Not A: 1 − fA A or B: max(fA, fB) A and B: min(fA, fB)
fA
degree of membership in set A (0–1)
max, min
the larger, the smaller

What the figure shows:Chapter 4 represented tallness as a degree from 0 to 1, with an ordinary set jumping from 0 to 1 at 175 cm and a fuzzy set rising smoothly; Zadeh's paper extended this to numbers much greater than 1, such as f(10) = 0.2 and f(100) = 0.95, and calculated with vague terms using NOT = 1 − f, OR = the larger value, and AND = the smaller value. This gives results impossible for ordinary sets or probabilities, such as much greater AND not much greater having a nonzero value, showing that degree of membership is different from probability.

171987 · Japan

Stopping a Subway with Fuzzy Logic

How does a skilled driver stop exactly on the mark without jolting the train?

On July 15, 1987, the Sendai City subway opened. The automatic train operation device developed by Hitachi used (translated). According to the company's 1988 article, it combined three things: AI (knowledge engineering) rules written in (translated) (the if-then form); a simulation that stands in for the skill of an expert driver; and fuzzy theory, which expresses several criteria as satisfaction degrees from 0 to 1 and combines them. Ride comfort, stopping accuracy and energy saving improved, and the article calls it (translated) (the words of the company that built it).

The figure on the right is a simple example of the same way of thinking, not Sendai's actual device. Compare three methods by their stopping-position error and the change in braking (the jolt): using just one rule, mixing several rules, and predicting ahead and choosing the brake with the highest satisfaction.

satisfaction = min(satisfaction with the stopping position, satisfaction with ride comfort) → choose the brake with the highest value
Satisfaction with the stopping position
predicted ahead, 1 when the train stops close to the target
Satisfaction with ride comfort
1 when the change in braking is small (the setting in this figure)
What you think you knowThe popular story:“Fuzzy is a buzzword for home appliances” is what people tend to think
The original source says:before appliances, it was used in the automatic operation of the Sendai City subway that opened in 1987.

What the figure shows:Using only 1 rule makes braking jerky, while blending rules makes it smooth. Predicting ahead and choosing the braking action with the highest satisfaction brings an accurate stop with little jolting.

Brake strength over time
181980–1990 · Checking a prediction

The “Standard Tool” Became a Washer

Where did the forecast for fuzzy logic get its answer?

In September 1980, Zadeh wrote that fuzzy set theory was starting to be used everywhere from industrial process control to medical diagnosis, and was . He gave no deadline year.

Seven years later, in 1987, the Sendai City subway adopted it, and in 1989, 48 companies founded the Laboratory for International Fuzzy Engineering Research (LIFE). On February 1, 1990, Matsushita Electric released a washing machine, “Aisaigo Day Fuzzy”. From the time it takes for the cloudiness of the water to settle and the transmittance once it has settled, it decides the washing time with 6 rules, such as (translated). That year, the gold prize in the new-word category of the year's buzzword awards went to . In the figure on the right, change the amount and kind of dirt.

washing time = Σ(fit × time of the rule) ÷ Σ fit
Fit
min(degree of T, degree of V)
T
time until the cloudiness settles
V
transmittance once it has settled

What the figure shows:Fuzzy logic entered washing machines 10 years after Zadeh wrote that it was “likely to become —in the not distant future —a standard tool.” The machines blended 6 rules to choose washing time from light transmission and the time it took for cloudiness to settle.

Change of transmittance over time (the curves and rules are an example made up for this site)
191980–1989 · Upkeep

The Rules Kept Growing

Once you build an AI with rules in it, are you done?

The rules of R1 (XCON) kept growing from 772 in June 1980. When DEC took over the upkeep there were about 1,000, around July 1982 about 2,000, and in 1984 2,500, and in 1989 the related systems together had 17,500. This was because each time DEC released a new product, the assembly work itself changed.

According to an article written by DEC people in 1984, continuing to add knowledge took about four people's work every year, and, as they said of upkeep, , and it needs specially trained people. In that same year, 1984, the brochure in the exhibition hall boasted that expert systems never quit or retire.

New rules need to be checked for contradiction with the rules that came before. In the figure on the right, press a dot to see the number of rules at that time and the number of pairs.

number of pairs = n(n − 1) / 2
n
number of rules. With 772 there are 297,606 pairs, and with 17,500 about 153 million pairs
What you think you knowThe popular story:“XCON was a great success that saved $40 million every year” is what people tend to say
The original source says:that figure is an estimate in a 1989 paper by a DEC person, , and this site has confirmed it only through Nilsson's citation. The 1984 article by DEC people gives no dollar amount, and describes the effort of upkeep.

What the figure shows:XCON's rules grew from 772 to 17,500, requiring roughly 4 people's worth of maintenance work each year. As rules increase, the number of pairs to check for contradictions becomes very large.

201977– · Acquiring knowledge

Widening the Narrow Pipe

How do you move the knowledge in an expert's head into a computer?

In 1977, in the invited paper , Feigenbaum wrote that . A bottleneck is the narrowest passage, like the neck of a bottle. There was also a case where drawing out the knowledge took little effort: PUFF, a program for diagnosing lung tests, got 55 rules from under 50 hours of exchanges with experts, under 10 person-weeks of work.

The same paper introduced, as one way to widen the pipe, META-DENDRAL, a program that automatically finds rules from measurement data on molecules whose structures are known. The rules it found were said to be on a par with the experts' rules in quality. The figure on the right shows the simplest method: finding rules one at a time from examples that come with answers.

Rules written by people kept needing upkeep. The road of learning from data grows in Chapters 8 and 9.

What you think you knowThe popular story:“Second-boom AI could only have experts' knowledge written in by hand, and learning from data begins with the third boom” is how people tend to divide it
The original source says:the 1977 paper that wrote about the bottleneck itself introduced, as one answer to it, META-DENDRAL, which finds rules automatically from data.

What the figure shows:Getting knowledge out of experts was a bottleneck, a narrow passage slowing progress. One way to widen it was to find rules automatically from examples with known answers, a method already introduced in a 1977 paper.

Closing

What This Chapter Still Doesn't Know

AI that had experts' knowledge written in as rules spread to chemistry, medicine, minerals, factories, translation, subways, and washing machines. But there are numbers and stories we have not yet been able to confirm. For XCON's estimate of , we do not know what was counted as profit. We also do not know who first said, and when, that MYCIN was not used because of legal and liability problems.

Whether the part of the 1984 discussion's scenario where everyone changes the name of their research really happened, this site has not yet confirmed. Nor have we measured how far Zadeh's forecast came true as a standard tool, in the world's fields beyond Japan's subway and home appliances. And how much common sense is enough is unknown in 1985, and unknown today.

In the next chapter, we look at the big project that Japan's government started around the same time, the Fifth Generation Computer. It was a plan to make reasoning and writing in knowledge faster with a special-purpose computer.