
The Knowledge Architects: Building Wisdom in the Information Age
Episode 36 | Connected Knowledge
AI-generated audio: the two voices and their conversation in this episode are created by AI. The hosts are not real people. How we make it: our team chooses each topic and edits the audio. The research and these notes are drafted with AI and read by us before publishing. Why AI? It lets us bring peer-reviewed science to you for free, in English and German. Sources are below. Episode Summary Give a physicist and a first year student the same twenty four physics problems and ask them to sort the problems into piles. They make about the same number of piles. They take about the same time. Reading a problem, they underline the same words on nineteen of twenty problems. And the two diagrams that textbooks reproduce as the picture of expert versus novice knowledge have seventeen nodes and sixteen. So where exactly is the difference? In this episode we open up the story everybody has been told: experts have rich, hierarchical, densely connected knowledge networks, and novices have fragments. Half of that turns out to be unsourced, and the other half rests on studies with four to sixteen participants and no statistics. The words "fragmented" and "piecemeal" appear nowhere in the 125 page report that everyone cites for them. What survives the audit is better than the myth. Almost everything you can count comes out the same for both groups, and the single count that does separate them is a count of conditions, not of nodes. When an expert says "conservation of energy," the next words are "if the plane is smooth." When a novice says it, the next words are nothing. That is the whole difference, and it is why a link matters: an isolated fact cannot tell you when to use it. Key Topics Covered The survey of nulls: same number of piles, same sorting time, same summary length, same keywords, same number of facts per concept Where the counts differ they run the wrong way: the expert's object description has eight nodes against the novice's sixteen, and instructor pilots had forty links against their trainees' fifty one What Chi, Glaser and Rees actually wrote, including their own verdict that the study "is not definitive" The vocabulary audit: "fragmented," "piecemeal" and "organizing principles" occur zero times in their 125 pages Where the fragments framing really enters the canon, in a 2000 summary chapter written for teachers Conditionalisation: nineteen conditional statements out of forty three for experts against one out of thirty five for novices Knowledge that is not conditionalised is inert: relevant, and never retrieved The chunking claim that did not replicate, and Chi's own group finding the opposite Eylon and Reif's 1979 experiment: structure helps on questions that span several facts and does nothing at all on local ones One child, forty dinosaurs, and a retention result a year later with the amount of knowledge held roughly equal Knowledge encapsulation in medicine: the store gets shorter, and a twelve link causal chain becomes two words The intermediate effect, and the failure to replicate it at ninety six participants by two of its own authors Why more connections should hurt: Anderson's 1974 interference result Reder and Ross's resolution: the same people, the same facts, and a fan effect of opposite sign depending only on the question asked Density is not the variable, diagnosticity is: a link costs you when it competes and pays you when it narrows The rival account: diSessa's knowledge in pieces, p-prims, and elements that are neither right nor wrong until a context cues them The replication contest that the challengers won, and the twist that both camps predict expertise means becoming better connected Whether a knowledge network can be measured at all: Pathfinder scaling, the shrinking correlation, and the circularity objection published by the method's own authors The Knowledge Integration rubric and the SOLO taxonomy as classroom ways of scoring links rather than facts The modern birdwatcher study, and the modularity null inside it: experts do not have more structure, they have differently made structure Researchers Mentioned Micheline Chi (Pittsburgh, later Arizona State) : the founding studies of expert knowledge organisation, and unusually candid about how the famous result was found Robert Glaser and Ernest Rees (Learning Research and Development Center, Pittsburgh) : coauthors of the 1982 chapter, and of the argument that novice difficulty sits in the knowledge base and not in the architecture Bat-Sheva Eylon (Weizmann Institute) and Frederick Reif (Berkeley, later Carnegie Mellon) : ran the earliest causal experiment in this literature, in 1979, and it is barely cited Jill Larkin (Carnegie Mellon) : proposed that expert knowledge is stored in tight chunks, on the evidence of one expert and one novice Vimla Patel and Guy Groen (McGill, later Columbia), with José Arocha : found that accurate diagnosticians reason forward, a property of getting it right rather than of being an expert, and then showed themselves that the pattern breaks when a case contains a loose end Henk Schmidt and Henny Boshuizen (Maastricht), with Margaretha van de Wiel : knowledge encapsulation and illness scripts, and the authors of the failure to replicate their own effect John R. Anderson and Lynne Reder (Carnegie Mellon) : the interference cost of knowing more, and the modelling result that the critical variable is probability rather than fan Brian Ross (Illinois) : coauthor of the experiment in which the same knowledge produced fan effects of opposite sign Gabriel Radvansky (Notre Dame) : hedged his own integration result, and switched the effect on and off by changing the probe format Roger Schvaneveldt (New Mexico State) : Pathfinder network scaling, and the finding that expert networks are simpler than novice ones Timothy Goldsmith and Peder Johnson (New Mexico) : structural knowledge assessment, and the authors of the circularity objection to their own method John Gammack : ran five elicitation methods on one expert, found five structures, and drew the honest conclusion Andrea diSessa (UC Berkeley) : knowledge in pieces, p-prims, coordination classes, and the humble theory doctrine David Hammer (Maryland, later Tufts) : the resources framework, and the line that an intuition becomes correct or incorrect in its use Bruce Sherin (Northwestern) : the only sustained study of what happens to intuitive knowledge as physics expertise develops Stella Vosniadou (Athens, later Flinders) : framework theory, and the coherence side of the fence Douglas Clark (Vanderbilt) : ran the dispute's decisive comparison across five countries with both sides' coding schemes Marcia Linn (UC Berkeley) : knowledge integration, and a scoring rubric that counts links rather than facts Asaf Gilboa and Erik Wing (Toronto and Baycrest) : the 2022 birdwatcher study, and the modularity null inside it Key Studies and Sources Chi, M.T.H., Glaser, R., and Rees, E. (1982...

