Multimedia learning research, pioneered by Richard Mayer, investigates how people learn from instructional materials that combine words (printed or spoken) and pictures (illustrations, animations, video). Mayer's cognitive theory of multimedia learning builds on dual coding theory and cognitive load theory, proposing that learners have separate channels for processing visual and auditory information, each with limited capacity, and that meaningful learning requires active cognitive processing: selecting relevant information, organizing it into coherent representations, and integrating it with prior knowledge.
Key Structures
- Auditory cortex (verbal channel) — The region of the temporal lobe that processes sound, organized tonotopically in the superior temporal gyrus, particularly in relation to verbal channel.
- Visual cortex (pictorial channel) — The regions of the occipital lobe dedicated to processing visual information through a hierarchy of increasingly complex feature representations, particularly in relation to pictorial channel.
- Prefrontal cortex (integration) — The anterior portion of the frontal lobe, critical for executive functions including planning, decision-making, working memory, and cognitive control.
- Hippocampus (encoding) — A medial temporal lobe structure essential for the formation of new declarative memories and spatial navigation — one of the most studied structures in cognitive neuroscience.
- Working Memory — A limited-capacity system for temporarily holding and manipulating information during complex cognitive tasks such as reasoning, comprehension, and learning.
- Dual Coding Theory — Paivio's theory that cognition involves two independent but interconnected representational systems — one for verbal information and one for imagery — and that using both improves memory.
- Cognitive Load Theory — An instructional design framework holding that learning is optimized when teaching methods align with the limited capacity of working memory and the unlimited capacity of long-term memory.
- Expertise — The superior performance exhibited by individuals with extensive experience in a domain, characterized by rich knowledge structures, automatized skills, and qualitatively different problem representat.
- Schemas — Organized mental frameworks of knowledge and expectations about the world that guide perception, memory, and reasoning — shaping how we interpret new experiences based on what we already know.
Key Functions
Describes how people learn more effectively from words and pictures together than from words alone, based on the dual-channel processing model of working memory.
Core Principles
Decades of experimental research have yielded robust design principles. The multimedia principle: people learn better from words and pictures than from words alone. The modality principle: people learn better from animation and narration than from animation and on-screen text (because narration uses the auditory channel, freeing the visual channel for the animation). The contiguity principle: people learn better when corresponding words and pictures are presented near each other in space (spatial contiguity) and time (temporal contiguity).
Several principles focus on eliminating extraneous processing. The coherence principle: remove extraneous material (interesting but irrelevant details, decorative illustrations). The signaling principle: highlight essential material with cues. The redundancy principle: do not add on-screen text to narrated animation (the redundant text competes with the animation for visual attention). The segmenting principle: break complex lessons into learner-paced segments rather than continuous presentations.
Modern Extensions
Recent research extends multimedia learning to interactive simulations, virtual reality, gesture-based learning, and embodied learning environments. Individual differences — particularly spatial ability, prior knowledge, and working memory capacity — moderate the effectiveness of multimedia principles. The expertise reversal effect shows that design principles effective for novices can be ineffective or harmful for experts, who have the schemas to manage more complex presentations.
Disorders
- Learning disabilities (processing channel deficits) — Neurodevelopmental conditions affecting the acquisition of reading, writing, or mathematical skills despite adequate intelligence and instruction, particularly in relation to processing channel defici.
- ADHD (split attention) — Attention-Deficit/Hyperactivity Disorder — a neurodevelopmental condition characterized by persistent patterns of inattention, hyperactivity, and impulsivity affecting cognitive functioning.
- Dyslexia — A specific learning disability affecting reading accuracy, fluency, and comprehension, rooted in phonological processing deficits despite adequate intelligence and instruction.