The question nobody was asking
In 1966 the television was a settled technology with a settled purpose. Tens of millions of American households had one, everybody understood what it was for, and the idea that the appliance in the living room might be an interactive device rather than a broadcast receiver was not a live question anywhere in the consumer electronics industry. Ralph Baer, an engineer at Sanders Associates in Nashua, New Hampshire — a defence contractor, not a toy company — started asking it anyway.
The insight was not really technical. Nothing in a 1966 television prevented what Baer wanted; the hardware to drive spots of light around a screen was buildable with the era's components. The obstacle was conceptual. A television was for receiving, and the notion of a box that made the set do something under the viewer's control had no category to belong to. Baer's contribution begins with recognising that the installed base of televisions was an installed base of displays, and that whoever worked out what to plug into them had a market of millions already wired into homes.
Building it
Baer worked through a series of test units between 1967 and 1969 with colleagues Bill Harrison and Bill Rusch, iterating toward a machine that could do more than one thing. The result was the Brown Box: a prototype for the first multiplayer, multiprogram video game system. Both adjectives matter. Multiplayer meant the box was social, a thing two people did together in a living room. Multiprogram meant it was not a single-purpose appliance but a platform, capable of hosting different games.
The games Baer built for it establish how thoroughly he had thought it through: ping-pong, handball, soccer, volleyball, target shooting, checkers, and golf. That list is a deliberate survey of what an interactive television might be for — sport, competition, strategy, skill — produced years before there was any evidence that anyone wanted such a thing. He was not prototyping a product so much as mapping a medium.
From defence contractor to Magnavox
The Brown Box was patented on 17 April 1973 as U.S. Patent No. 3,728,480. Sanders had no business selling toys, so it licensed the system to Magnavox, which released the design in 1972 as the Magnavox Odyssey — the first commercial home video game console, arriving in living rooms before Atari existed as a going concern.
The patent mattered enormously, and its ownership explains much of the industry's early legal history. A defence contractor held the foundational intellectual property of home video gaming, which meant the companies who built the business through the 1970s did so on licensed ground. The division of credit that eventually settled — Baer as the father of the home console, Nolan Bushnell as the originator of the arcade machine — is roughly fair, and it obscures how differently the two men arrived. Bushnell built a company and a culture. Baer built a prototype at his day job and handed it to someone else to sell.
The engineer who kept going
Baer did not treat the Odyssey as a career-defining event to be lived off. He continued working in electronics until his death in 2014, accumulating over 150 patents — a working engineer to the end, in a field he had personally caused to exist. His prototypes are now held by the National Museum of American History, an unusual fate for hardware built in a defence contractor's lab as a side interest.
What makes his story worth telling apart from the chronology is the shape of the insight. Baer did not invent a technology; the components were available, and someone would have assembled them eventually. He noticed that a device already sitting in tens of millions of homes was being used for one thing when it could do another, and he was willing to pursue that observation inside a company with no reason to care about it. Every console since — through Atari, Nintendo, Sony, and Microsoft — descends from a question about what the furniture in the living room was actually for.