Information Theory - MIT（信息理论麻省理工学院）.pdf

Aftab, Cheung, Kim, Thakkar, Yeddanapudi INFORMATION THEORY THE DIGITAL REVOLUTION 1 Information Theory INFORMATION THEORY AND THE DIGITAL AGE AFTAB, CHEUNG, KIM, THAKKAR, YEDDANAPUDI 6.933 – FINAL PAPER 6.933 Project History, Massachusetts Institute of Technology SNAPES@MIT.EDU Aftab, Cheung, Kim, Thakkar, Yeddanapudi INFORMATION THEORY THE DIGITAL REVOLUTION 2 INTRODUCTION Information Theory is one of the few scientific fields fortunate enough to have an identifiable beginning - Claude Shannons 1948 paper. The story of the evolution of how it progressed from a single theoretical paper to a broad field that has redefined our world is a fascinating one. It provides the opportunity to study the social, political, and technological interactions that have helped guide its development and define its trajectory, and gives us insight into how a new field evolves. We often hear Claude Shannon called the father of the Digital Age. In the beginning of his paper Shannon acknowledges the work done before him, by such pioneers as Harry Nyquist and RVL. Hartley at Bell Labs in the 1920s. Though their influence was profound, the work of those early pioneers was limited and focussed on their own particular applications. It was Shannon’s unifying vision that revolutionized communication, and spawned a multitude of communication research that we now define as the field of Information Theory. One of those key concepts was his definition of the limit for channel capacity. Similar to Moore’s Law, the Shannon limit can be considered a self-fulfilling prophecy. It is a benchmark that t