Information Theory part 9: What is a bit?

Channel:
Canada Art of the Problem
Subscribers:
173,000
Published on ● Video Link: https://www.youtube.com/watch?v=X40ft1Lt1f0


Category:
Guide
Duration: 9:53
47,829 views
594

How can we quantify/measure an information source? We introduce the ideas of Nyquist & Hartley using a simple game involving yes/no questions. It's important to realize all of this happened before Claude Shannon arrived on the scene. However, this measure applies only when communication involves random sequences...


References:
Hartley - Transmission of Information
http://www3.alcatel-lucent.com/bstj/vol07-1928/articles/bstj7-3-535.pdf

Nyquist - Certain Factors Affecting Telegraph Speed
http://www3.alcatel-lucent.com/bstj/vol03-1924/articles/bstj3-2-324.pdf



Other Videos By Art of the Problem


2016-05-19What is an Algorithm?
2016-04-04What is Computer Science? | The Turing test
2016-01-19The Origin and History of Computer Science?
2015-10-04Episode 3 Teaser
2014-04-15Information Theory part 15: The search for Extraterrestrial Intelligence
2014-01-08Information Theory part 14: Error correction codes (Hamming coding)
2014-01-05Information Theory part 13: Data Compression via Huffman Coding
2013-11-27Claude Shannon's Information Entropy | Information Theory Part 12
2013-06-27Information Theory part 11: Claude Shannon: A Mathematical Theory of Communication
2013-06-26Information Theory part 10: What is a Markov chain?
2013-05-31Information Theory part 9: What is a bit?
2013-05-20Fermat primality test (Prime Adventure Part 10)
2013-04-08Intro to Channel Capacity (information theory)
2013-04-08Symbol Rate (information theory)
2013-04-05Information Theory part 8: Channel capacity (baud rate)
2013-03-12Random Primality Test (Prime Adventure Part 9)
2013-03-12Random Primality Tests (Prime Adventure part 9)
2013-03-07Fermat's Little Theorem (Visualization)
2013-03-02Information Theory part 7: Morse Code
2013-02-21RSA Encryption (step 5)
2013-02-21RSA Encryption (step 2)


Tags:
measure information
information
bits
nyquist
hartley
shannon
quantify information
information theory
bit
Claude Shannon (Author)
artoftheproblem
languageofcoins