Information Theory

Teaching students
Suitable
Teaching educators
Suitable

Preview slides with notes

We recommend previewing these slides on a larger screen to view the slides and speaker notes easily.

Information Theory

Key question

  • How can information be measured?
  • What is entropy?

Claude Shannon

1916 - 2001

Juggler, mathematician, inventor...

A hundred years after his birth, Claude Shannon's fingerprints are on every electronic device we own.

—Siobhan Roberts The New Yorker 2016
I think I will ask if it is a T.
They will first ask me if it is a T. It is, so I will just say "Yes".
Yes!

Message:

a a a a a a a a a

What comes next?

Message:

Z q a v

What comes next?

Message:

a b c a b c a b c

What comes next?

?
?
?
?
?
?
?
?
?
?
?
?
?
?
?

Supporting Resources