EE6340 Information Theory (Jan-Apr 2013)

Instructor

Srikrishna Bhashyam
Office: ESB 212D
Phone: 2257 4439

Class Timings

Mondays 12-12.50pm, Thursdays 10-10.50am, and Fridays 9-9.50am: in ESB350

Course Content

• Entropy, Relative Entropy and Mutual Information
• The Asymptotic Equipartition Property
• Entropy Rate
• Data Compression
• Channel Capacity
• Differential Entropy
• The Gaussian Channel
• Parallel Gaussian Channels

Evaluation
Quiz 1 -- Feb 28, 2013 (20%)
Quiz 2 -- Apr 8, 2013 (20%)
Final -- May 10, 2013 (60%)

Assignments

• Problem Set 1
• Solutions to Problem Set 1
• Problem Set 2
• Solutions to Problem Set 2
• Problem Set 3
• Solutions to Problem Set 3
• Problem Set 4
• Solutions to Problem Set 4
• Problem Set 5
• Solutions to Problem Set 5
• Problem Set 6
• Solutions to Problem Set 6
• Problem Set 7
• Solutions to Problem Set 7
• Problem Set 8
• Solutions to Problem Set 8

References

[1] T. M. Cover, J. A. Thomas, "Elements of Information Theory," Second edition, John Wiley & Sons, 2006.
(First edition of this book is available as a low priced edition)