国立東京工業高等専門学校シラバス

教科目名	情報理論特論 Advanced Information Theory

担当　教官	：	小嶋　徹也
学年、学科等	：	2年	専攻科機械情報専攻			通常講義
単位数　期間	：	選択	2 単位	後期	週2時間	（合計 30 時間）

授業の目標と概要

　Claude E. Shannon published a paper called ``A Mathematical Theory of Communication''. The theory

described in this paper forms very important bases of computers and communications even in today's

highly sophisticated network communication technology. The objective of this lecture is to study some of

the important factors in Shannon's theory such as information measures, source and channel coding

theorems.

カリキュラムにおける位置づけ

　Students should have knowledge on basic theories of communcations that they could study in the classes

such as Computer Mathematics or Communication Engineering in Department of Computer Science. In this

lecture, students have to read Shannon's paper, investigate related topics by themselves, and make

presentations.

授業の内容

時間

In every class, the teacher assigns a theme or topic to each student. Every student has to
investigate the topic by reading Shannon's paper or other materials, and make a presentation in
the next class. Presentations can be given in Japanese, but the teacher asks some questions in
English. Student can answer the questions in Japanese. All materials used in the lecture will be
given in English.

1. Introduction	2
2. The Discrete Noiseless Channel	2
3. The Discrete Source of Information	2
4. Markoff Process, Ergodic and Mixed Sources	2
5. The Entropy of an Information Source	2
6. Encoding and Decoding Operations	2
7. Noisy Discrete Channel and Channel Capacity	2
8. Attainable Region of Discrete Channel with Noise	2
9. The Channel Capacity in Certain Special Cases	2
10. Entropy of a Continuous Distribution	2
11. Entropy of an Ensemble of Functions	2
12. The Capacity of a Continuous Channel	2
13. Fidelity Evaluation Functions	2
14. Information Theory and Communications	2
15. Summary	2

教科書

クロード・シャノン，ワレン・ウィーバー著，植松友彦訳「通信の数学的理論」ちくま学芸文庫

補助教科書

C.E.Shannon,"A Mathematical Theory of Communication," The Bell Sys. Tech. J.

履修上の注意

Every student has to study the assigned theme and prepare his/her presentation. In every class, a certain exercise will be given to students, so A4 report pads are required.

評価基準

Students should understand the overview of Shannon's theory on data compressions and communications.

評価法

レポートなど75%，presentations15%，Exercises10%

学習・教育目標

東京高専

B-3,C-2,C-6

JABEE

(d)(f)(h)