This an updated new edition of the popular elementary introduction to probability theory and information theory, now containing additional material on Markov chains and their entropy. Suitable as a textbook for beginning students in mathematics,

分别假定英文信源为m 0,1,2,...,5 阶马尔科夫链考察其熵率、 信息 冗余度和结构信息；仅考虑英文的 阶马尔科夫链考察其熵率、 信息 冗余度和结构信息；仅考虑英文的 26 个字母，不区分大小写。 用MATLAB 实现。-English sources are assumed as m 0,1,2, ..., 5-order Markov chain examine its entropy rate, information redundancy and structu