信息论基础

信息论基础

作者:Thomas M.Cover

出版社:清华大学出版社

出版年:2003-11-1

评分:9.1

ISBN:9787302072850

所属分类:行业好书

书刊介绍

精彩摘录

Theinitialquestionstreatedbyinformationtheorylayintheareasofdatacompressionandtransmission.Theanswersarequantitiessuchasentropyandmutualinformation,whicharefunctionsoftheprobabilitydistributionsthatunderlietheprocessofcommunication.TheKol-mogorovcomplexityofabinarystringisdefinedasthelengthoftheshortestcomputerprogramthatprintsoutthestring.Entropyistheuncertaintyofasinglerandomvariable.Acommunicationchannelisasysteminwhichtheoutputdependsprobabilisticallyonitsinput.TheentropyHofarandomvariableisalowerboundontheaveragelengthoftheshortestdescriptionoftherandomvariable.

——引自第5页


Wesummarizethisbysaying,"Almostalleventsarealmostequallysuprising."

——引自第58页

相关推荐

微信二维码