An algebraic framework for information theory: Classical information

An algebraic framework for information theory: Classical information

  • Patra, M.K. and Braunstein, S. L., (2013): IMA Journal of Mathematical Control and Information 30(2), 205-238. (PDF)

    ABSTRACT: This work proposes a complete algebraic model for classical information theory. As a precursor the essential probabilistic concepts have been defined and analysed in the algebraic setting. Examples from probability and information theory demonstrate that in addition to theoretical insights provided by the algebraic model one obtains new computational and analytical tools. Several important theorems of classical probability and information theory are formulated and proved in the algebraic framework.