x dots x n dots n math common information theory speak rate entropy language appropriate example source information english prose rate source information related redundancy well compressed subject channel capacity communications channel primary motivation information theory however channels often fail produce exact reconstruction signal noise periods silence forms signal corruption often degrade quality consider communications
Formal science Computer science Computer communications (networks) Information theory