Generalized cutoff rates and Renyi's information measures 论文

摘要

Renyi's (1961) entropy and divergence of order a are given operational characterizations in terms of block coding and hypothesis testing, as so-called /spl beta/-cutoff rates, with /spl alpha/=(1+/spl beta/)/sup -1/ for entropy and /spl alpha/=(1-/spl beta/)/sup -1/ for divergence. Out of several possible definitions of mutual information and channel capacity of order /spl alpha/, our approach distinguishes one that admits an operational characterization as /spl beta/-cutoff rate for channel coding, with /spl alpha/=(1-/spl beta/)/sup -1/. The ordinary cutoff rate of a DMC corresponds to /spl beta/=-1.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>