2012 IEEE International Symposium on Information Theory proceedings (ISIT 2012): Cambridge, Massachusetts, USA, 1-6 July 2012
ISBN
9781467325806
Event
IEEE International Symposium on Information Theory; (Cambridge, Mass.): 2012.07.01-06
Pages (from-to)
1054-1058
Publisher
Piscataway, NJ: IEEE
Organisations
Faculty of Science (FNWI) - Swammerdam Institute for Life Sciences (SILS)
Abstract
An algorithm for estimating the entropy, which is based on the representation of the entropy function as the sum of two polynomial terms, called the polynomial approximation function and the remainder, is proposed. We construct an accurate and unbiased estimate of the value of the polynomial approximation function and use the known Bayesian approach to estimate the remainder. The combined estimator essentially reduces the bias of the constructed estimate as compared to the known estimators. Simulation results that confirm the claim are presented.
