The ideas in this dissertation rely on fundamental principles in probability, statistics and information theory. This chapter reviews the relevant concepts and establishes the mathematical notation that we will use in the rest of the dissertation.
