Learning Outcomes

In this free course, you will learn how to:

• Outline the concept of the information-theoretic lower bounds
• Describe the procedure for deriving lower bounds for compression problems
• Discuss the relationship between Shannon's source coding and ‘Shannon entropy’
• Explain the process for deriving lower bounds for random number generation
• Identify the methods of deriving minimax lower bound for statistical estimation
• Recognise the significance of empirical mean in deriving a lower bound
• Outline the concept of the minimax estimator