Jan 13, 2025  
Graduate Catalog | 2023-2024 
    
Graduate Catalog | 2023-2024 Previous Edition

Add to Catalog Bookmarks (opens a new window)

ECGR 8165 - Information Theory


Information measures and their properties; entropy, relative entropy and mutual information. Information source models. Lossless data compression: the Kraft inequality, Shannon-Fano and Huffman codes. Typical sequences, asymptotic equipartition property, source coding theorem. Discrete memoryless channels: capacity, channel coding theorem. The additive Gaussian channel. Source coding under a fidelity constraint: rate distortion function and rate distortion theorem. Modern applications of information theory, including information security, data privacy and machine learning. Credit will not be given for ECGR 8165 where credit has been given for ECGR 6165 .

Credit Hours: (3)
Cross-listed Course(s): ITCS 8165 


Schedule of Classes




Add to Catalog Bookmarks (opens a new window)