Dec 26, 2024  
Graduate Catalog | 2023-2024 
    
Graduate Catalog | 2023-2024 Previous Edition

Add to Catalog Bookmarks (opens a new window)

ECGR 6165 - Information Theory


Information measures and their properties; entropy, relative entropy and mutual information. Information source models. Lossless data compression: the Kraft inequality, Shannon-Fano and Huffman codes. Typical sequences, asymptotic equipartition property, source coding theorem. Discrete memoryless channels: capacity, channel coding theorem. The additive Gaussian channel. Source coding under a fidelity constraint: rate distortion function and rate distortion theorem. Modern applications of information theory, including information security, data privacy and machine learning. Credit will not be given for ECGR 6165 where credit has been given for ECGR 8165 .

Credit Hours: (3)
Cross-listed Course(s): ITCS 6165  


Schedule of Classes




Add to Catalog Bookmarks (opens a new window)