Systems and Computer Engineering (SYSC)
Department of Systems and Computer Engineering
SYSC 5506 [0.5 credit] (ELG 5170)
Information Theory
Measure of information: entropy, relative entrophy, mutual information, asymptotic equipartition property, entropy rates for stochastic processes; data compression: Huffman code, arithmetic coding; channel capacity: random coding bound, reliability function, Blahut-Arimoto algorithm, Gaussian channels, coloured Gaussian noise and 'water-filling'; rate distortion theory; network information theory.Prerequisite: SYSC 5503 (ELG 6153) or EACJ 5109 (ELG 5119) or equivalent.
Precludes credit for EACJ 5501 (ELG 5170).
Summer session: some of the courses listed in this Calendar are offered during the summer. Hours and scheduling for summer session courses will differ significantly from those reported in the fall/winter Calendar. To determine the scheduling and hours for summer session classes, consult the class schedule at central.carleton.ca
Not all courses listed are offered in a given year. For an up-to-date statement of course offerings for the current session and to determine the term of offering, consult the class schedule at central.carleton.ca
