Carleton University Graduate Calendar 2010-2011

Breadcrumb trail

Home /Courses/ SYSC

Site navigation

  • Calendar Updates
  • Graduate Programs
  • Graduate Courses
  • The Academic Year
  • General Regulations
  • Awards and Scholarships
  • Graduate Supervisors
  • About the University
  • Calendar Archives
  • PDF version
  • Student Services
  • Undergraduate Calendar

Systems and Computer Engineering (SYSC)

Department of Systems and Computer Engineering

SYSC 5506 [0.5 credit] (ELG 5170)

Information Theory

Measure of information: entropy, relative entrophy, mutual information, asymptotic equipartition property, entropy rates for stochastic processes; data compression: Huffman code, arithmetic coding; channel capacity: random coding bound, reliability function, Blahut-Arimoto algorithm, Gaussian channels, coloured Gaussian noise and 'water-filling'; rate distortion theory; network information theory.
Prerequisite: SYSC 5503 (ELG 6153) or EACJ 5109 (ELG 5119) or equivalent.
Precludes credit for EACJ 5501 (ELG 5170).

Summer session: some of the courses listed in this Calendar are offered during the summer. Hours and scheduling for summer session courses will differ significantly from those reported in the fall/winter Calendar. To determine the scheduling and hours for summer session classes, consult the class schedule at central.carleton.ca

Not all courses listed are offered in a given year. For an up-to-date statement of course offerings for the current session and to determine the term of offering, consult the class schedule at central.carleton.ca

top

  • Apply to Graduate Studies

    Apply!

    Application Deadlines

    Information about application deadlines can be found here.
  • LOGIN

    • MyCarleton Portal
    • WebCT
    • Carleton Central