===== Information Theory & Coding ===== \\ |Instructor|**Ruediger Urbanke**| |Office|[[http://plan.epfl.ch/?room=INR116|INR 116]]| |Phone|**+4121 6937692**| |Email|**ruediger.urbanke@epfl.ch**| |Office Hours|**By appointment**| \\ |Teaching Assistant|**Hamed Hassani**| |Phone|**+4121 6937516**| |Office|[[http://plan.epfl.ch/?room=INR034|INR 034]]| |Email|**seyedhamed.hassani@epfl.ch**| |Office Hours|**24/7**| \\ |Teaching Assistant|**Javad Ebrahimi Boroojeni**| |Phone|**+4121 6931355**| |Office|[[http://plan.epfl.ch/?room=BC047|BC 047]]| |Email|**javad.ebrahimi@epfl.ch**| |Office Hours|**24/7**| \\ |Teaching Assistant|**Vinodh Venkatesan**| |Email|**vinodh.venkatesan@epfl.ch**| \\ |Teaching Assistant|**Selma Chouaki**| |Email|**selma.chouaki@epfl.ch**| \\ |Student Assistant|**Alexandre Duc**| |Student Assistant|**Messan Vigniko**| ||| \\ |Lectures|**Monday 13:00 - 15:00** (Room: [[http://plan.epfl.ch/?reset_session&alias=ela1|ELA01]])| | |**Tuesday 13:00 - 15:00** (Room: [[http://plan.epfl.ch/?reset_session&alias=sg01|SG 1]])| |Exercises|**Tuesday 15:00 - 17:00** (Room: [[http://plan.epfl.ch/?reset_session&room=sg01|SG 1]])| \\ |**Language**:| |English| |**Coefficient / Crédits **:| |7 ECTS| \\ [[http://infowww.epfl.ch/imoniteur_ISAP/!itffichecours.htm?ww_i_matiere=1774097&ww_x_anneeAcad=2010-2011&ww_i_section=946228&ww_i_niveau=&ww_c_langue=en|Link]] to official course description. ==== Exams and Grading ==== The final grade is determined as follows: \\ |Graded homeworks |10%|\\ |Midterm exam |40%|\\ |Final exam |50%|\\ |----------------------------|-------|\\ |Total |100%|\\ \\ {{:en:courses:2010-2011:itc_2010-2011_mid_term.pdf|Mid-Term 2010-2011 Grades}}\\ __**The final exam will take place on Friday January 21st, from 08:15 till 11:15 in CM2 & CM3 {{:en:courses:2010-2011:itc_exam_sched_2010.pdf|ITC_exam Schedule}} **__ \\ **You are allowed to use the book by Thomas and Cover and your course notes. You can also use a one-page summary. No notes from the exercise sessions or any other notes of any kind. No calculators, cell-phones, or any other electronic devices. Write only what is relevant to the question! THE EXAM WILL COVER THE WHOLE COURSE! ** ====== ====== ====== ==== Instructions for Graded Homeworks ==== \\ We will have a few graded homeworks. These will be announced and are collected exactly one week after they have been posted. It is OK to discuss problems with your friends, but once you write down a problem, you have to write it down in your own words. Also, on top of the first page, write down the list of people you discussed the problem with. If we find similarities of solutions beyond random and the ones listed, all involved homeworks will receive 0 points. We will not investigate who copied from whom. ==== Detailed Schedule ==== \\ ^ Date ^ Topic ^ Assignment ^ Due Date/Solutions Posted ^ Remarks ^ | Sep 20 | |public holiday - no course :-)| | Sep 21 | lossless source coding | {{en:courses:2010-2011:it2010-11-hw1.pdf|hw1.pdf}} | {{en:courses:2010-2011:it2010-11-sol1.pdf|sol1.pdf}} | | | Sep 27| | | Sep 28 | lossless source coding | {{en:courses:2010-2011:it2010-11-hw2.pdf| hw2.pdf}} | {{en:courses:2010-2011:it2010-11-sol2.pdf|sol2.pdf}} | | | Oct 4 | convexity; definitions and basic properties | | Oct 5 | information inequalities| {{en:courses:2010-2011:it-2010-11-hw3.pdf|hw3.pdf}} | {{en:courses:2010-2011:it-2010-11-hw3-sol.pdf|sol3.pdf}} | | | Oct 11 | | | Oct 12 | |{{en:courses:2010-2011:it-2010-11-hw4.pdf|hw4.pdf}}| {{en:courses:2010-2011:it-2010-11-hw4-sol.pdf|sol4.pdf}} | graded | | Oct 18 | | | Oct 19 | variable-length source coding | {{en:courses:2010-2011:it2010-11-hw5.pdf|hw5.pdf}} | {{en:courses:2010-2011:it2010-11-sol5.pdf|sol5.pdf}}| | | Oct 25 | | | Oct 26 | Lempel-Ziv algorithm | {{en:courses:2010-2011:it2010-11-hw6.pdf|hw6.pdf}} |{{en:courses:2010-2011:sol6.pdf|sol6.pdf}} | | | Nov 1 | analysis of LZ algorithm | {{en:courses:2010-2011:lz.pdf|notes by Prof. Telatar }}| | | Nov 2 | | {{en:courses:2010-2011:it2010-11-hw7-3.pdf|hw7.pdf}} | {{:en:courses:2010-2011:it2010-11-sol7.pdf|sol7.pdf}}| | Nov 8 | | | Nov 9 | midterm | {{en:courses:2010-2011:midterm.pdf|midterm.pdf}} | {{:en:courses:2010-2011:midtermsol.pdf|midtermsol.pdf}}| | Nov 15 | | | Nov 16 | | {{:en:courses:2010-2011:it2010-11-hw8.pdf|hw8.pdf}} |{{:en:courses:2010-2011:it2010-11-sol8.pdf|sol8.pdf}}| | Nov 22 | | | Nov 23 | | {{:en:courses:2010-2011:hw9-e.pdf|hw9.pdf}} | {{:en:courses:2010-2011:sol9.pdf|sol9.pdf}}| | Nov 29 | | | Nov 30 | Gaussian channels| {{:en:courses:2010-2011:hw10-m.pdf| hw10.pdf}}| {{:en:courses:2010-2011:sol10.pdf| sol10.pdf}} | graded | | Dec 6 | Gaussian channels| | Dec 7 | Gaussian channels |{{:en:courses:2010-2011:hw11.pdf| hw11.pdf}} | {{:en:courses:2010-2011:sol11.pdf|sol11.pdf}}| | Dec 13 | polar codes| | Dec 14 | polar codes|{{en:courses:2010-2011:it-2010-11-hw12.pdf|hw12.pdf}} ||graded (work in groups of at most four people) | | Dec 20 | rate distortion | | Dec 21 | rate distortion | [[http://example.com|External Link]] ==== Textbook ==== [[http://opac.nebis.ch/F?local_base=nebis&func=find-b&find_code=020&request=0-471-24195-4&con_lng=ENG|Elements of information theory]], Thomas M. Cover, Joy A. Thomas, 2006. ISBN:0-471-24195-4 ==== Additional Reading Material ====