ELEC / COMP 502
Spring 2008

Schedule

Class topics and Handouts will come on-line in a timely manner. My intention is to post them by the end of the day before the lecture. In that case you are responsible for printing your own copy for class if desired. If I post later, then I will provide hardcopies in class. Should you have trouble getting a printout please get help from Ms. Lili Zhang and also notify me.

The Lecture Notes and Handouts constitute the mandatory reading, and consist of two main ingredients:

Key to notation: CFi/k = Chapter k of Colin Fyfe's Volume i. Note that since I am using chapters from two different volumes two printed chapters may have the same number. Mark the volume # on your hardcopies.
EMwg-x = set #x of my viewgraphs. EM-"other" = "other" electronic material that I may post.

Additional, optional reading is listed to quench your thirst for more knowledge than contained in the Lecture Notes. The references are listed in the Course materials.

If a .ps or .pdf file comes up with poor resolutin on your screen, the printed version should still be perfectly fine. If that is not the case alert me.
>> <

No.

Date

Topic

Lecture Notes
& Handouts
mandatory reading

Homework
Turn in a hardcopy by 2:30pm on due date
unless otherwise indicated.

Optional Reading

1

Jan 8

Orientation, Introduction

CF2/1 EMwg-1

HW-1 due 1/10

Haykin Ch1

2

Jan 10

Review of Basics of Info Theory and Statistics CF2/2 EMwg-2

 Haykin Ch10 or Cover & Thomas Ch1

3

Jan 15

Review of Info, Stat, cont'd;
Noisy Neurons

CF2/2 EMwg-2

HW-2 due 1/24

LaTeX source
if you wish to write HW in LaTeX

Haykin Ch10 or Cover & Thomas Ch1 and Ch9

4

Jan 17

Associative memory CF1/2 EMwg-3 Haykin Ch2.11

5

Jan 22

 Assoc. memory, cont'd; Error correction CF1/2 EMwg-4 Haykin Ch2.1-4, Ch2.11

6

 Jan 24 Perceptron CF1/3 EMwg-5 HW-3 due 1/31

Haykin Ch3

7

 Jan 29 Back Propagation CF1/4 EMwg-6 Haykin Ch4.1-4.4

8

 Jan 31 Backprop cont'd CF1/4 EMwg-7 HW-4 due 2/14 Haykin Ch4.5-4.8

9

 Feb 5 Issues with BP, momentum CF1/4 EMwg-7 cont'd Haykin Ch4.5-4.8

10

 Feb 7 Issues with BP: Pruning EMwg-9

11

 Feb 12 Issues with BP: VC dimension CF1/4 EMwg-8 Haykin Ch4.5-4.8, Haykin pp 94 - 102, Bishop

12

 Feb 14 Vector-BP & clinic
PCA overview		 LZhang-wg

13

 Feb 19 BP wrap up; Unsupervised learning CF2/3 EMwg-10 HW-5 due 2/26 Haykin CH8.1-5

14

 Feb 21 QUIZ1,Unsupervised Learning CF2/3 EMwg-10 Haykin CH8.1-5

15

 Feb 26 Competitive Learning CF1/5.6-8 EMwg-11short HW-6 due 3/4 Haykin CH9.1-6

16

 Feb 28 Competitive learning (SOM, LVQ), cont'd CF1/5.6-8 EMwg-11 Haykin CH9.1-6

Mar 3 - 7 SPRING BREAK, no classes

Mar 10 Midterm exam handed out, due 3/18 

17

 Mar 11 Discussion of project proposals Meet in my office
bring hardcopy of your proposal

18

 Mar 13 Competitive learning (SOM, LVQ); Hopfield net CF1/5.6-8, CF 1/7.1-7.2, EMwg-12 HW-7 due 3/21 Haykin CH9.1-6, Haykin Ch14

Mar 18 no class, make up time for midterm Midterm due on this day, by class time.
Slide under my door or give it to Lily.

19

 Mar 20 Hopfield network; Annealing  CF 1/7.1-7.3, EMwg-13 Haykin Ch14, Ch11

20

 Mar 25 Boltzmann machine  CF 1/7.1-7.5 EMwg-14 Haykin Ch11

21

 Mar 27 Network Growing: Cascade Correlation Net (Faster Supervised Learning)
Conjugate Gradients (Faster Supervised Learning)  		 CF 1/8.5, 1/8.3, 1/8.4, 1/8.7 EMwg-15

22

 Apr 1 Conjugate Gradients, cont'd
Information Theoretic Models, Applications 		CF 2/5.1 EMwg-15 Parts of Haykin Ch10

Apr 3 NO CLASS (spring recess)

23

 Apr 8 QUIZ2
Information Theoretic Models, cont'd 		Material for QUIZ2: from QUIZ1 to April 1

24

 Apr 10 Information Theoretic Models
Radial Basis Function networks 		CF 2/5 CF 1/8.2 EMwg-16 Parts of Haykin Ch5

25

 Apr 15 Blind Source Separation CF 2/6 EMwg-17 Parts of Haykin Ch10

26

 Apr 17 Class project presentations

27

 Apr 22 NO CLASS (makeup time for project writeup and presentation preparation)
 Project writeup due 4/23 (turn in one hardcopy and email one electronic copy)
Project presentation due 4/23 (email one electronic copy)

Return to ELEC 502 / COMP 502 home page