Schedule

Home Syllabus and Grading Policies Archived News Schedule Text Information

E E 547. Pattern Recognition


(3-0) Cr. 3. F. Prereq: 424. Mathematical formulation of pattern recognition problems and decision functions, statistical approach, Bayes classifier, pdf estimation, clustering algorithms (supervised and unsupervised), learning algorithms and neural networks, fuzzy recognition systems, feature selection methods, syntactic approach to pattern recognition.

horizontal rule

Key Events

Project 1

First project on supervised learning with PCA feature reduction. 

Final Project

Project combining different clustering and supervised learning methods and comparison of different pattern recognition systems.

Back to Top

horizontal rule

Schedule

Week Date Topic Chapter
1   Introduction and Overview, examples 1
2  
bulletDecision functions and Bayesian decision theory, metrics
bulletNaive Bayes Classifiers, "On the Optimality of the Simple Bayesian Classifier under zero-one Loss", Domingos and Pazzani, Machine Learning, 1997; "An Empirical Study of the naive Bayes classifier," Rish in IJCAI-01 workshop on "Empirical Methods in AI". Also appeared as IBM Technical Report RC22230.
bulletApplication: Spam Detection
 		 2
3  
bulletTopics: Linear Classifiers: Perceptrons, Least squares and mean square error
bulletApplication:
3
4   Neural Network Approaches Backpropagation, EM continued; Nonparametric analysis, density estimation, feature reduction 4
5   Linear Discriminants, Gradient Descent, Perceptron, LMS, Support Vector MachinesUsing genetic algorithms for clustering; using Nearest Neighbor methods to split a decision space for density estimation 4
6     10
7     10
8     Karayannis Text
9   Unsupervised learning and clustering; Methods of cluster analysis, effects of different metrics 5, handout
10   Unsupervised learning and clustering; Methods of cluster analysis, effects of different metrics 6
11 3/ Unsupervised Clustering Evaluation: Hypothesis testing, internal metrics  
12 4/3 Tree classification, CART, ID3, C4.5 Papers and website
13 4/10 Random Forests, Feature Selection using filters Breiman Website;

Feature Selection links

14 4/17 Feature Selection using wrappers, Data visualization  
15 4/24 Classifier Comparison  
Back to Top

Page last edited 04/10/2006