Laboratory of Statistical Learning

Exercise 0 – Fisher Discriminant Analysis

Investigate if it’s possible to separate the data points projected onto the optimal direction when dataset meets the following requirements:

• there are three classes

• there are 30 points from normal distribution for each class with covariance matrix:

  

• the means for each class are as follows:

  

Make an appropriate picture.

Solution

Exercise 1 – Naive Bayes classifier

Solution

Exercise 2 – Model evaluation

Solution

Exercise 3 – K-nearest neighboors classifier

Solution

Exercise 4 – Decision Trees

Solution

Exercise 5 – Bagging

Solution

Exercise 6 – Support Vector Machines

Solution

Exercise 7 – Clustering algorithms

Solution

Exercise 8 – Principal Component Analysis

Solution