Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Machine Learning Fundamentals

sambaiga
April 03, 2018

Machine Learning Fundamentals

The talk introduce the fundamental of machine learning with emphasis on enabling learners to learn how to build remarkable machine learning algorithms capable of solving complex real-world problem. Specifically it presents the basics of machine learning, its applications and how to formulate supervised learning problem. The tutorial also explore different challenges of machine learning algorithms and discuss best practise for evaluating machine learning algorithms.

sambaiga

April 03, 2018
Tweet

More Decks by sambaiga

Other Decks in Technology

Transcript

  1. Machine learning fundamentals PytzMLS2018@IdabaX: CIVE UDOM Tanzania. Anthony Faustine PhD

    Fellow (IDLab research group-Ghent University) 3 April 2018 1
  2. Learning goal • Understand the basics of Machine learning and

    its applications. • Learn how to formulate learning problem. • Explore different challenges of machine learning models. • Learn best practise for designing and evaluationg machine learning models. 2
  3. Outline Introduction Formulating ML learning Problem: Supervised Learning Challenge of

    ML problem ML Evaluation Best practise for solving ML problem 3
  4. What is ML ? Machine learning (ML): the science (and

    art) of programming computers so they can learn from data. Learn from data • Automatically detect patterns in data and • Build models that explain the world • Use the uncovered pattern to understand what is happening (inference) and to predict what will happen(prediction). This gives computers the ability to learn without being explicitly programmed. 3
  5. Why ML? Consider how you would write a spam filter

    using traditional programming techniques. 4
  6. Why ML? • Hard problems in high dimensions, like many

    modern CV or NLP problems require complex models ⇒ difcult to program the correct behavior by hand. • Machines can discover hidden, non-obvious patterns. • A system might need to adapt to a changing environment. • A learning algorithm might be able to perform better than its human programmers. 5
  7. ML applications As an exciting and fast-moving field ML has

    many applications. • Computer vision: Object Classification in Photograph, image captioning. • Speech recognition, Automatic Machine Translation, • Communication systems • Robots learning complex behaviors: • Recommendations services (predict interests (Facebook), predict other books you might like (Amazon), . • Medical diagnosis. • Bank(Fraud detection and prevention). • Computaional biology (tumor detection, drug discovery and DNA sequencing). • Search engines (Google). • Anamloly and events detection (IoT, factory predictive maintance). 6
  8. ML types Machine learning is usually divide into three major

    types: 1 Supervised Learning • Learn a model from a given set of input-output pairs, in order to predict the output of new inputs. • Further grouped into Regression and classification problems. 2 Unsupervised Learning • Discover patterns and learn the structure of unlabelled data. • Example Distribution modeling and Clustering. 3 Reiforcement Learning • Learn what actions to take in a given situation, based on rewards and penalties. More details on RL • Example consider teaching a dog a new trick: you cannot tell it what to do, but you can reward/punish it. 7
  9. Outline Introduction Formulating ML learning Problem: Supervised Learning Challenge of

    ML problem ML Evaluation Best practise for solving ML problem 9
  10. Formulate a learning problem To formulate ML problem mathematically, you

    need first to define Model (Hypothesis) and Loss function: Model (Hypothesis) Given a set of labeled training examples {x1:N , y1:N }: • A model is a set of allowable functions fθ (x; θ) that compute predictions ˆ y from the inputs x ⇒ map inputs x to outputs y parameterized by θ. Loss function Given a set of labeled data {x1:D , y1:M } and the hypothesis f(x; θ) • Loss function Lθ (f(x; θ), y) defines how well the model f(x; θ) fit the data ⇒ howfar off the prediction ˆ y is from the output y. 9
  11. Formulate a learning problem To formulate ML problem mathematically, you

    need first to define Model (Hypothesis) and Loss function: Model (Hypothesis) Given a set of labeled training examples {x1:N , y1:N }: • A model is a set of allowable functions fθ (x; θ) that compute predictions ˆ y from the inputs x ⇒ map inputs x to outputs y parameterized by θ. Loss function Given a set of labeled data {x1:D , y1:M } and the hypothesis f(x; θ) • Loss function Lθ (f(x; θ), y) defines how well the model f(x; θ) fit the data ⇒ howfar off the prediction ˆ y is from the output y. 9
  12. Formulate a learning problem: Optimisation problem The loss, averaged over

    all the training examples is called cost function given by: Jθ = 1 N N i=1 Lθ(ˆ y(i), y(i)) Optimisation Problem After model and loss function definition we need to solve an optimisation problem. • Find the model parameters θ that best fit the data ⇒ Empirical Risk Minimization. arg min θ 1 N N i=1 Lθ (ˆ y(i), y(i)) (1) • Objective: minimize a cost function Jθ with respect to the model parameters θ 10
  13. Formulate a learning problem: Optimisation problem The loss, averaged over

    all the training examples is called cost function given by: Jθ = 1 N N i=1 Lθ(ˆ y(i), y(i)) Optimisation Problem After model and loss function definition we need to solve an optimisation problem. • Find the model parameters θ that best fit the data ⇒ Empirical Risk Minimization. arg min θ 1 N N i=1 Lθ (ˆ y(i), y(i)) (1) • Objective: minimize a cost function Jθ with respect to the model parameters θ 10
  14. Formulate a learning problem: Gradient Descent Gradient descent: procedure to

    minimize a loss function. • compute gradient • take step in opposite direction 1 Initilize parameter θ, 2 Loop until converge, 3 Compute gradient: ∂Jθ ∂θ 4 Update parameters: θt+1 = θt − α∂Jθ ∂θ 5 Return parameter θ 11
  15. Formulate a learning problem: Gradient Descent α is the learning

    rate → determine size of step we take to reach local minimum. Issues: • What is the appropriate value of α? • Avoid non-global minimum Figure 1: Gradient Descent. 12
  16. Formulate a learning problem: Linear regression Linear regression: predict a

    scalar-valued target, such as the price of stock. 1 weather forecasting. 2 house pricing prediction. 3 student performance prediction. 4 .... 5 .... Figure 2: dataset. 13
  17. Formulate a learning problem: Linear regression In linear regression, the

    model consists of linear functions given by: f(x; θ) = j wj xj + b where w is the weights, and b is the bias. The loss function is given by: L(ˆ y, y) = 1 2 (ˆ y − y)2 The cost function: Jθ = 1 N N i=1 L(ˆ y(i), y(i)) = 1 2N N i=1 j wj x(i) j + b − y(i) In vectorized form: Jθ = 1 2N ˆ y − y 2= 1 2N (ˆ y − y)T (ˆ y − y) where ˆ y = wTx 14
  18. Formulate a learning problem: Linear regression Use gradient descent to

    solve the minimum cost function Jθ θt+1 = θt − α ∂Jθ ∂θ For parameter w and b: wt+1 = wt − α ∂Jθ ∂w bt+1 = bt − α ∂Jθ ∂b where: ∂Jθ ∂w = 1 N xT(ˆ y − y) ∂Jθ ∂b = 1 N (ˆ y − y) import torch import torch.nn as nn import torch.optim.SGD as SGD feature_dim = 1 target_dim = 1 model=nn.Linear(feature_dim,target_dim) loss_fn = nn.MSELoss() optimizer=SGD(model.parameters(), lr=0.1) for epoch in range(100): optimizer.zero_grad() y_pred=model(x) cost=loss_fn(y_pred,y) cost.backward() optimizer.step() 15
  19. Formulate a learning problem: Linear regression Use gradient descent to

    solve the minimum cost function Jθ θt+1 = θt − α ∂Jθ ∂θ For parameter w and b: wt+1 = wt − α ∂Jθ ∂w bt+1 = bt − α ∂Jθ ∂b where: ∂Jθ ∂w = 1 N xT(ˆ y − y) ∂Jθ ∂b = 1 N (ˆ y − y) import torch import torch.nn as nn import torch.optim.SGD as SGD feature_dim = 1 target_dim = 1 model=nn.Linear(feature_dim,target_dim) loss_fn = nn.MSELoss() optimizer=SGD(model.parameters(), lr=0.1) for epoch in range(100): optimizer.zero_grad() y_pred=model(x) cost=loss_fn(y_pred,y) cost.backward() optimizer.step() 15
  20. Formulate a learning problem: Linear regression Use gradient descent to

    solve the minimum cost function Jθ θt+1 = θt − α ∂Jθ ∂θ For parameter w and b: wt+1 = wt − α ∂Jθ ∂w bt+1 = bt − α ∂Jθ ∂b where: ∂Jθ ∂w = 1 N xT(ˆ y − y) ∂Jθ ∂b = 1 N (ˆ y − y) import torch import torch.nn as nn import torch.optim.SGD as SGD feature_dim = 1 target_dim = 1 model=nn.Linear(feature_dim,target_dim) loss_fn = nn.MSELoss() optimizer=SGD(model.parameters(), lr=0.1) for epoch in range(100): optimizer.zero_grad() y_pred=model(x) cost=loss_fn(y_pred,y) cost.backward() optimizer.step() 15
  21. Formulate a learning problem: Classification Goal is to learn a

    mapping from inputs x to target y such that y ∈ {1 . . . k} where k is the number of classes. • If k = 2, this is called binary classification. • If k > 2, this is called multiclass classification. • If each instance of x is associated with more than one label to each instance, this is called multilabel classification Figure 3: dataset. 16
  22. Classification: Logistic regression Goal is to predict the binary target

    class y ∈ {0, 1}. Model is given by: ˆ y = σ(z) = 1 1 + e−z where z = wTx + b import torch from torch.nn as nn import torch.nn.functional as F z=nn.Linear(feature_dim, 1) model = F.sigmoid(z) This function squashes the predictions to be between 0 and 1 such that: p(y = 1 | x, θ) = σ(z) and p(y = 0 | x, θ) = 1 − σ(z) 17
  23. Classification: Logistic regression Loss function: it is called crossentropy and

    defined as: LCE (ˆ y, y) = − log ˆ y if y = 1 − log(1 − ˆ y) if y = 0 The crossentropy can be written in other form as: LCE (ˆ y, y) = −y log ˆ y − (1 − y) log(1 − ˆ y) The cost function Jθ with respect to the model parameters θ is thus: Jθ = 1 N N i=1 LCE (ˆ y, y) = 1 N N i=1 −y(i) log ˆ y(i) − (1 − y(i)) log(1 − ˆ y(i)) loss_fn = nn.BCELoss() y_pred=model(x) cost=loss_fn(y_pred,y) 18
  24. Multi-class Classification What about classification tasks with more than two

    categories? • Targets form a discrete set {1, ..., k}. • It’s often more convenient to represent them as indicator vectors, or a one-of-k encoding: Model: softmax function ˆ yk = softmax(z1 . . . zk) = ezk k ezk where zk = j wkjxj + b Loss Function: cross-entropy for multiple-output case LCE(ˆ y, y) = − K k=1 yk log ˆ yk = −yT log ˆ y z = nn.linear(feature_dim, num_class) y = F.softmax(z) loss = nn.CrossEntropyLoss() 19
  25. Multi-class Classification Cost funcion Jθ = 1 N N i=1

    LCE(ˆ y, y) = −1 N N i=1 K k=1 yk log ˆ yk The gradient descent algorithm will be: wt+1 = wt − α ∂Jθ ∂w where ∂Jθ ∂w = 1 N xT(ˆ y − y) bt+1 = bt − α ∂Jθ ∂b where ∂Jθ ∂b = 1 N (ˆ y − y) 20
  26. Outline Introduction Formulating ML learning Problem: Supervised Learning Challenge of

    ML problem ML Evaluation Best practise for solving ML problem 22
  27. Data: Irrelevant Features Consider relevant features (inputs) → features that

    are correlated with prediction. • ML systems will only learn efficiently if the training data contain enough relevant features. The process of identifying relevant feature from data is called Feature engineering. Feature Engineering Involves: • Feature selection: selecting the most useful features to train on among existing features • Feature extraction: combining existing features to produce a more useful one (e.g Dimension reduction) 22
  28. Overfitting and Underfitting Central ML challenge: ML algorithm must perform

    well on new unseen inputs ⇒ Generalization. • When training the ML model on training set we measure training error. • When testing the ML model on test set we measure test error (generalization error) ⇒ should be low as possible. The performance of ML models depends on these two factors: 1 generation error ⇒ small is better. 2 the gap between generalization error and train error. 23
  29. Overfitting and Underfitting Overfitting (variance) : Occur when the gap

    between training error and test error is too large. • The model performs well on the training data, but it does not generalize well. Underfitting (bias): Occur when the model is not able to obtain sufficiently low error value on training set. • Excessively simple model Both underfitting and overfitting lead to poor predictions on new data and they do not generalize well. 24
  30. Overfitting and Underfitting Figure 5: Model complexity: credit: Gerardnico Variance-Bias

    Tradeoff • For high bias, we have a very simple model. • For the case of high variance, the model become complex. To control bias and variance 1 Reduce number of features 2 Alter the capacity of the model (regularization). 26
  31. Overfitting and Underfitting: Regularization Regularization: Reduces overfitting by adding a

    complexity penalty to the loss function. Lreg(ˆ y, y) = L(ˆ y, y) + λ 2 Ω(w) where: • λ ≥ 0 is the regularization parameter. • Ω(w) is the regularization functions which is defined as: Ω(w) = w2 for L2 regulization Ω(w) = |w| for L1 regulization 27
  32. Outline Introduction Formulating ML learning Problem: Supervised Learning Challenge of

    ML problem ML Evaluation Best practise for solving ML problem 28
  33. Evaluation protocols Learning algorithms require the tuning of many meta-parameters

    (Hyper-parameters). Hyper-parameters Hyper-parameter: a parameter of a model that is not trained (specified before training) • Have a strong impact on the performance, resulting in over-fitting through experiments. • We must be extra careful with performance estimation. • The process of choosing the best hyper-parameters is called Model selection. 28
  34. Evaluation protocols: Development cycle • There may be over-fitting, but

    it does not bias the final performance evaluation. 30
  35. Evaluation protocols: Development cycle Unfortunately, it often looks like •

    This should be avoided at all costs. • The standard strategy is to have a separate validation set for the tuning. 31
  36. Evaluation protocols: Cross validation Cross validation: Statistical method for evaluating

    how well a given algorithm will generalize when trained on a specific data set. • Used to estimate the performance of learning algorithm with less variance than a single train-test set split. • In cross validation we split the data repetedely and train a multiple models. Figure 6: Cross validation: credit: kaggle.com 32
  37. Evaluation protocols: Cross validation Types K-fold cross validation • It

    works by splitting the dataset into k-parts (e.g.k=3, k=5 or k=10). • Each split of the data is called a fold. Figure 7: K-Fold: credit: Juan Buhagiar Startified K-fold cross validation • The folds are selected so that the mean response value is approximately equal in all the folds. Figure 8: SK-Fold: credit: Mark Peng 33
  38. Performance metrics How to measure the performance of a trained

    model? Many options availabe: depend on type of problem at hand. • Classification: Accuracy, Precision, Recall, Confusion matrix etc. • Regression: RMSE, Explained variance score, Mean absolute error etc. • Clustering: Adjusted Rand index, inter-cluster density etc. Example: scik-learn metrics 34
  39. Outline Introduction Formulating ML learning Problem: Supervised Learning Challenge of

    ML problem ML Evaluation Best practise for solving ML problem 35
  40. Data exploration and cleanup • Spend time cleaning up your

    data ⇒ remove errors, outliers, nose and handle missing data. • Explore your data: visualize and identify potential correlations between inputs and outputs or between input dimensions. • Transform non-numerical data: on-hot encoding, embending etc. Figure 9: on-hot encoding credit: Adwin Jahn 35
  41. Feature transformation Normalization Make your features consistent ⇒ easy for

    ML algorithm to learn. 1 Centering: Move your dataset so that it centered around the origin. x ← (x − µ)/σ 2 Scaling: rescale your data such that each feature has maximum absolute of 1. x ← x max |x| 3 scikit-learn example Dimension Reduction • PCA. 36
  42. Lab 1: Machine Learning Fundamentals Part 1.Regression Problem: Objective: Implement

    machine learning algorithm to predict the best house price for a sample house using data related to housing prices at Boston from kaggle dataset. Part 2.Classification Problem: Objective:Predict whether or not a patient has diabetes, based on certain diagnostic measurements included in the PIMA dataset. 37
  43. References I • Intro to Neural Networks and Machine Learning:csc321

    2018, Toronto University. • Deep learning in Pytorch, Francois Fleurent: EPFL 2018. • Machine Learning course by Andrew Ng: Coursera. 38