ݺߣ

ݺߣShare a Scribd company logo
CH 17
GOING A STEP BEYOND USING
SUPPORT VECTOR
MACHINES
10766012h Jason
Revisiting the Separation
Problem
? Nonseparability of classes
? There is no straight line that traces a precise border
between different examples.
? Other options
? K-Nearest Neighbors : Ch14
? Logistic regression : Ch15
? Transforming the features : Solves the problem by
employing both feature creation
? Decision treesNeural networks
Characteristics of
Support Vector Machines
? Binary and multiclass classification, regression, and
detection of anomalous or novelty data
? Robust handling of overfitting, noisy data, and outliers
? A capability to handle situations with many variables
? Easy and timely handling of up to about 10,000
training examples
? Automatic detection of nonlinearity in data
Explaining the Algorithm
SVM - Linear
Negative hyperplane
Positive hyperplane
Support Vector
Applying Nonlinearity
? Nonlinearly
separable points
requiring feature
transformation
(left) to be fit by a
line (right).
? Make the existing
features onto a
feature space of
higher
dimensionality
Applying Nonlinearity
? Problems and limits :
? The number of features increases exponentially, making
computations cumbersome Ӌ㷱}
? The expansion creates many redundant features,
causing overfitting. N
? Difficult to determine becoming linearly or not, requiring
many iterations of expansion and test
Kernel functions
? kernel functions project the original features into
a higher dimensional space by combining them
in a nonlinear way
? rely on algebra calculations
Discovering the different
kernels
? Linear: Suitable for linear
? No extra parameters
? Radial Basis Function: Suitable for non-linear
? parameters: gamma
? Polynomial: suitable for non-linear
? parameters: gamma, degree, and coef0
? Sigmoid: Binary classification like Logistic Regression
? parameters: gamma and coef0
? Custom-made kernels: Depends upon the kernel
Radial Basis Function
? An RBF kernel
that uses
diverse hyper-
parameters to
create unique
SVM solutions.
? The RBF kernel can adapt itself to different
learning strategies
? the error cost is high -> bended hyperplane
? the error cost is low -> smoother curve line
Kernels
? The polynomial and sigmoid kernels arent as
adaptable as RBF, thus showing more bias
? Most data problems are easily solved using the
RBF
sigmoid polynomial
Classifying and Estimating
with SVM
? handwritten recognition task
? the digits dataset (from Scikit-learn)
? nonlinear kernel, using the RBF
? a series of 8-x-8 grayscale pixel images of
handwritten numbers ranging from 0 to 9.

More Related Content

Similar to Ml ch17 (20)

General Tips for participating Kaggle Competitions
General Tips for participating Kaggle CompetitionsGeneral Tips for participating Kaggle Competitions
General Tips for participating Kaggle Competitions
Mark Peng
?
Why quants love NAG & NAG from Excel
Why quants love NAG & NAG from ExcelWhy quants love NAG & NAG from Excel
Why quants love NAG & NAG from Excel
Marcin Krzysztofik
?
SVMs.pptx support vector machines machine learning
SVMs.pptx support vector machines machine learningSVMs.pptx support vector machines machine learning
SVMs.pptx support vector machines machine learning
AmgadAbdallah2
?
The Case for Learned Index Structures
The Case for Learned Index StructuresThe Case for Learned Index Structures
The Case for Learned Index Structures
?
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...
Spark Summit
?
Week5-Faster R-CNN.pptx
Week5-Faster R-CNN.pptxWeek5-Faster R-CNN.pptx
Week5-Faster R-CNN.pptx
fahmi324663
?
How Machine Learning Helps Organizations to Work More Efficiently?
How Machine Learning Helps Organizations to Work More Efficiently?How Machine Learning Helps Organizations to Work More Efficiently?
How Machine Learning Helps Organizations to Work More Efficiently?
Tuan Yang
?
201907 AutoML and Neural Architecture Search
201907 AutoML and Neural Architecture Search201907 AutoML and Neural Architecture Search
201907 AutoML and Neural Architecture Search
DaeJin Kim
?
Faster R-CNN - PR012
Faster R-CNN - PR012Faster R-CNN - PR012
Faster R-CNN - PR012
Jinwon Lee
?
Day17.pptx department of computer science and eng
Day17.pptx department of computer science and engDay17.pptx department of computer science and eng
Day17.pptx department of computer science and eng
RamaKrishnaErroju
?
[Q-tangled 22] Deconstructing Quantum Machine Learning Algorithms - Sasha Laz...
[Q-tangled 22] Deconstructing Quantum Machine Learning Algorithms - Sasha Laz...[Q-tangled 22] Deconstructing Quantum Machine Learning Algorithms - Sasha Laz...
[Q-tangled 22] Deconstructing Quantum Machine Learning Algorithms - Sasha Laz...
DataScienceConferenc1
?
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Bootstrap Your Own Latent: A New Approach to Self-Supervised LearningBootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Sungchul Kim
?
Towards Detecting Performance Anti-patterns Using Classification Techniques
Towards Detecting Performance Anti-patterns Using Classification TechniquesTowards Detecting Performance Anti-patterns Using Classification Techniques
Towards Detecting Performance Anti-patterns Using Classification Techniques
James Hill
?
Welch Verolog 2013
Welch Verolog 2013Welch Verolog 2013
Welch Verolog 2013
Philip Welch
?
Introduction to deep learning
Introduction to deep learningIntroduction to deep learning
Introduction to deep learning
Vishwas Lele
?
SVM_and_Kernels_with_Visuals_and_Code.pptx
SVM_and_Kernels_with_Visuals_and_Code.pptxSVM_and_Kernels_with_Visuals_and_Code.pptx
SVM_and_Kernels_with_Visuals_and_Code.pptx
RushikeshKadam60
?
Machine Learning Workshop
Machine Learning WorkshopMachine Learning Workshop
Machine Learning Workshop
Osman Ramadan
?
Improving region based CNN object detector using bayesian optimization
Improving region based CNN object detector using bayesian optimizationImproving region based CNN object detector using bayesian optimization
Improving region based CNN object detector using bayesian optimization
Amgad Muhammad
?
Performance Benchmarking of the R Programming Environment on the Stampede 1.5...
Performance Benchmarking of the R Programming Environment on the Stampede 1.5...Performance Benchmarking of the R Programming Environment on the Stampede 1.5...
Performance Benchmarking of the R Programming Environment on the Stampede 1.5...
James McCombs
?
AMBER presentation
AMBER presentationAMBER presentation
AMBER presentation
Giorgio Orsi
?
General Tips for participating Kaggle Competitions
General Tips for participating Kaggle CompetitionsGeneral Tips for participating Kaggle Competitions
General Tips for participating Kaggle Competitions
Mark Peng
?
Why quants love NAG & NAG from Excel
Why quants love NAG & NAG from ExcelWhy quants love NAG & NAG from Excel
Why quants love NAG & NAG from Excel
Marcin Krzysztofik
?
SVMs.pptx support vector machines machine learning
SVMs.pptx support vector machines machine learningSVMs.pptx support vector machines machine learning
SVMs.pptx support vector machines machine learning
AmgadAbdallah2
?
The Case for Learned Index Structures
The Case for Learned Index StructuresThe Case for Learned Index Structures
The Case for Learned Index Structures
?
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...
Large-Scale Lasso and Elastic-Net Regularized Generalized Linear Models (DB T...
Spark Summit
?
Week5-Faster R-CNN.pptx
Week5-Faster R-CNN.pptxWeek5-Faster R-CNN.pptx
Week5-Faster R-CNN.pptx
fahmi324663
?
How Machine Learning Helps Organizations to Work More Efficiently?
How Machine Learning Helps Organizations to Work More Efficiently?How Machine Learning Helps Organizations to Work More Efficiently?
How Machine Learning Helps Organizations to Work More Efficiently?
Tuan Yang
?
201907 AutoML and Neural Architecture Search
201907 AutoML and Neural Architecture Search201907 AutoML and Neural Architecture Search
201907 AutoML and Neural Architecture Search
DaeJin Kim
?
Faster R-CNN - PR012
Faster R-CNN - PR012Faster R-CNN - PR012
Faster R-CNN - PR012
Jinwon Lee
?
Day17.pptx department of computer science and eng
Day17.pptx department of computer science and engDay17.pptx department of computer science and eng
Day17.pptx department of computer science and eng
RamaKrishnaErroju
?
[Q-tangled 22] Deconstructing Quantum Machine Learning Algorithms - Sasha Laz...
[Q-tangled 22] Deconstructing Quantum Machine Learning Algorithms - Sasha Laz...[Q-tangled 22] Deconstructing Quantum Machine Learning Algorithms - Sasha Laz...
[Q-tangled 22] Deconstructing Quantum Machine Learning Algorithms - Sasha Laz...
DataScienceConferenc1
?
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Bootstrap Your Own Latent: A New Approach to Self-Supervised LearningBootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning
Sungchul Kim
?
Towards Detecting Performance Anti-patterns Using Classification Techniques
Towards Detecting Performance Anti-patterns Using Classification TechniquesTowards Detecting Performance Anti-patterns Using Classification Techniques
Towards Detecting Performance Anti-patterns Using Classification Techniques
James Hill
?
Introduction to deep learning
Introduction to deep learningIntroduction to deep learning
Introduction to deep learning
Vishwas Lele
?
SVM_and_Kernels_with_Visuals_and_Code.pptx
SVM_and_Kernels_with_Visuals_and_Code.pptxSVM_and_Kernels_with_Visuals_and_Code.pptx
SVM_and_Kernels_with_Visuals_and_Code.pptx
RushikeshKadam60
?
Machine Learning Workshop
Machine Learning WorkshopMachine Learning Workshop
Machine Learning Workshop
Osman Ramadan
?
Improving region based CNN object detector using bayesian optimization
Improving region based CNN object detector using bayesian optimizationImproving region based CNN object detector using bayesian optimization
Improving region based CNN object detector using bayesian optimization
Amgad Muhammad
?
Performance Benchmarking of the R Programming Environment on the Stampede 1.5...
Performance Benchmarking of the R Programming Environment on the Stampede 1.5...Performance Benchmarking of the R Programming Environment on the Stampede 1.5...
Performance Benchmarking of the R Programming Environment on the Stampede 1.5...
James McCombs
?

More from Jason Chen (7)

Optimize0530v 3
Optimize0530v 3Optimize0530v 3
Optimize0530v 3
Jason Chen
?
Ai robot
Ai robotAi robot
Ai robot
Jason Chen
?
Outlier detection in audit logs for application systems
Outlier detection in audit logs for application systemsOutlier detection in audit logs for application systems
Outlier detection in audit logs for application systems
Jason Chen
?
PHILIPPINE JASON 0530
 PHILIPPINE JASON 0530 PHILIPPINE JASON 0530
PHILIPPINE JASON 0530
Jason Chen
?
JASON - Data mining
JASON - Data miningJASON - Data mining
JASON - Data mining
Jason Chen
?
10766012 ranalitics
10766012 ranalitics10766012 ranalitics
10766012 ranalitics
Jason Chen
?
Post Big Data 0530
Post Big Data 0530Post Big Data 0530
Post Big Data 0530
Jason Chen
?
Outlier detection in audit logs for application systems
Outlier detection in audit logs for application systemsOutlier detection in audit logs for application systems
Outlier detection in audit logs for application systems
Jason Chen
?
PHILIPPINE JASON 0530
 PHILIPPINE JASON 0530 PHILIPPINE JASON 0530
PHILIPPINE JASON 0530
Jason Chen
?
JASON - Data mining
JASON - Data miningJASON - Data mining
JASON - Data mining
Jason Chen
?
10766012 ranalitics
10766012 ranalitics10766012 ranalitics
10766012 ranalitics
Jason Chen
?
Post Big Data 0530
Post Big Data 0530Post Big Data 0530
Post Big Data 0530
Jason Chen
?

Recently uploaded (20)

SQL-for-Data-Analytics-Top-10-Queries-Every-Analyst-Should-Know
SQL-for-Data-Analytics-Top-10-Queries-Every-Analyst-Should-KnowSQL-for-Data-Analytics-Top-10-Queries-Every-Analyst-Should-Know
SQL-for-Data-Analytics-Top-10-Queries-Every-Analyst-Should-Know
Ozias Rondon
?
Reason To Switch to DNNDNNs excel in handling huge volumes of data (e.g., ima...
Reason To Switch to DNNDNNs excel in handling huge volumes of data (e.g., ima...Reason To Switch to DNNDNNs excel in handling huge volumes of data (e.g., ima...
Reason To Switch to DNNDNNs excel in handling huge volumes of data (e.g., ima...
SrideviPcSenthilkuma
?
FOOD LAWS.pptxbshdhdhdhdhdhhdhdhdhdhdhhdh
FOOD LAWS.pptxbshdhdhdhdhdhhdhdhdhdhdhhdhFOOD LAWS.pptxbshdhdhdhdhdhhdhdhdhdhdhhdh
FOOD LAWS.pptxbshdhdhdhdhdhhdhdhdhdhdhhdh
cshdhdhvfsbzdb
?
Epidemiology 009 Data collection tools .pdf
Epidemiology 009 Data collection tools .pdfEpidemiology 009 Data collection tools .pdf
Epidemiology 009 Data collection tools .pdf
oduroantiri
?
10514-risk management powerpoint-red.pptx
10514-risk management powerpoint-red.pptx10514-risk management powerpoint-red.pptx
10514-risk management powerpoint-red.pptx
sarovarenter
?
Turinton Insights - Enterprise Agentic AI Platform
Turinton Insights - Enterprise Agentic AI PlatformTurinton Insights - Enterprise Agentic AI Platform
Turinton Insights - Enterprise Agentic AI Platform
vikrant530668
?
chap2_nnejjejehhehehhhhhhhhhehslides.ppt
chap2_nnejjejehhehehhhhhhhhhehslides.pptchap2_nnejjejehhehehhhhhhhhhehslides.ppt
chap2_nnejjejehhehehhhhhhhhhehslides.ppt
Nikhil620181
?
Types_of_Data_Structures_Presentation.pptx
Types_of_Data_Structures_Presentation.pptxTypes_of_Data_Structures_Presentation.pptx
Types_of_Data_Structures_Presentation.pptx
shefalisharma776119
?
A Simple Introduction to data Science- what is it and what does it do
A Simple Introduction to data Science- what is it and what does it doA Simple Introduction to data Science- what is it and what does it do
A Simple Introduction to data Science- what is it and what does it do
sarah mabrouk
?
Blood Bank Management Skahfhfhystem.pptx
Blood Bank Management Skahfhfhystem.pptxBlood Bank Management Skahfhfhystem.pptx
Blood Bank Management Skahfhfhystem.pptx
vedantgupta411
?
ijcnlp04.....................................................
ijcnlp04.....................................................ijcnlp04.....................................................
ijcnlp04.....................................................
muhammadbsee749
?
DII-WS Training Manual with Links_V2.pdf
DII-WS Training Manual with Links_V2.pdfDII-WS Training Manual with Links_V2.pdf
DII-WS Training Manual with Links_V2.pdf
coolprince739
?
Presentation_DM_applications for another services
Presentation_DM_applications for another servicesPresentation_DM_applications for another services
Presentation_DM_applications for another services
aldowilmeryapita
?
The rise of AI Agents - Beyond Automation_ The Rise of AI Agents in Service ...
The rise of AI Agents -  Beyond Automation_ The Rise of AI Agents in Service ...The rise of AI Agents -  Beyond Automation_ The Rise of AI Agents in Service ...
The rise of AI Agents - Beyond Automation_ The Rise of AI Agents in Service ...
Yasen Lilov
?
Data-Ethics-and-Privacy-What-Every-Analyst-Should-Know
Data-Ethics-and-Privacy-What-Every-Analyst-Should-KnowData-Ethics-and-Privacy-What-Every-Analyst-Should-Know
Data-Ethics-and-Privacy-What-Every-Analyst-Should-Know
Ozias Rondon
?
Chat Bots - An Analytical study including Indian players
Chat Bots - An Analytical study including Indian playersChat Bots - An Analytical study including Indian players
Chat Bots - An Analytical study including Indian players
DR. Ram Kumar Pathak
?
Statistics for Management - standard deviation.pptx
Statistics for Management - standard deviation.pptxStatistics for Management - standard deviation.pptx
Statistics for Management - standard deviation.pptx
Jeya Sree
?
Automating-Your-World-with-Python-Scripts
Automating-Your-World-with-Python-ScriptsAutomating-Your-World-with-Python-Scripts
Automating-Your-World-with-Python-Scripts
Ozias Rondon
?
DRMS-S- 13 CCA-DRR-Social Protection.ppt
DRMS-S- 13 CCA-DRR-Social Protection.pptDRMS-S- 13 CCA-DRR-Social Protection.ppt
DRMS-S- 13 CCA-DRR-Social Protection.ppt
ChiefTraining
?
diagram ANN of factor and responses.pptx
diagram ANN of factor and responses.pptxdiagram ANN of factor and responses.pptx
diagram ANN of factor and responses.pptx
EdunjobiTunde1
?
SQL-for-Data-Analytics-Top-10-Queries-Every-Analyst-Should-Know
SQL-for-Data-Analytics-Top-10-Queries-Every-Analyst-Should-KnowSQL-for-Data-Analytics-Top-10-Queries-Every-Analyst-Should-Know
SQL-for-Data-Analytics-Top-10-Queries-Every-Analyst-Should-Know
Ozias Rondon
?
Reason To Switch to DNNDNNs excel in handling huge volumes of data (e.g., ima...
Reason To Switch to DNNDNNs excel in handling huge volumes of data (e.g., ima...Reason To Switch to DNNDNNs excel in handling huge volumes of data (e.g., ima...
Reason To Switch to DNNDNNs excel in handling huge volumes of data (e.g., ima...
SrideviPcSenthilkuma
?
FOOD LAWS.pptxbshdhdhdhdhdhhdhdhdhdhdhhdh
FOOD LAWS.pptxbshdhdhdhdhdhhdhdhdhdhdhhdhFOOD LAWS.pptxbshdhdhdhdhdhhdhdhdhdhdhhdh
FOOD LAWS.pptxbshdhdhdhdhdhhdhdhdhdhdhhdh
cshdhdhvfsbzdb
?
Epidemiology 009 Data collection tools .pdf
Epidemiology 009 Data collection tools .pdfEpidemiology 009 Data collection tools .pdf
Epidemiology 009 Data collection tools .pdf
oduroantiri
?
10514-risk management powerpoint-red.pptx
10514-risk management powerpoint-red.pptx10514-risk management powerpoint-red.pptx
10514-risk management powerpoint-red.pptx
sarovarenter
?
Turinton Insights - Enterprise Agentic AI Platform
Turinton Insights - Enterprise Agentic AI PlatformTurinton Insights - Enterprise Agentic AI Platform
Turinton Insights - Enterprise Agentic AI Platform
vikrant530668
?
chap2_nnejjejehhehehhhhhhhhhehslides.ppt
chap2_nnejjejehhehehhhhhhhhhehslides.pptchap2_nnejjejehhehehhhhhhhhhehslides.ppt
chap2_nnejjejehhehehhhhhhhhhehslides.ppt
Nikhil620181
?
Types_of_Data_Structures_Presentation.pptx
Types_of_Data_Structures_Presentation.pptxTypes_of_Data_Structures_Presentation.pptx
Types_of_Data_Structures_Presentation.pptx
shefalisharma776119
?
A Simple Introduction to data Science- what is it and what does it do
A Simple Introduction to data Science- what is it and what does it doA Simple Introduction to data Science- what is it and what does it do
A Simple Introduction to data Science- what is it and what does it do
sarah mabrouk
?
Blood Bank Management Skahfhfhystem.pptx
Blood Bank Management Skahfhfhystem.pptxBlood Bank Management Skahfhfhystem.pptx
Blood Bank Management Skahfhfhystem.pptx
vedantgupta411
?
ijcnlp04.....................................................
ijcnlp04.....................................................ijcnlp04.....................................................
ijcnlp04.....................................................
muhammadbsee749
?
DII-WS Training Manual with Links_V2.pdf
DII-WS Training Manual with Links_V2.pdfDII-WS Training Manual with Links_V2.pdf
DII-WS Training Manual with Links_V2.pdf
coolprince739
?
Presentation_DM_applications for another services
Presentation_DM_applications for another servicesPresentation_DM_applications for another services
Presentation_DM_applications for another services
aldowilmeryapita
?
The rise of AI Agents - Beyond Automation_ The Rise of AI Agents in Service ...
The rise of AI Agents -  Beyond Automation_ The Rise of AI Agents in Service ...The rise of AI Agents -  Beyond Automation_ The Rise of AI Agents in Service ...
The rise of AI Agents - Beyond Automation_ The Rise of AI Agents in Service ...
Yasen Lilov
?
Data-Ethics-and-Privacy-What-Every-Analyst-Should-Know
Data-Ethics-and-Privacy-What-Every-Analyst-Should-KnowData-Ethics-and-Privacy-What-Every-Analyst-Should-Know
Data-Ethics-and-Privacy-What-Every-Analyst-Should-Know
Ozias Rondon
?
Chat Bots - An Analytical study including Indian players
Chat Bots - An Analytical study including Indian playersChat Bots - An Analytical study including Indian players
Chat Bots - An Analytical study including Indian players
DR. Ram Kumar Pathak
?
Statistics for Management - standard deviation.pptx
Statistics for Management - standard deviation.pptxStatistics for Management - standard deviation.pptx
Statistics for Management - standard deviation.pptx
Jeya Sree
?
Automating-Your-World-with-Python-Scripts
Automating-Your-World-with-Python-ScriptsAutomating-Your-World-with-Python-Scripts
Automating-Your-World-with-Python-Scripts
Ozias Rondon
?
DRMS-S- 13 CCA-DRR-Social Protection.ppt
DRMS-S- 13 CCA-DRR-Social Protection.pptDRMS-S- 13 CCA-DRR-Social Protection.ppt
DRMS-S- 13 CCA-DRR-Social Protection.ppt
ChiefTraining
?
diagram ANN of factor and responses.pptx
diagram ANN of factor and responses.pptxdiagram ANN of factor and responses.pptx
diagram ANN of factor and responses.pptx
EdunjobiTunde1
?

Ml ch17

  • 1. CH 17 GOING A STEP BEYOND USING SUPPORT VECTOR MACHINES 10766012h Jason
  • 2. Revisiting the Separation Problem ? Nonseparability of classes ? There is no straight line that traces a precise border between different examples. ? Other options ? K-Nearest Neighbors : Ch14 ? Logistic regression : Ch15 ? Transforming the features : Solves the problem by employing both feature creation ? Decision treesNeural networks
  • 3. Characteristics of Support Vector Machines ? Binary and multiclass classification, regression, and detection of anomalous or novelty data ? Robust handling of overfitting, noisy data, and outliers ? A capability to handle situations with many variables ? Easy and timely handling of up to about 10,000 training examples ? Automatic detection of nonlinearity in data
  • 5. SVM - Linear Negative hyperplane Positive hyperplane Support Vector
  • 6. Applying Nonlinearity ? Nonlinearly separable points requiring feature transformation (left) to be fit by a line (right). ? Make the existing features onto a feature space of higher dimensionality
  • 7. Applying Nonlinearity ? Problems and limits : ? The number of features increases exponentially, making computations cumbersome Ӌ㷱} ? The expansion creates many redundant features, causing overfitting. N ? Difficult to determine becoming linearly or not, requiring many iterations of expansion and test
  • 8. Kernel functions ? kernel functions project the original features into a higher dimensional space by combining them in a nonlinear way ? rely on algebra calculations
  • 9. Discovering the different kernels ? Linear: Suitable for linear ? No extra parameters ? Radial Basis Function: Suitable for non-linear ? parameters: gamma ? Polynomial: suitable for non-linear ? parameters: gamma, degree, and coef0 ? Sigmoid: Binary classification like Logistic Regression ? parameters: gamma and coef0 ? Custom-made kernels: Depends upon the kernel
  • 10. Radial Basis Function ? An RBF kernel that uses diverse hyper- parameters to create unique SVM solutions. ? The RBF kernel can adapt itself to different learning strategies ? the error cost is high -> bended hyperplane ? the error cost is low -> smoother curve line
  • 11. Kernels ? The polynomial and sigmoid kernels arent as adaptable as RBF, thus showing more bias ? Most data problems are easily solved using the RBF sigmoid polynomial
  • 12. Classifying and Estimating with SVM ? handwritten recognition task ? the digits dataset (from Scikit-learn) ? nonlinear kernel, using the RBF ? a series of 8-x-8 grayscale pixel images of handwritten numbers ranging from 0 to 9.