Kernel trick----PRML读书笔记
Many linear parametric models can be re-cast into an equivalent 'dual representstion' in which the predictions are also based on linear combinations of a kernel function evaluated at the training data points. As we shall see, for models which are based on a fixed nonlinear feature space mapping Φ(x), the kernel function is given by the relation: k(x,x')=Φ(x)TΦ(x')=ΣΦi(x)Φi(x'). From this definition, we see that the kernel is a symmetric function of its arguments so that k(x,x')=k(x',x).
The simplest example of a kernel function is obtained by considering the identity mapping for the feature space so that Φ(x)=x, in which case k(x, x')=xTx'. We shall refer to this as the linear kernel. The concept of a kernel formulated as an inner product in a feature space allows us to build interesting extensions of many well-known algorithms by making use of the kernel trick, also known as kernel substitution. The general idea is that, if we have an algorithm formulated in such a way that the input vector x enters only in the form of scalar products, then we can replace that scalar product with some other choice of kernel.
We require that the kernel k(x,x') be symmetric and positive semidefinite anf that it expresses the appropriate form of similarity between x and x' according to the intended application.
最新文章
- handsontable组件和jqwidgets(jqxdragdrop组件)在一个页面产生调整宽高bug
- Python处理json格式的数据文件(一些坑、一些疑惑)
- angular+requirejs前端整合
- [转载]jQuery诞生记-原理与机制
- python- shutil 高级文件操作
- shell学习三十四天----printf详解
- .net后台获取HTML中select元素选中的值
- 第十四章:高级I/O
- 多态-I(继承实现)
- MySql中的事件
- Android 中Activity生命周期分析(二):从AActivity 到BActivity过程分析
- C#学习笔记(三)
- 2016041601 - maven用途
- swfupload多图上传插件(ASP.NET)
- Java调用IDL出错处理
- Luogu P1747 好奇怪的游戏
- MySQL协议学习(1):准备工作
- maven相关配置
- 第七次实验:CC2530平台上多跳通信的TinyOS编程
- 采用shell脚本定时清理Tomcat日志