Scribd Logo
Upload

Welcome to Scribd!

  • SVM

    Uploaded by

    Gobi
    18 views19 pages
    The document describes a support vector machine (SVM) classifier with a radial basis function (RBF) kernel. It shows a kernel matrix calculated from training data and defines the decision boundary as a function of weights, biases, labels and the kernel. The RBF kernel calculates similarity based on Euclidean distance between data points.

    Original Description:

    Original Title

    svm

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document describes a support vector machine (SVM) classifier with a radial basis function (RBF) kernel. It shows a kernel matrix calculated from training data and defines the decision boundary as a function of weights, biases, labels and the kernel. The RBF kernel calculates similarity based on Euclidean distance between data points.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    18 views19 pages

    SVM

    Uploaded by

    Gobi
    The document describes a support vector machine (SVM) classifier with a radial basis function (RBF) kernel. It shows a kernel matrix calculated from training data and defines the decision boundary as a function of weights, biases, labels and the kernel. The RBF kernel calculates similarity based on Euclidean distance between data points.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 19

    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 1


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 2


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 3


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 4


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 5


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 6


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 7


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 8


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 9


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 10


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 11


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 12


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 13


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 14


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 15


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 16


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 17


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 18


    x'1 x'2

    Linear
    yi xi
    x'j
    2
    4
    3
    1
    1
    1
    SVM
    1 x1 1 2 1 Kernel Matrix
    -1 x2 0 4 3
    1 x3 0 3 0
    K(xi , x'j)
    -1 x4 0 3 1
    1 x5 5 0 3
    -1 x6 1 4 3

    ai 2 0 1 1 1 1 Decision Boundary
    b
    ai yi 2 b + ∑ai yi K
    sign

    RBF x'j 2
    4
    -γ||2
    -0.5
    !□
    0.6
    1
    1
    -0.4 0.67
    L2 distance ||2 3 -0.3 0.7 1
    -γ||2
    xi (x - x')2 ∑ (-0.1) !□
    -0.2
    -0.1
    0.8
    0.9

    1 2 1
    0 4 3
    0 3 0
    0 3 1
    5 0 3
    1 4 3

    ai 20 10 10 10 0 10
    b
    ai yi -1

    sign

    AI by Hand ✍ Vol. 2 © 2024 Tom Yeh 19

    You might also like