Scribd Logo
Upload

Welcome to Scribd!

  • Neural Net Basics

    Uploaded by

    phli
    31 views2 pages
    This document provides an overview of neural networks and how they are trained. It explains that neural networks consist of interconnected nodes that produce an output based on weighted inputs and an activation function. The weights are adjusted during training to minimize the difference between the network's output and the correct answer. Training occurs through backpropagation, where the error is calculated and used to update the weights. Examples are provided to illustrate how weights are adjusted during training of simple networks.

    Original Description:

    just the simplest fundamentals; need to add linear algebra linear regression.

    Original Title

    neural net basics

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document provides an overview of neural networks and how they are trained. It explains that neural networks consist of interconnected nodes that produce an output based on weighted inputs and an activation function. The weights are adjusted during training to minimize the difference between the network's output and the correct answer. Training occurs through backpropagation, where the error is calculated and used to update the weights. Examples are provided to illustrate how weights are adjusted during training of simple networks.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    31 views2 pages

    Neural Net Basics

    Uploaded by

    phli
    This document provides an overview of neural networks and how they are trained. It explains that neural networks consist of interconnected nodes that produce an output based on weighted inputs and an activation function. The weights are adjusted during training to minimize the difference between the network's output and the correct answer. Training occurs through backpropagation, where the error is calculated and used to update the weights. Examples are provided to illustrate how weights are adjusted during training of simple networks.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 2

    Neural Nets∗

    USC Linguistics

    August 8, 2007

    P
    i fi wi > threshold → Output = 1, else Output = 0

    1 Simple Logical Connectives


    and: or: not:

    {1,0}*1 {1,0}*1 {1,0}*1 {1,0}*1 {1,0}*-1


    + +

    >1.5? >.5? >-.5

    or:
    and: not:
    {1,0}*1 1*-.5 {1,0}*1
    {1,0}*1 1*-1.5 {1,0}*1 {1,0}*-1 1*.5
    + +
    + + +
    >0?
    >0? >0?

    ∗
    Thanks to David Wilczynski whose clear presentation and explicit examplification are emulated here; also Russell
    and Norvig’s on-line notes.

    1
    XOR:
    {1,0} {1,0}

    *1 *-1 *-1 *1

    >0? >0?

    {1,0}*1 {1,0}*1

    >0?

    2 Training
    ∆w = (C) ∗ Error ∗ f
    Error = CorrectAnswer − Output

    2.1 or, C=1, threshold=.5


    ex. f1 f2 CA w1 w2 f1 w1 + f2 w2 Output Error ∆w1 ∆w2
    1 0 0 0 0 0 0 0 0 0 0
    2 1 0 1 0 0 0 0 1 1 0
    3 0 1 1 1 0 0 0 1 0 1
    4 1 1 1 1 1 1 1 0 0 0

    2.2 or, C=.5, threshold=0


    P
    ex. f1 f2 f3 CA w1 w2 w3 i fi wi Output Error ∆w1 ∆w2 ∆w3
    1 0 0 1 0 0 0 0 0 0 0 0 0 0
    2 1 0 1 1 0 0 0 0 0 1 .5 0 .5
    3 0 1 1 1 .5 0 .5 .5 1 0 0 0 0
    4 1 1 1 1 .5 0 .5 1 1 0 0 0 0
    1 0 0 1 0 .5 0 .5 .5 1 -1 0 0 -.5
    2 1 0 1 1 .5 0 0 .5 1 0 0 0 0
    3 0 1 1 1 .5 0 0 0 0 1 0 .5 .5
    4 1 1 1 1 .5 .5 .5 1.5 1 0 0 0 0
    1 0 0 1 0 .5 .5 .5 .5 1 -1 0 0 -.5
    2 1 0 1 1 .5 .5 0 .5 1 0 0 0 0
    3 0 1 1 1 .5 .5 0 .5 1 0 0 0 0
    4 1 1 1 1 .5 .5 0 1 1 0 0 0 0
    1 0 0 1 0 .5 .5 0 0 0 0 0 0 0
    2 1 0 1 1 .5 .5 0 .5 1 0 0 0 0
    3 0 1 1 1 .5 .5 0 .5 1 0 0 0 0
    4 1 1 1 1 .5 .5 0 1 1 0 0 0 0

    You might also like