Scribd Logo
Upload

Welcome to Scribd!

  • LSTM inExcelUnsolved

    Uploaded by

    rishikesh10808
    6 views7 pages
    This document appears to describe the mathematical operations of a long short-term memory (LSTM) neural network. It includes the equations and variable values for the forget, input, and output gates as well as the cell state. Matrices named W_f, W_i, W_C, and W_o are multiplied with the previous hidden state and current input to calculate gate values and cell state. The cell state is updated based on the previous cell state and new gate values. The hidden state is then calculated from the cell state and output gate.

    Original Description:

    Original Title

    LSTM_inExcelUnsolved

    Copyright

    © © All Rights Reserved

    Available Formats

    XLSX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document appears to describe the mathematical operations of a long short-term memory (LSTM) neural network. It includes the equations and variable values for the forget, input, and output gates as well as the cell state. Matrices named W_f, W_i, W_C, and W_o are multiplied with the previous hidden state and current input to calculate gate values and cell state. The cell state is updated based on the previous cell state and new gate values. The hidden state is then calculated from the cell state and output gate.

    Copyright:

    © All Rights Reserved
    Download as XLSX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as xlsx, pdf, or txt
    6 views7 pages

    LSTM inExcelUnsolved

    Uploaded by

    rishikesh10808
    This document appears to describe the mathematical operations of a long short-term memory (LSTM) neural network. It includes the equations and variable values for the forget, input, and output gates as well as the cell state. Matrices named W_f, W_i, W_C, and W_o are multiplied with the previous hidden state and current input to calculate gate values and cell state. The cell state is updated based on the previous cell state and new gate values. The hidden state is then calculated from the cell state and output gate.

    Copyright:

    © All Rights Reserved
    Download as XLSX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as xlsx, pdf, or txt
    of 7

    𝑥 �

    _ �
    𝑡1 _0.19 0.82 0.22 0.43 0.43 0.45 0.57
    0 𝑓0.5 0.77 0.79 0.19 0.1 0.72 0.61
    0 0.34 0.1 0.16 0.79 0.74 0.19 0.58
    0

    ℎ �
    _ �
    0.26
    ( 0.29 0.85 0.57 0.49 0.88 0.45 0.17
    _
    0.72
    𝑡 𝑖 0.9 0.87 0.69 0.19 0.21 0.72 0.41
    −
    0.36 0.54 0.09 0.56 0.49 0.04 0.39 0.58
    1
    )
    𝐶 �
    _ �
    (0.1 _0.29 0.85 0.57 0.49 0.88 0.45 0.17
    -0.92
    𝑡 𝐶 0.9 0.87 0.69 0.19 0.21 0.72 0.41
    −
    0.36 0.54 0.09 0.56 0.49 0.04 0.39 0.58
    1
    )
    �
    �
    0.85
    _ 0.15 0.77 0.89 0.88 0.45 0.17
    𝑜0.1 0.34 0.39 0.46 0.21 0.72 0.41
    0.38 0.69 0.16 0.59 0.04 0.39 0.58
    ℎ_(𝑡−1)+ 𝑊_𝑓⋅[ℎ_(𝑡−1),𝑥_𝑡 ]
    𝑥_𝑡
    0.26 1.15
    0.72 1.16
    0.36 1.01
    1
    0
    0
    0
    𝑊_𝑖⋅[ℎ_(𝑡−1),𝑥_𝑡 ] 𝑖_𝑡=𝜎(𝑊_𝑖⋅[ℎ_(𝑡−1),𝑥_𝑡 ])
    1.38 0.8
    1.3 0.79
    0.9 0.71

    𝑊_𝐶⋅[ℎ_(𝑡−1),𝑥_𝑡 ] 𝐶 ̃_𝑡=tanh⁡〖 (𝑊_𝐶⋅[ℎ_(𝑡−1),𝑥_𝑡 ]) 〗


    1.38 0.88
    1.3 0.86
    0.9 0.72

    𝑊_0⋅[ℎ_(𝑡−1),𝑥_𝑡 ] 𝑜_𝑡=𝜎(𝑊_0⋅[ℎ_(𝑡−1),𝑥_𝑡 ]) tanh⁡〖 (𝐶_𝑡) 〗


    1.5 0.82
    0.87 0.7
    1.24 0.78
    1),𝑥_𝑡 ] 𝑓_𝑡=𝜎(𝑊_𝑓⋅[ℎ_(𝑡−1),𝑥_𝑡 ])
    0.76
    0.76
    0.73

    𝑓_𝑡∗𝐶_(𝑡−1)
    0.08
    -0.7
    0.26

    𝑡−1),𝑥_𝑡 ]) 〗 𝑖_𝑡∗𝐶 ̃_𝑡 𝐶_𝑡=𝑓_𝑡∗𝐶_(𝑡−1)+𝑖_𝑡∗𝐶 ̃_𝑡


    0.7 0.78
    0.68 -0.02
    0.51 0.77

    tanh⁡〖 (𝐶_𝑡) 〗ℎ_𝑡= 〖𝑜 _𝑡∗tanh 〗〖


    ⁡ (𝐶_𝑡) 〗
    0.65 0.533
    -0.02 -0.01
    0.65 0.51
    A B A*B
    0.19 0.21 0.94 0.72 0.14 0.14 0.53 0.63
    0.59 0.11 0.19 0.25 0.94 0.48 0.52 0.27
    0.54 0.31 0.11 0.36 0.43 0.6 0.51 0.41

    SIGMOID A TANH(A)
    0.55 0.55 0.72 0.19 0.21 0.74
    0.64 0.53 0.55 0.53 0.11 0.19
    0.63 0.58 0.53 0.49 0.3 0.11
    A*B
    0.69
    0.25
    0.29

    You might also like