Scribd Logo
Upload

Welcome to Scribd!

  • Case Studies Residual Networks (Resnets) : Deeplearning - Ai

    Uploaded by

    Lakshya Khandelwal
    8 views3 pages
    Residual networks (ResNets) were introduced to address the problem of degradation where deeper neural networks are more difficult to train. ResNets incorporate "skip connections" that bypass a few layers, adding the input to the output. This allows gradients to backpropagate more directly through the network, making it easier to train even with hundreds or thousands of layers. The document compares training error curves of plain and residual networks, showing residual networks continue to benefit from increased depth while plain networks experience degradation with more layers.

    Original Description:

    kjbjkb

    Original Title

    _f968ded494544a1de4b634edc2f61336_C4W2L03-ResNets

    Copyright

    © © All Rights Reserved

    Available Formats

    PPTX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    Residual networks (ResNets) were introduced to address the problem of degradation where deeper neural networks are more difficult to train. ResNets incorporate "skip connections" that bypass a few layers, adding the input to the output. This allows gradients to backpropagate more directly through the network, making it easier to train even with hundreds or thousands of layers. The document compares training error curves of plain and residual networks, showing residual networks continue to benefit from increased depth while plain networks experience degradation with more layers.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pptx, pdf, or txt
    8 views3 pages

    Case Studies Residual Networks (Resnets) : Deeplearning - Ai

    Uploaded by

    Lakshya Khandelwal
    Residual networks (ResNets) were introduced to address the problem of degradation where deeper neural networks are more difficult to train. ResNets incorporate "skip connections" that bypass a few layers, adding the input to the output. This allows gradients to backpropagate more directly through the network, making it easier to train even with hundreds or thousands of layers. The document compares training error curves of plain and residual networks, showing residual networks continue to benefit from increased depth while plain networks experience degradation with more layers.

    Copyright:

    © All Rights Reserved
    Download as PPTX, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pptx, pdf, or txt
    of 3

    Case Studies

    Residual Networks
    deeplearning.ai
    (ResNets)
    Residual block
    [+1]
    [] [+2]

    [+1] = [+1] [] + [+1] [+1] = ( [+1] ) [+2] = [+2] [+1] + [+2] [+2] = ( [+2] )

    [He et al., 2015. Deep residual networks for image recognition] Andrew Ng
    Residual Network

    x []

    Plain ResNet
    training error

    training error
    # layers # layers
    [He et al., 2015. Deep residual networks for image recognition] Andrew Ng

    You might also like