Scribd Logo
Upload

Welcome to Scribd!

  • Assignment 7

    Uploaded by

    vullingala syanthan
    7 views1 page
    The document outlines 11 questions for Assignment 7 covering topics in convolutional networks, overfitting, dropout, class imbalance, loss functions, recurrent neural networks, attention mechanisms, and maximum likelihood estimation. Specifically, it asks about channels in convnets, overfitting and methods to mitigate it like dropout, class imbalance problems and solutions, recommending L1 or L2 loss, explaining LSTMs and gated RNNs, attention in RNNs, and why cross entropy is a good loss function for neural networks.

    Original Description:

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document outlines 11 questions for Assignment 7 covering topics in convolutional networks, overfitting, dropout, class imbalance, loss functions, recurrent neural networks, attention mechanisms, and maximum likelihood estimation. Specifically, it asks about channels in convnets, overfitting and methods to mitigate it like dropout, class imbalance problems and solutions, recommending L1 or L2 loss, explaining LSTMs and gated RNNs, attention in RNNs, and why cross entropy is a good loss function for neural networks.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    7 views1 page

    Assignment 7

    Uploaded by

    vullingala syanthan
    The document outlines 11 questions for Assignment 7 covering topics in convolutional networks, overfitting, dropout, class imbalance, loss functions, recurrent neural networks, attention mechanisms, and maximum likelihood estimation. Specifically, it asks about channels in convnets, overfitting and methods to mitigate it like dropout, class imbalance problems and solutions, recommending L1 or L2 loss, explaining LSTMs and gated RNNs, attention in RNNs, and why cross entropy is a good loss function for neural networks.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 1

    Assignment 7:

    1. What is a channel in a convolu6onal network?

    2. Explain the meaning and reason of overfiBng?

    3. Explain dropout and why this can help with overfiBng?

    4. Chose another method to mi6gate overfiBng and explain why this should help.

    5. Why is imbalance of the training set a problem and how can this be mi6gated?

    6. Given the choices of two loss func6on L1=(y-y*)^2 and L2=(y-y*)^4, which of these loss func6on do you
    recommend to use and why?

    7. Briefly explain a LSTM.

    8. Why is a gated recurrent neural network recommended over a basic RNN?

    9. Explain a\en6on in the context of recurrent neural networks.

    10. Give the density func6on 𝑝(𝑥; 𝜆) = 𝜆𝑒 !"# for 𝑥 > 0, what is the MLE for the parameter 𝜆.

    11. Why is a cross entropy a good choice for the loss func6on of a neural network?

    You might also like