This document outlines the contents of a course on selected topics in artificial intelligence taught by Dr. Eman Ahmed. The course covers revision on logistic regression and neural networks, design issues in deep learning models, different types of convolutional neural networks, transfer learning and pretrained models, performance measures like confusion matrices, discriminative vs generative learning, and a final project applying deep learning and transfer learning techniques. Key concepts from logistic regression covered include the sigmoid activation function, loss functions, convexity, and gradient descent optimization.
This document outlines the contents of a course on selected topics in artificial intelligence taught by Dr. Eman Ahmed. The course covers revision on logistic regression and neural networks, design issues in deep learning models, different types of convolutional neural networks, transfer learning and pretrained models, performance measures like confusion matrices, discriminative vs generative learning, and a final project applying deep learning and transfer learning techniques. Key concepts from logistic regression covered include the sigmoid activation function, loss functions, convexity, and gradient descent optimization.
This document outlines the contents of a course on selected topics in artificial intelligence taught by Dr. Eman Ahmed. The course covers revision on logistic regression and neural networks, design issues in deep learning models, different types of convolutional neural networks, transfer learning and pretrained models, performance measures like confusion matrices, discriminative vs generative learning, and a final project applying deep learning and transfer learning techniques. Key concepts from logistic regression covered include the sigmoid activation function, loss functions, convexity, and gradient descent optimization.
e.ahmed@fci-cu.edu.eg Group? Course Contents • Revision on Logistic Regression and Neural Networks. • Design Issues (Initialization, activation function choice, regularization, loss functions, …) • Deep Learning Models (CNNs) and its types. • Transfer Learning and pretrained models. • Performance Measures (Confusion matrix) • Discriminative vs Generative Learning. • Project (Applying deep learning and transfer learning in different applications) – Optimization? Linear Regression • Binary Classification • Classify an image into 2 classes. • Class Cat : 1 • Class Dog : 0 Logistic Regression • Sigmoid Function • For large values of z: • Sigmoid approaches 1 • For very small values of z: • Sigmoid approaches zero • When z=0: • Sigmoid outputs 0.5 Loss Function • Convex Function
We would like the loss function to be convex to have one minimum.
This is not the case for non-convex functions, they have many local minima. Loss Function of Logistic Regression • Cost Funtion • Gradient Descent W increases
W decreases Logistic Regression Delta learning rules • Thanks