One hidden layer

Neural Network

Derivatives of
deeplearning.ai activation functions
Sigmoid activation function

a
  1
𝑔( 𝑧)= −𝑧
1+ 𝑒
z

Andrew Ng
Tanh activation function
a
 𝑔( 𝑧)=tanh ( 𝑧)

Andrew Ng
ReLU and Leaky ReLU
a a

z z
ReLU Leaky ReLU

Andrew Ng