datahacker.rs@gmail.com

# Category: Data Visualization

### #009 Activation functions and their derivatives

Activation functions When we build a neural network, one of the choices we have to make is what activation functions to use in the hidden layers as well as at the output unit of the  Neural Network. So far, we’ve just been using the sigmoid activation function but sometimes other choices can work much better.  Let’s take a look at some of the  options. $$sigmoid$$ activation function In the forward propagation steps for Neural Network there are two steps…