datahacker.rs@gmail.com

Category: Other

#002B Image representation in a computer

Image representation in a computer The computer stores 3 separate matrices corresponding to the red, green and blue (RGB) color channels of the image. If the input image is 64 by 64 pixels, then we would have three 64 by 64 matrices corresponding to the red, green and blue pixel intensity values for our image. For a 64 by 64 image – the total dimension of this vector will be =64*64*3=12288. Notation that we will follow…

#001B Deep Learning, wait but why now?

Deep Learning, wait but why now? If the basic technical idea behind deep learning neural networks has been around for decades, why are they only now taking off? To answer this question, we plot a figure where on the x-axis we plot the amount of labelled data we have for a task, and on the y-axis, we plot the performance of our learning algorithm (accuracy). For example, we want to measure the accuracy of our…

#010 C Random initialization of parameters in a Neural Network

Why do we need a random initialization? If we have for example this shallow Neural Network: Parameters for this shallow neural network are , $$\textbf{W}^{[2]}$$, $$b^{[1]}$$ and $$b^{[2]}$$. If we initialize matrices  and $$\textbf{W}^{[2]}$$ to zeros then unit1 and unit2 will give the same output, so $$a_1^{[1]}$$ and $$a_2^{[1]}$$ would be equal. In other words unit1 and unit2 are symmetric, and it can be shown by induction that these two units are computing…