Pooling layers Apart from convolutional layers, \(ConvNets \) often use pooling layers to reduce the image size. Hence, this layer speeds up the computation and this also makes some of the features they detect a bit more robust. Let’s go through an example of pooling, and then we’ll talk about why we might want to apply them. There are two types of pooling: \(Max \enspace pooling \) \(Average \enspace pooling \) \(Max \enspace pooling \) Suppose…
Read more

A simple Convolutional Neural Network  – A ConvNet In the last post we saw the building blocks of a single convolutional layer in a \(ConvNet \). Now let’s go through a concrete example of a simple convolutional neural network. Let’s say we have an image and we want to do an image classification or image recognition. We want to take an image \(X \)  as input and decide if this is a cat or not a…
Read more

One layer of a Convolutional Neural Network We will now present how to  make one convolutional layer within our network. Let’s go through the example. We’ve seen in the previous post how to take a 3D volume and convolve it with two different filters in order to get two different \(4 \times 4 \) outputs. An example of a convolution with two different filters Convolving with the first filter gives us one \(4 \times 4…
Read more

How do we make convolutions on RGB images? We’ve seen how convolutions over 2D images work. Now, let’s see how we can implement convolutions over not just 2D images, but over three-dimensional volumes. For example, if we want to detect features, not just in a grayscale image, but in an RGB image. 2D (or a grayscale) image and 3D (or a RGB) image Instead of a \(6 \times 6 \) image, an RGB image could…
Read more

Strided convolution A strided convolution is another basic building block of convolution that is used in Convolutional Neural Networks. Let’s say we want to convolve this \(7 \times 7 \) image with this \(3 \times 3 \) filter, except, that instead of doing it the usual way, we’re going to do it with a stride of \(2 \). Convolutions with a stride of two This means that we take the element-wise product as usual in…
Read more