Category: PyTorch

#018 PyTorch – Popular techniques to prevent the Overfitting in a Neural Networks

Highlights: Hello and welcome to our new post. In today’s post, we will discuss one of the most common problems that arise during the training of deep neural networks. It is called overfitting, and it usually occurs when we increase the complexity of the network. In this post, you will learn the most common techniques to reduce overfitting while training neural networks. So, let’s begin. Tutorial Overview: What is overfitting? Common tehniques to reduce the…
Read more

#017 PyTorch – How to apply Batch Normalization in PyTorch

Highlights: Hello and welcome to our new post. Today, we’ll discuss another popular method used to improve the performance of your deep neural network called batch normalization. It is a technique for training deep neural networks that standardizes the inputs to a layer for each mini-batch. After finishing the theoretical part, we will explain how to implement batch normalization in Python using PyTorch. So, let’s begin with our lecture. Tutorial Overview: Data Normalization and Standardization Batch Normalization…
Read more

#016 PyTorch – Three hacks for improving the performance of Deep Neural Networks: Transfer Learning, Data Augmentation, and Scheduling the Learning rate in PyTorch

Highlights: Hi and welcome to our new post. In this post, we are going to talk about very popular deep learning techniques that we can apply to speed up training and improve the performance of our deep learning model. You will learn how you can use transfer learning and some other popular methods like data augmentation and scheduling the learning rate. So, let’s begin. Tutorial Overview: What is Transfer learning? Transfer learning in PyTorch Scheduling…
Read more

# 019 Siamese Network in PyTorch with application to face similarity

Highlights: Hello and welcome back. In today’s post, we’ll discuss and learn a very interesting neural network architecture. We will discuss Siamese Neural Networks, whose goal is to calculate a similarity between two given images. For example, it should tell us how similar two faces are. Siamese networks were first introduced in the early 1990s by Bromley and LeCun[1] to solve signature verification as an image matching problem It is a very popular solution when it comes…
Read more

#003 Advanced Computer Vision – Multi-Task Cascaded Convolutional Networks

Highlights: Face detection and alignment are correlated problems. Change in various poses, illuminations, and occlusions in unrestrained environments can make these problems even more challenging. In this tutorial, we will study how deep learning approaches can be great performing solutions for these two problems. We will study a deep cascaded multi-task framework proposed by Kaipeng Zhang [1] et al. that predicts face and landmark location in a coarse-to-fine manner. So let’s get started! Tutorial Overview:…
Read more