Category: Other

LLMs from Scratch #002 PyTorch Fundamentals: Building Efficient Language Models from Scratch

PyTorch Fundamentals: Building Efficient Language Models from Scratch 🎯 What You’ll Learn In this comprehensive guide, we’ll explore the fundamental building blocks of PyTorch for language model development. You’ll learn how to account for memory usage across different floating-point representations, understand tensor operations and their computational costs, master efficient data movement between CPU and GPU, and develop the mindset of resource accounting that’s essential for training large-scale models. This is the practical foundation you need…
Read more

dH #022 Introduction to the Interest Points, Corner Detection – Theory and Applications

Highlights: In this tutorial, we’ll explore the fundamental concepts of computer vision, focusing on interest points and corner detection. You’ll learn how tracking, feature detection, and matching form the backbone of modern computer vision applications – from object recognition to 3D reconstruction. Let’s begin! Tutorial overview: Computer Vision Applications and Use Cases Local Features and Interest Point Fundamentals Interest Point Detection Methods 1. Introduction to Computer Vision and Interest Points Computer Vision Applications and Use…
Read more

dh #021: Marr-Hildreth Edge Detection: A Comprehensive Tutorial

Highlights: The Marr-Hildreth edge detection algorithm represents one of the most elegant approaches to finding edges in images by combining Gaussian smoothing with Laplacian operations. In this comprehensive tutorial, we’ll explore how this method uses zero crossings in the second derivative to identify edges, dive into the mathematical foundations of Laplacian of Gaussian filters, and discover how separability properties make these computations remarkably efficient. Let’s begin!   Have a look at these examples and steps!…
Read more

The Evolution of AI: From Text Generation to Multimodal Tool Masters

How Large Language Models are Revolutionizing Problem-Solving Through Tool Integration and Multimodality The landscape of artificial intelligence has shifted dramatically. What started as impressive text generators have evolved into sophisticated problem-solving systems that mirror human intelligence in their approach to complex tasks. Today, we’re witnessing a fundamental transformation in how AI systems operate – they’re no longer confined to generating text in isolation, but actively leverage external tools and multimodal capabilities to tackle real-world challenges.…
Read more

dH #016: Problems with Stochastic Gradient Descent and the Momentum Solution

highlights: Understanding the fundamental challenges in optimization and how momentum-based approaches provide elegant solutions. This post will give deeper knowledge about more advanced methods for optimization of Machine Learning models. Source: This post is inspired by Lecture of Prof. Justin Johnson, from Michigan University:  https://www.youtube.com/watch?v=YnQJTfbwBM8 The goal of the post is to present the most important ideas, along with the graphs, and it can be used for quick recap of the main ideas.  Problems with SGD…
Read more