Category: GEN AI

LLM_log #008: CLIP — Understanding Multimodal AI Through Step-by-Step Experiments

  Highlights: In this post, you’ll learn how CLIP connects images and text in a shared embedding space — enabling zero-shot image classification, semantic search, and visual perception scoring without any task-specific training. We start from the ground up with Vision Transformers, walk through CLIP’s contrastive learning architecture, run hands-on embedding experiments, and then push CLIP to its limits with a real-world challenge: can it tell cheap bedrooms from expensive ones using actual house sale…
Read more

dH #027: A Unified Framework for Deep Learning Architectures: From Sequences to Graphs

🎯 What You’ll Learn In this comprehensive guide, we’ll explore a unified framework for understanding deep learning architectures across different data types. You’ll learn how to design models based on fundamental principles of invariance and equivariance, understand the spectrum from domain-specific to general-purpose approaches, master the building blocks of temporal sequence models including RNNs and Transformers, and discover how spatial convolution models and graph neural networks all fit into one coherent paradigm. By the end,…
Read more

Enhancing LLMs using Retrieval-Augmented Generation (RAG) models

Highlights: Retrieval-Augmented Generation (RAG) models are transforming AI by combining Large Language Models (LLMs) with external memory to improve accuracy, reduce hallucinations, and provide context-aware outputs. In today’s post, we’ll explore RAG’s key concepts, challenges, and cutting-edge advancements and learn how RAG models enhance the reliability of LLM models and increase their adaptability across diverse applications. So let’s begin! Tutorial Overview: 1. LLMs today & their Many Challenges Output Accuracy While language models are impressive,…
Read more

Understanding Large Language Models (LLMs) like LLaMa by Meta (Part 1)

Highlights: Large Language Models (LLMs) have become essential tools in Natural Language Processing, powering applications from chatbots to complex data analysis. In today’s post, we’ll dive into the fascinating world of Large Language Models (LLMs) as explained in a lecture by Andrej Karpathy. We’ll study a notable model in this space, i.e., LLaMA (Large Language Model Meta AI), a groundbreaking LLM developed by Meta (formerly Facebook). We’ll also learn how LLMs in general and this…
Read more

Understanding Large Language Models (LLMs): Scaling, Applications & The Future (Part 2)

Highlights: Large Language Models (LLMs) have become essential tools in Natural Language Processing, powering applications from chatbots to complex data analysis. This is Part 2 of the post we posted earlier where we discussed the LLM by Meta called the LLaMa (Large Language Model Meta AI). We also learned how LLaMa was trained and how models like ChatGPT are trained. In today’s post, we’ll continue to discuss LLMs touching upon scaling laws, real-life applications of…
Read more