AI
Understanding Triton Kernels from First Principles
A deep dive into how Triton kernels work, explained from absolute basics to complete understanding. …
Under the Hood: How PyTorch Chooses Attention Kernels and Why It Matters for Performance
A deep dive into PyTorch’s attention kernel selection and what each choice means for your …
From Theory to Practice: Quantization and Dequantization Made Simple
Quantization transforms floating-point values (‘float32’) into lower-precision formats, such as …
Breaking Down Vision Transformers: A Code-Driven Explanation
In this article, I’ll break down the layers of a ViT step by step with code snippets, and a …
Harnessing Local Llama to Process Complete Projects: How I use AI for code suggestions and refactoring my Projects
We’ll walk through a Python script that leverages the LangChain framework to process a codebase, …
The Magic of DPAS on Intel's XMX Engines: Cracking Why GPUs are Fast
When you think of multiplying matrices, you probably imagine a lot of numbers flying around and …
Code, Run, Debug on AutoPilot: Let Your Local Llama Do All Your Heavy Lifting!
AutoGen isn’t just another framework; it marks a revolutionary leap in leveraging Large …
Deep Learning for Graphics Programmers: Performing Tensor Operations with DirectML and Direct3D 12
In the rapidly evolving landscape of machine learning and artificial intelligence, harnessing the …
Comparing SYCL, OpenCL, and CUDA: Matrix Multiplication Example
Matrix multiplication is a core operation in scientific and engineering applications, often …
The Simple Path to PyTorch Graphs: Dynamo and AOT Autograd Explained
Graph acquisition in PyTorch refers to the process of creating and managing the computational graph …
Profiling ResNet Models with PyTorch Profiler for Performance Optimization
In the realm of deep learning, model performance is paramount. Whether you’re working on image …
Accelerating Deep Learning Inference on Intel Arc 770: ONNX and PyTorch Go Head-to-Head
When deploying deep learning models, the choice of framework can significantly impact performance. …
Warmup Wisdom: Accurate PyTorch Benchmarking Made Simple!
In the realm of PyTorch model benchmarking, achieving accurate results is paramount for gauging …
Delving into ONNX: Comprehending Computation Graphs and Structure
ONNX (Open Neural Network Exchange) is an open-source format designed to represent machine learning …