Scaling LLM Inference with Disaggregated Prefill and Decode
Disaggregated prefill/decode isn’t an academic concept it’s the fix that saved my LLM serving at scale for 40M users. Here’s exactly how it works and why mon...
Posts by Year
2026
Deep Dive into Fine Tuning a LoRA Reranker on Phi-3
I fine tuned Phi-3 as a pairwise reranker with LoRA and logged every gradient. Early layers changed 200x more than late layers, but ranking representations o...
Text Diffusion: The Idea Hiding Inside BERT All Along
Auto regressive generation is sequential and diffusion uses much fewer passes in text generation.
Cross Entropy Loss Connection to GPT Models
Cross-entropy loss isn’t a heuristic, it is maximum likelihood estimation with a sign flip. It also shows how the same math powers GPT training.
RLHF vs RLAIF vs RLVR: The Three Ways to Teach AI Models
Understanding the basics of RLHF vs RLAIF vs RLVR for AI feedback comparison
Complete Guide to SFT and DPO Fine-tuning with Axolotl
Master the complete pipeline for fine-tuning Large Language Models using Supervised Fine-Tuning (SFT) and Direct Preference Optimization (DPO) with Axolotl f...
How to Build Multi-Objective Ranking Models with LightGBM
Learning to rank with lambdarank multi objective pairwise ranking models using lightgbm
2025
Simple Guide to RoPE Scaling in Large Language Models
Understanding RoPE Scaling and how it enables LLMs to handle longer contexts
Basics of Gradient Accumulation and Checkpointing to train LLMs
Basics of gradient accumulation and gradient checkpointing to train LLMs
Simple Guide on FLOPs in GPU Utilisation
Understanding basics of flops and how they influence gpu computation
5 Lessons from Deploying LLMs in Production using vLLM
Lessons learned from deploying large language models in productions using vLLM
2023
Hands on tutorial with Polars DataFrames in Python
Tutorial to work on large datasets in memory Polars DataFrames in Python
2020
Practical Tutorial on Asyncio in Python 3.7
Understanding asyncio using simple examples in python 3.7
Useful Full Text Search (FTS) queries with sqlite in Python 3.7
Learning to use FTS5 with sqlite for full text search applications
How to create TF-IDF matrix using ngrams in R?
Create tfidf matrix in R just like using scikit-learn
2019
Packaging a Machine Learning Project using Python PEX
Use pex python library to package a python project for deployment.
Banco Data Model
this line will show up as preview on the posts page
First Post
import sys a = [1,2,3] print(a)