Simple Guide to RoPE Scaling in Large Language Models
Understanding RoPE Scaling and how it enables LLMs to handle longer contexts
Recent Posts
Basics of Gradient Accumulation and Checkpointing to train LLMs
Basics of gradient accumulation and gradient checkpointing to train LLMs
Simple Guide on FLOPs in GPU Utilisation
Understanding basics of flops and how they influence gpu computation
5 Lessons from Deploying LLMs in Production using vLLM
Lessons learned from deploying large language models in productions using vLLM
Hands on tutorial with Polars DataFrames in Python
Tutorial to work on large datasets in memory Polars DataFrames in Python