Welcome to the log. This is where I document my technical experiments, research findings, and deep-dives into LLM internals.


The Tipping Point: Identifying the Threshold of Quantized Weight Corruption

πŸš€ Objective To determine the precise mathematical threshold at which uniform bit-level perturbations to 4-bit quantized LLM weights cause catastrophic model collapse. We aim to understand how robust these compressed models are to β€œbit-level noise.”

Read Full Deep-Dive →