Writing

Essays, research notes, and engineering logs.

More on Hashnode ↗

Writing & Notes

Blog

Reproducing Google's Sequential Attention Paper in PyTorch

I implemented Google's Sequential Attention feature-selection algorithm from scratch in PyTorch and traced why my results diverged from the paper's.

ResearchAIPyTorchFeature SelectionGoogleDeep Learning
Read on Hashnode →
Blog

My implementation of TurboQuant algorithm by Google

I implemented the TurboQuant algorithm by Google in PyTorch.

ResearchAIPyTorchOptimizationLLMK-V CacheQuantizationGoogle
Read on Hashnode →