https://sherlock-dev.netlify.app/ Recent content on Bitter Lesson Hugo -- 0.157.0 en-us Tue, 02 Dec 2025 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-10-02-llm-quant/ Mon, 02 Oct 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-10-02-llm-quant/ This blog post provides an overview of the fundamental concepts of quantization, as well as a review of mainstream quantization methods in the context of LLMs. https://sherlock-dev.netlify.app/posts/2025-12-02-rot-quant-opt/ Tue, 02 Dec 2025 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2025-12-02-rot-quant-opt/ 介绍 LLM 量化中的旋转技术以及相关的优化方案 https://sherlock-dev.netlify.app/posts/2025-08-10-nvfp4/ Thu, 28 Aug 2025 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2025-08-10-nvfp4/ 介绍 MXFP4 和 NVFP4 的区别 https://sherlock-dev.netlify.app/posts/2024-08-30-w4a8kv4-summary/ Fri, 30 Aug 2024 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2024-08-30-w4a8kv4-summary/ Comprehensive summary of W4A8KV4 quantization techniques, covering KV4 and W4A8 optimization methods with practical recommendations. https://sherlock-dev.netlify.app/posts/2024-07-25-low-bit-moe-quant/ Thu, 25 Jul 2024 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2024-07-25-low-bit-moe-quant/ Comprehensive guide to quantizing large MoE models like DeepSeek-V3/R1, covering techniques for efficient memory usage and inference optimization. https://sherlock-dev.netlify.app/posts/2024-06-20-speculative-sampling/ Thu, 20 Jun 2024 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2024-06-20-speculative-sampling/ Deep dive into speculative sampling techniques for accelerating LLM inference through draft model prediction and rejection sampling. https://sherlock-dev.netlify.app/posts/2024-05-15-deepseek-v2-nutshell/ Wed, 15 May 2024 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2024-05-15-deepseek-v2-nutshell/ Understanding DeepSeek-v2's MLA architecture and its solutions to KV cache memory challenges in long context LLM inference. https://sherlock-dev.netlify.app/posts/2024-04-10-layernorm-math-derivation/ Wed, 10 Apr 2024 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2024-04-10-layernorm-math-derivation/ Comprehensive mathematical derivation of LayerNorm forward and backward passes, including PyTorch implementation details. https://sherlock-dev.netlify.app/posts/2024-03-20-softmax-flashattention/ Wed, 20 Mar 2024 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2024-03-20-softmax-flashattention/ Deep dive into the mathematical foundations of flash attention, from softmax fundamentals to efficient kernel implementation. https://sherlock-dev.netlify.app/posts/2024-02-15-fast-hadamard-transform/ Thu, 15 Feb 2024 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2024-02-15-fast-hadamard-transform/ A comprehensive guide to the Fast Hadamard Transform, its mathematical foundations, and practical implementation with code examples. https://sherlock-dev.netlify.app/posts/2024-01-24-quant-kv-cache/ Wed, 24 Jan 2024 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2024-01-24-quant-kv-cache/ This blog introduces KV Cache quantization in LLM inference. https://sherlock-dev.netlify.app/posts/2023-10-09-sq-awq/ Sun, 08 Oct 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-10-09-sq-awq/ This blog post compares *SmoothQuant* and *AWQ* differences and their code implementation. https://sherlock-dev.netlify.app/posts/2023-09-20-triton-tutorial2-new/ Wed, 20 Sep 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-09-20-triton-tutorial2-new/ Build a high-performance matrix multiplication kernel in Triton that rivals cuBLAS performance with step-by-step optimization. https://sherlock-dev.netlify.app/posts/2023-09-20-triton-tutorial2/ Wed, 20 Sep 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-09-20-triton-tutorial2/ third blogpost of triton tutorial series, gemm and autotune. https://sherlock-dev.netlify.app/posts/2023-09-18-gptq-code/ Mon, 18 Sep 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-09-18-gptq-code/ This blog post delved into the code implementation of the GPTQ quantization process, using the Llama model as a case study. https://sherlock-dev.netlify.app/posts/2023-09-09-gptq-math/ Sat, 09 Sep 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-09-09-gptq-math/ This blog post traces the development of GPTQ, starting from its roots in OBD, through OBS, and finally to OBC. https://sherlock-dev.netlify.app/posts/2023-09-05-triton-tutorial1-new/ Tue, 05 Sep 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-09-05-triton-tutorial1-new/ Learn to write a fused softmax kernel in Triton, with debugging and performance benchmarking techniques. https://sherlock-dev.netlify.app/posts/2023-09-05-triton-tutorial1/ Tue, 05 Sep 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-09-05-triton-tutorial1/ second blogpost of triton tutorial series, fused softmax, debug and benchmarking it. https://sherlock-dev.netlify.app/posts/2023-09-02-triton-tutorial0-new/ Sat, 02 Sep 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-09-02-triton-tutorial0-new/ Introduction to Triton programming language, installation guide, and vector-addition example to get started with GPU kernel development. https://sherlock-dev.netlify.app/posts/2023-09-02-triton-tutorial0/ Sat, 02 Sep 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-09-02-triton-tutorial0/ first blogpost of triton tutorial series, triton introduction, installation and vector-add example https://sherlock-dev.netlify.app/posts/2023-08-27-cuda-reduce-parallel/ Sun, 27 Aug 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-08-27-cuda-reduce-parallel/ A step-by-step guide to optimizing parallel reduction operations using CUDA, from basic implementation to advanced optimization techniques. https://sherlock-dev.netlify.app/posts/2023-08-20-llm-inference-benchmark/ Sun, 20 Aug 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-08-20-llm-inference-benchmark/ Introduce some metrics for LLM inference benchmarking https://sherlock-dev.netlify.app/posts/2023-08-03-rope/ Thu, 10 Aug 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-08-03-rope/ Introduce some basic concepts of Position Encoding, RoPE and length extrapolation related it. https://sherlock-dev.netlify.app/posts/2023-07-26-codellm/ Wed, 26 Jul 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-07-26-codellm/ 一个偏综述的文章，总结 codeLLM 相关 paper 从 data collection 到 training 中间的一些细节 https://sherlock-dev.netlify.app/posts/2023-07-22-wizard-ocra/ Sat, 22 Jul 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-07-22-wizard-ocra/ 介绍一下最近看到的两篇关于 SIFT 数据相关的非常好的论文 WizardLM(WizardCoder) 和 Ocra，以及我对这个问题的一些思考 https://sherlock-dev.netlify.app/posts/2023-07-10-how-to-use-pomodor/ Mon, 10 Jul 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-07-10-how-to-use-pomodor/ 记录我如何使用番茄工作法进行提升效率，以及一些使用过程中的心路历程 https://sherlock-dev.netlify.app/posts/2023-07-04-continued-pretrain-intro/ Tue, 04 Jul 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-07-04-continued-pretrain-intro/ 介绍一下 continued pre-train https://sherlock-dev.netlify.app/posts/2023-02-28-find-trt-fp16-diff/ Tue, 28 Feb 2023 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2023-02-28-find-trt-fp16-diff/ 记录一次找 TensorRT FP16 和 PyTorch 推理结果不一致的经历 https://sherlock-dev.netlify.app/posts/2022-03-15-csapp-attack-new/ Tue, 15 Mar 2022 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2022-03-15-csapp-attack-new/ Understanding buffer overflow attacks through CSAPP lab exercises, covering code injection and return-oriented programming techniques. https://sherlock-dev.netlify.app/posts/2022-03-15-csapp-attack/ Tue, 15 Mar 2022 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2022-03-15-csapp-attack/ 记录在阅读和学习 CSAPP 过程中，完成 AttackLab 的相关内容 https://sherlock-dev.netlify.app/posts/2022-02-19-vscode-develop_tool/ Sat, 19 Feb 2022 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2022-02-19-vscode-develop_tool/ 记录配置和使用 VSCode 的流程，演示一些深度学习中 debug 的例子 https://sherlock-dev.netlify.app/posts/2022-02-13-csapp-bomb-new/ Sun, 13 Feb 2022 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2022-02-13-csapp-bomb-new/ Step-by-step walkthrough of defusing a binary bomb through reverse engineering and assembly analysis. https://sherlock-dev.netlify.app/posts/2022-02-13-csapp-bomb/ Sun, 13 Feb 2022 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2022-02-13-csapp-bomb/ 记录在阅读和学习 CSAPP 过程中，完成 BombLab 的相关内容 https://sherlock-dev.netlify.app/posts/2021-11-18-oneflow-userop/ Thu, 18 Nov 2021 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2021-11-18-oneflow-userop/ 记录在 oneflow 中开发 userOp 的流程以及中间遇到的一些问题 https://sherlock-dev.netlify.app/posts/2021-11-10-autodiff/ Wed, 10 Nov 2021 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2021-11-10-autodiff/ 从数学和实现的角度解释 AutoDiff 的原理，给出一个简单的代码实现 https://sherlock-dev.netlify.app/posts/2021-11-05-l2-reg-weight-decay/ Fri, 05 Nov 2021 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2021-11-05-l2-reg-weight-decay/ L2 reg 和 weight decay 的区别和联系 https://sherlock-dev.netlify.app/posts/2021-06-02-hackers-and-painters/ Wed, 02 Jun 2021 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2021-06-02-hackers-and-painters/ 黑客与画家读后感 https://sherlock-dev.netlify.app/posts/2021-05-16-dl-dist-train/ Sun, 16 May 2021 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2021-05-16-dl-dist-train/ 介绍数据并行，模型并行以及流水并行等相关内容 https://sherlock-dev.netlify.app/posts/2021-05-09-study-less-study-smart/ Sun, 09 May 2021 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2021-05-09-study-less-study-smart/ 总结一些高效学习的技巧 https://sherlock-dev.netlify.app/posts/2021-04-28-fastreid-v1/ Wed, 28 Apr 2021 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2021-04-28-fastreid-v1/ fastreid v1.0 功能介绍 https://sherlock-dev.netlify.app/posts/2020-05-29-fastreid/ Fri, 29 May 2020 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2020-05-29-fastreid/ fastreid toolbox 介绍 https://sherlock-dev.netlify.app/posts/2020-02-20-ssl-survey/ Thu, 20 Feb 2020 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2020-02-20-ssl-survey/ SSL 的入门介绍和几篇 paper 的个人解读 https://sherlock-dev.netlify.app/posts/2020-02-15-simclr/ Sat, 15 Feb 2020 00:00:00 +0000 https://sherlock-dev.netlify.app/posts/2020-02-15-simclr/ 介绍 SimCLR 这篇文章中的一些内容