Exploring Smoothquant
Let's dive into the details surrounding Smoothquant.
- What is
- By Marie Zhussupova.
- SmoothQuant : run LLM on CPU
- SmoothQuant
- By Marie Zhussupova.
In-Depth Information on Smoothquant
Large language models (LLMs) show excellent performance but are compute- and memory-intensive. Quantization can reduce ... Links : Subscribe: https://www.youtube.com/@Arxflix Twitter: https://x.com/arxflix LMNT: https://lmnt.com/ SmoothQuant - Accurate and Efficient Post-Training Quantization for Large Language Models In this video, we look into SmoothQ Algorithm and Paper: Paper: https://arxiv.org/abs/2211.10438 Pseudocode Open Source ...
https://arxiv.org/abs/2211.10438.
That wraps up our extensive overview of Smoothquant.