AI-SOVEREIGN
Home / Open-source AI / AutoGPTQ
Open-source AI

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

GitHub stars5.1K
Forks547
7d change–
LanguagePython
LicenseMIT
Last commit11 Apr 2025
deep-learninginferencelarge-language-modelsllmsnlppytorchquantizationtransformer