LLM Quantization Explained: GGUF vs GPTQ vs AWQ
Q4_K_M, GPTQ-4bit, AWQ: the names encode 2 separate choices, and the format matters more than the bit count. Measured quality by level on Llama-3.1-8B, the memory math including the KV cache, and which formats your hardware can actually run.
