All news

1 articles

Min score

blogvLLM Blog·21 Oct 20264.5
Announcing Humming: Fast, Flexible Kernels for Quantized Inference
Ant Group and vLLM open-sourced Humming, a quantized inference kernel library that covers NVIDIA GPUs from Turing on and other CUDA-compatible chips.
llm-inference quantization gpu-kernels