Pinned Loading

1. GPTQModel GPTQModel Public

   Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

   Python 141 30

2. Device-SMI Device-SMI Public

   Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separate tools such as nvidia-smi or /proc/cpuinfo and parsing it y…

   Python 9