Search results

Windows pip install issue on a python 3.12 venv

Status: Open.

#2425 In ModelCloud/GPTQModel;

* sbhmajum369 opened on Feb 25, 2026

[BUG]: SM120 GPTQ quantization junk output across models

bugSomething isn't workingSomething isn't working

on-hold

Status: Open.

#2423 In ModelCloud/GPTQModel;

* babyplutokurt opened on Feb 22, 2026

[BUG] Rotation parameter not saved and not used in inference ?

bugSomething isn't workingSomething isn't working

Status: Open.

#2354 In ModelCloud/GPTQModel;

* 12345txy opened on Jan 12, 2026

Module placement for BALANCED VramStrategy flawed

bug: non-breaking

performance

Status: Open.

#2326 In ModelCloud/GPTQModel;

* avtc opened on Jan 2, 2026

Moe-vram for QQQ

performance

Status: Open.

#2115 In ModelCloud/GPTQModel;

* avtc opened on Oct 25, 2025

How to quantize both vision encoder and llm together?

Status: Open.

#1998 In ModelCloud/GPTQModel;

* XULU42 opened on Oct 9, 2025

Support the lm_head of QWEN2.5_OMNI?

Status: Open.

#1841 In ModelCloud/GPTQModel;

* LiMa-cas opened on Sep 22, 2025

[FEATURE] Add FOEM Support

Status: Open.

Feature

#1678 In ModelCloud/GPTQModel;

* sankexin opened on Aug 13, 2025

TextSummarizationTask module not found

Status: Open.

#1659 In ModelCloud/GPTQModel;

* TianL123 opened on Jul 17, 2025

[BUG] Gemma 3 4b quantization outputs multi-modal config despite it being text only

bugSomething isn't workingSomething isn't working

Status: Open.

#1655 In ModelCloud/GPTQModel;

* ethan-tonic opened on Jul 9, 2025

Quantized QQQ models encountered configuration field exceptions and inference garbled text issues when deployed in vLLM 0.9.1.

Status: Open.

#1654 In ModelCloud/GPTQModel;

* ShiningMaker opened on Jul 9, 2025

[BUG] GPTQ-quantized OVIS 1B model yields poor performance & misaligned outputs in vLLM-0.9.1

bugSomething isn't workingSomething isn't working

Status: Open.

#1653 In ModelCloud/GPTQModel;

* AstonyJ opened on Jul 9, 2025