Search results

[Doc]: FP8 KV Cache: Does softmax output multiply with FP8 V directly or after dequantization?

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#31023 In vllm-project/vllm;

· jorjiang opened on Dec 19, 2025

[Bug]: Qwen3-VL 2:4 sparsity llm-compressor RuntimeError: shape mismatch (0.12, 0.13rc2)

bugSomething isn't workingSomething isn't working

Status: Open.

#31019 In vllm-project/vllm;

· SorenDreano opened on Dec 19, 2025

[Bug]: ImportError: libcudart.so.12: cannot open shared object file: No such file or directory

bugSomething isn't workingSomething isn't working

Status: Open.

#31018 In vllm-project/vllm;

· shahizat opened on Dec 19, 2025

[Bug]: Wrong outputs with the FlashInfer backend after resuming from sleep, caused by not restoring block_table_arange in attn_metadata in version v0.10.1.

bugSomething isn't workingSomething isn't working

Status: Open.

#31016 In vllm-project/vllm;

· xiaoxiaosuaxuan opened on Dec 19, 2025

[Bug]: GPT-OSS-120B Eagle-v2 High concurrency perf drop

bugSomething isn't workingSomething isn't working

Status: Open.

#31014 In vllm-project/vllm;

· shyeh25 opened on Dec 19, 2025

[Bug]: truncate_prompt_tokens in PoolingParams has no effect when using AsyncLLM.encode()

bugSomething isn't workingSomething isn't working

Status: Open.

#31012 In vllm-project/vllm;

· jeffreywang-anyscale opened on Dec 19, 2025

[Docs] Feedback for <code>/en/latest/</code>

Status: Open.

#31009 In vllm-project/vllm;

· Leopipi26 opened on Dec 19, 2025

[Bug]: Incorrect warning message for tensor parallel size in Ray executor (ray_utils.py:331-340)

bugSomething isn't workingSomething isn't working

Status: Open.

#31005 In vllm-project/vllm;

· jarieshan opened on Dec 19, 2025

[New Model]: T5Gemma 2

new-modelRequests to new modelsRequests to new models

Status: Open.

#31004 In vllm-project/vllm;

· ducviet00-h2 opened on Dec 19, 2025

[Bug]: vLLM 0.12.0 + LMCache outputs ERROR: PrometheusLogger instance already created with different metadata.

bugSomething isn't workingSomething isn't working

Status: Open.

#30996 In vllm-project/vllm;

· keivenchang opened on Dec 19, 2025

[Bug]: Fused MoE errors without safe serialization

bugSomething isn't workingSomething isn't working

Status: Open.

#30995 In vllm-project/vllm;

· ojh31 opened on Dec 19, 2025

[Bug]: CUTLASS BLOCK SCALE FP8 IMA on B200

bugSomething isn't workingSomething isn't working

Status: Open.

#30989 In vllm-project/vllm;

· robertgshaw2-redhat opened on Dec 18, 2025