Search results

Submission checker logging Whisper performance with wrong metric

Status: Open.

#2449 In mlcommons/inference;

· keithachorn-intel opened on Jan 15, 2026

Refactor interactive scenario to not be a benchmark

Status: Open.

#2442 In mlcommons/inference;

· nvzhihanj opened on Jan 14, 2026

[Documentation] MLCommons URL access to llama3.1-8b is down

Status: Open.

#2440 In mlcommons/inference;

· cmoralopennebula opened on Jan 14, 2026

[Bug] [Wan2.2-T2V] Hard-coded FPS value

Status: Open.

#2434 In mlcommons/inference;

· lauri9 opened on Jan 13, 2026

DLRMv3 FAILED to load sparse_ops_cpu in jagged

Status: Open.

#2429 In mlcommons/inference;

· cfRod opened on Jan 8, 2026

Issue with benchmarking SSD-ResNet34 model.

Status: Open.

#2416 In mlcommons/inference;

· MK-1307 opened on Dec 19, 2025

Using enforce_eager=True in llama-3.1-8B

Status: Open.

#2408 In mlcommons/inference;

· mahmoodn opened on Dec 8, 2025

[Multimodal][vl2l] Offline Scenario hangs at the end of the benchmark

Status: Open.

#2389 In mlcommons/inference;

· johncalesp opened on Nov 12, 2025

Llama-3.1-8B inference time with different batch sizes

Status: Open.

#2386 In mlcommons/inference;

· mahmoodn opened on Nov 5, 2025

[Llama2-70] No matching distribution found for torch==2.2.0.dev20231006+cpu

Status: Open.

#2380 In mlcommons/inference;

· mahmoodn opened on Oct 27, 2025

Define standard for representing and filtering heterogeneous systems on the official result table

Status: Open.

#2379 In mlcommons/inference;

· rausavar opened on Oct 24, 2025

Increase expected QPS so the loadgen pre-generates a larger (coalesced) query

Status: Open.

#2375 In mlcommons/inference;

· jinz2014 opened on Oct 22, 2025