Search results

get_tokenizer should fall back to PreTrainedTokenizerFast when AutoTokenizer.from_pretrained cannot resolve model_type (mirroring SGLang server fallback)

Status: Open.

#1589 In SemiAnalysisAI/InferenceX;

· janbernloehr opened on May 29, 2026

[vLLM] Missing --max-model-len guard for offload-disabled agentic runs causes KV cache OOM on H100

Status: Open.

#1587 In SemiAnalysisAI/InferenceX;

· Aavache opened on May 29, 2026

[Reproducibility] Request DeepSeek-R1 H100 2P2D run artifacts and network inventory

Status: Open.

#1580 In SemiAnalysisAI/InferenceX;

· yizyyy opened on May 28, 2026

[AI Generated] [Handoff] out of 70+ image updates, 13 stuck Klaud Cold PRs need upstream coordination / scope decisions

Status: Open.

#1511 In SemiAnalysisAI/InferenceX;

· functionstackx opened on May 18, 2026

Inference engine startup included in GPU metric capture

Status: Open.

#1507 In SemiAnalysisAI/InferenceX;

· thomas-primalabs opened on May 18, 2026

[infra] h200-nb_0 / h200-nb_1: enroot /mnt/image-storage full — can't unpack TRT-LLM v1.3.0rc14 image

Status: Open.

#1496 In SemiAnalysisAI/InferenceX;

· functionstackx opened on May 18, 2026

[Klaud Cold] sglang v0.5.12 DeepGemm regression on B300: CUDA_ERROR_ILLEGAL_ADDRESS in fp8_fp4_gemm_nt TMA descriptor init

Status: Open.

#1463 In SemiAnalysisAI/InferenceX;

· functionstackx opened on May 18, 2026

[experimental chore/agentx-v0.2-aiperf-testing branch] agentic build_replay_cmd: missing --tokenizer-trust-remote-code breaks Kimi-K2.5 (and other custom-code tokenizer models)

Status: Open.

#1369 In SemiAnalysisAI/InferenceX;

· andyluo7 opened on May 13, 2026

[experimental chore/agentx-v0.2-aiperf-testing branch] agentic build_replay_cmd: --cache-bust system_prefix mismatched with current aiperf scenario (requires first_turn_prefix)

Status: Open.

#1359 In SemiAnalysisAI/InferenceX;

· andyluo7 opened on May 13, 2026

[experimental chore/agentx-v0.2-aiperf-testing branch] agentic launcher: TOTAL_CPU_DRAM_GB=2000 hardcoded, OOMs on 1.5 TB MI355X nodes

Status: Open.

#1358 In SemiAnalysisAI/InferenceX;

· andyluo7 opened on May 13, 2026

Packaging and versioning for benchmarking tools and utilities

Status: Open.

#1302 In SemiAnalysisAI/InferenceX;

· thurttdd opened on May 8, 2026

mirror to gitcode

p2

Status: Open.

#1281 In SemiAnalysisAI/InferenceX;

· functionstackx opened on May 5, 2026