Add llmPredict built-in and LLM benchmarking framework#2431

Open

kubraaksux wants to merge 93 commits intoapache:mainfrom

kubraaksux:llm-benchmark

Commits on Jan 19, 2026

Add LLM benchmarking framework to staging
kubraaksux
committed

Commits on Feb 14, 2026

Fix bugs and improve code quality in benchmark framework
kubraaksux
committed

Commits on Feb 15, 2026

Commits on Feb 16, 2026

Run SystemDS with Qwen 3B and Mistral 7B for direct vLLM comparison
kubraaksux
committed
Remove deprecated trust_remote_code from dataset loaders
kubraaksux
committed
Update README with actual benchmark results and SystemDS backend docs
kubraaksux
committed
Add gitignore rules for .env files, meeting notes, and local tool configs
kubraaksux
committed
Redesign benchmark report for clarity and minimal UI
kubraaksux
committed
Update benchmark runner with systemds backend and GPU comparison mode
kubraaksux
committed
Clean up report: remove dead code, unused CSS, and hardcoded model name
kubraaksux
committed
Add presentation-friendly summary tables to benchmark report
kubraaksux
committed
Add concurrency=4 benchmark results and fix json_extraction type check
kubraaksux
committed
Revert accidental changes to MatrixBlockDictionary.java
kubraaksux
committed
Regenerate benchmark report with SystemDS results
kubraaksux
committed
Add GPU batching to SystemDS JMLC backend with benchmark results
kubraaksux
committed
Keep both sequential and batched inference modes for reproducibility
kubraaksux
committed

Commits on Mar 5, 2026