10K+ req/s batch API client for LLM endpoints — Rust, async, load-balanced
-
Updated
Feb 21, 2026 - Rust
10K+ req/s batch API client for LLM endpoints — Rust, async, load-balanced
💰 Optimize your Claude API usage to save 50-90% on costs with batching techniques and efficient request management.
🚀 Free Anime Quiz REST API — auto-generated trivia, image, quote & batch quizzes with rate limiting, caching & retry logic. Deploy on Vercel in 1 click!
🚀 Comprehensive Claude API cost optimization toolkit - reduce costs by 50-95%
A Web and API Development Platform build over Symfony
DCL-392: Developing Enterprise Applications on Java EE 8
🌏 EN ↔ 中文 i18n diff + Claude translate + HITL apply. Batch API path @ 50% off. MIT.
Carbon-aware MCP scheduler for agentic AI workflows. Defer "do it later" tasks to the cleanest electricity-grid hour inside a deadline — 40–70 % lower CO2, 50 % cheaper via Batch APIs. Apache-2.0.
Local web UI for OpenAI Sora 2 / Sora 2 Pro video generation with Batch API and automatic MP4 downloads.
VMware BatchBox is an unofficial API for Draga OS Ultimate X and Draga OS X.
Local mock server for testing LLM retries, fallbacks, and provider failure handling without spending tokens.
Drop-in replacement for the Anthropic and OpenAI batch APIs — self-hosted, running against local Ollama or LM Studio. Point your existing SDK code at this server instead of the real APIs. No API keys, no cloud costs, no rate limits.
Analyse any codebase with Claude — at scale, at 50% cost. Tree-sitter parsing, Anthropic Batch API, 8 languages, 7 output formats.
LangGraph pipeline that finds YouTube creators, scores them with Claude, and sends personalized outreach emails. Fully configurable via YAML.
a Batch processing system for Symfony applications
Add a description, image, and links to the batch-api topic page so that developers can more easily learn about it.
To associate your repository with the batch-api topic, visit your repo's landing page and select "manage topics."