ParaLLeM

ParaLLeM is a library for orchestrating agentic LLM workflows using the Batch API.

We are scalable, traceable, concise, readable, and expressive.

We are developer-centered and lightweight.

We help you save 50% on all token costs.

Compatibility

Sync/Batch	OpenAI	Anthropic	Google
Simple	✅	✅	✅
Structured Output	✅	✅	✅
Function Calls	✅	✅	✅
Web Search	✅	✅	✅
Image Input	✅	✅	✅
MCP	✅	-	-

Philosophy

1. We are built from the ground up around the Batch API.
2. Switch between sync (sequential) and batch in just 1 line of code.
3. Control flow is best represented with Python, not data structures.
4. An agent is more than just one LLM.

Quickstart/Documentation

Please refer to the documentation.