A high-throughput and memory-efficient inference and serving engine for LLMs

Arena-Hard-Auto: An automatic LLM benchmark.

Open Data Hub operator to manage ODH component integrations

A framework for few-shot evaluation of language models.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.

Go ahead and axolotl questions