Skip to content
@foundation-model-stack

Foundation Model Stack

IBM Research's home for incubating, advancing and upstreaming open source for foundation model development, training, tuning and inference.

Pinned Loading

  1. foundation-model-stack foundation-model-stack Public

    🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

    Python 218 100

  2. fms-fsdp fms-fsdp Public

    🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

    Python 279 46

  3. fms-hf-tuning fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    Python 56 65

  4. fms-acceleration fms-acceleration Public

    🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

    Python 13 19

  5. fms-guardrails-orchestrator fms-guardrails-orchestrator Public

    🚀 Guardrails orchestration server for application of various detections on text generation input and output.

    Rust 28 38

  6. bamba bamba Public

    Train, tune, and infer Bamba model

    Python 138 15

Repositories

Showing 10 of 29 repositories
  • foundation-model-stack Public

    🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

    foundation-model-stack/foundation-model-stack’s past year of commit activity
    Python 218 Apache-2.0 100 46 (4 issues need help) 58 Updated Jan 22, 2026
  • tuning-config-recommender Public

    ⚡️⚡️ Supercharge your fine-tuning users with completely automated tuning configurations!

    foundation-model-stack/tuning-config-recommender’s past year of commit activity
    Python 4 Apache-2.0 2 0 0 Updated Jan 22, 2026
  • aiu-fms-testing-utils Public

    Tests/Scripts for use with foundation-model-stack models running on AIU

    foundation-model-stack/aiu-fms-testing-utils’s past year of commit activity
    Python 4 Apache-2.0 33 2 27 Updated Jan 20, 2026
  • multi-nic-cni Public
    foundation-model-stack/multi-nic-cni’s past year of commit activity
    Go 40 Apache-2.0 11 8 1 Updated Jan 20, 2026
  • fms-guardrails-orchestrator Public

    🚀 Guardrails orchestration server for application of various detections on text generation input and output.

    foundation-model-stack/fms-guardrails-orchestrator’s past year of commit activity
    Rust 28 Apache-2.0 38 30 (2 issues need help) 3 Updated Jan 15, 2026
  • fastsafetensors Public

    High-performance safetensors model loader

    foundation-model-stack/fastsafetensors’s past year of commit activity
    Python 93 Apache-2.0 16 1 0 Updated Jan 13, 2026
  • fms-model-optimizer Public

    FMS Model Optimizer is a framework for developing reduced precision neural network models.

    foundation-model-stack/fms-model-optimizer’s past year of commit activity
    Python 20 Apache-2.0 17 16 (1 issue needs help) 10 Updated Jan 5, 2026
  • vllm-detector-adapter Public

    Tiny adapter that runs on top of vllm and provides detector APIs

    foundation-model-stack/vllm-detector-adapter’s past year of commit activity
    Python 4 Apache-2.0 7 7 3 Updated Dec 23, 2025
  • fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    foundation-model-stack/fms-hf-tuning’s past year of commit activity
    Python 56 Apache-2.0 65 25 (2 issues need help) 21 Updated Dec 18, 2025
  • vllm-triton-backend Public

    A Triton-only attention backend for vLLM

    foundation-model-stack/vllm-triton-backend’s past year of commit activity
    Python 23 Apache-2.0 7 0 2 Updated Dec 18, 2025
View all repositories

Most used topics

python pytorch