Skip to content
@foundation-model-stack

Foundation Model Stack

IBM Research's home for incubating, advancing and upstreaming open source for foundation model development, training, tuning and inference.

Pinned Loading

  1. foundation-model-stack foundation-model-stack Public

    🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

    Python 192 67

  2. fms-fsdp fms-fsdp Public

    🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

    Python 240 38

  3. fms-hf-tuning fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    Python 40 56

  4. fms-acceleration fms-acceleration Public

    🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

    Python 9 15

  5. fms-guardrails-orchestrator fms-guardrails-orchestrator Public

    🚀 Guardrails orchestration server for application of various detections on text generation input and output.

    Rust 15 28

  6. bamba bamba Public

    Train, tune, and infer Bamba model

    Python 88 13

Repositories

Showing 10 of 27 repositories
  • vllm-triton-backend Public

    A Triton-only attention backend for vLLM

    foundation-model-stack/vllm-triton-backend’s past year of commit activity
    Python 4 Apache-2.0 6 0 3 Updated Apr 23, 2025
  • fms-acceleration Public

    🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

    foundation-model-stack/fms-acceleration’s past year of commit activity
    Python 9 Apache-2.0 15 22 (11 issues need help) 3 Updated Apr 23, 2025
  • multi-nic-cni Public
    foundation-model-stack/multi-nic-cni’s past year of commit activity
    Go 38 Apache-2.0 7 20 2 Updated Apr 23, 2025
  • bamba Public

    Train, tune, and infer Bamba model

    foundation-model-stack/bamba’s past year of commit activity
    Python 88 Apache-2.0 13 4 0 Updated Apr 22, 2025
  • aiu-fms-testing-utils Public

    Tests/Scripts for use with foundation-model-stack models running on AIU

    foundation-model-stack/aiu-fms-testing-utils’s past year of commit activity
    Python 4 11 1 9 Updated Apr 22, 2025
  • foundation-model-stack Public

    🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

    foundation-model-stack/foundation-model-stack’s past year of commit activity
    Python 192 Apache-2.0 67 38 (4 issues need help) 41 Updated Apr 22, 2025
  • fms-hf-tuning Public

    🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

    foundation-model-stack/fms-hf-tuning’s past year of commit activity
    Python 40 Apache-2.0 56 24 (2 issues need help) 20 Updated Apr 22, 2025
  • vllm-detector-adapter Public

    Tiny adapter that runs on top of vllm and provides detector APIs

    foundation-model-stack/vllm-detector-adapter’s past year of commit activity
    Python 5 Apache-2.0 6 8 5 Updated Apr 21, 2025
  • fms-guardrails-orchestrator Public

    🚀 Guardrails orchestration server for application of various detections on text generation input and output.

    foundation-model-stack/fms-guardrails-orchestrator’s past year of commit activity
    Rust 15 Apache-2.0 28 29 (2 issues need help) 5 Updated Apr 18, 2025
  • fms-model-optimizer Public

    FMS Model Optimizer is a framework for developing reduced precision neural network models.

    foundation-model-stack/fms-model-optimizer’s past year of commit activity
    Python 16 Apache-2.0 11 7 (1 issue needs help) 3 Updated Apr 17, 2025
View all repositories

Top languages

Loading…

Most used topics

Loading…