Skip to content

@foundation-model-stack Foundation Model Stack

Change the repository type filter

All

    Repositories list

    29 repositories

    • fms-hf-tuning

      Public
      🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
      Python
      •
      Apache License 2.0
      •66•58•26•19•Updated Jul 21, 2026Jul 21, 2026

    • aiu-fms-testing-utils

      Public
      Tests/Scripts for use with foundation-model-stack models running on AIU
      Python
      •
      Apache License 2.0
      •40•4•4•13•Updated Jul 17, 2026Jul 17, 2026

    • foundation-model-stack

      Public
      🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
      Python
      •
      Apache License 2.0
      •107•231•47•58•Updated Jul 16, 2026Jul 16, 2026

    • vllm-triton-backend

      Public
      A Triton-only attention backend for vLLM
      Python
      •
      Apache License 2.0
      •7•27•0•2•Updated Jul 14, 2026Jul 14, 2026

    • fastsafetensors

      Public
      High-performance safetensors model loader
      pythonpytorchsafetensors
      pythonpytorchsafetensors
      Python
      •
      Apache License 2.0
      •34•157•3•2•Updated Jul 7, 2026Jul 7, 2026

    • fms-guardrails-orchestrator

      Public
      🚀 Guardrails orchestration server for application of various detections on text generation input and output.
      Rust
      •
      Apache License 2.0
      •43•35•29•9•Updated Jul 6, 2026Jul 6, 2026

    • multi-nic-cni

      Public
      Go
      •
      Apache License 2.0
      •11•40•8•5•Updated Jul 3, 2026Jul 3, 2026

    • fms-model-optimizer

      Public
      FMS Model Optimizer is a framework for developing reduced precision neural network models.
      pythonmachine-learningcloud
      pythonmachine-learningcloudframeworkaioptimizerquantization
      Python
      •
      Apache License 2.0
      •20•21•16•10•Updated Jun 24, 2026Jun 24, 2026

    • vllm-detector-adapter

      Public
      Tiny adapter that runs on top of vllm and provides detector APIs
      Python
      •
      Apache License 2.0
      •10•4•7•4•Updated May 21, 2026May 21, 2026

    • bamba

      Public
      Train, tune, and infer Bamba model
      Python
      •
      Apache License 2.0
      •16•138•4•2•Updated May 15, 2026May 15, 2026

    • ocp-efa-operator

      Public
      Operator that enables EFA and/or GDRCOPY in an OpenShift cluster
      Go
      •
      Apache License 2.0
      •0•1•0•0•Updated Mar 23, 2026Mar 23, 2026

    • fms-autoconf-k8s-controller

      Public
      Go
      •
      MIT License
      •0•2•0•0•Updated Feb 12, 2026Feb 12, 2026

    • tuning-config-recommender

      Public
      ⚡️⚡️ Supercharge your fine-tuning users with completely automated tuning configurations!
      Python
      •
      Apache License 2.0
      •4•5•1•1•Updated Feb 10, 2026Feb 10, 2026

    • fm-training-estimator

      Public
      Estimate resources needed to train LLMs
      Python
      •
      Apache License 2.0
      •9•14•3•0•Updated Feb 10, 2026Feb 10, 2026

    • fms-acceleration

      Public
      🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
      Python
      •
      Apache License 2.0
      •19•14•26•2•Updated Jan 30, 2026Jan 30, 2026

    • fms-fsdp

      Public
      🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.
      pytorchdistributed-trainingllm
      pytorchdistributed-trainingllm
      Python
      •
      Apache License 2.0
      •47•288•24•10•Updated Nov 24, 2025Nov 24, 2025

    • fms-dgt

      Public archive
      Synthetic Data Generation for Foundation Models
      Python
      •
      Apache License 2.0
      •23•21•2•1•Updated Nov 10, 2025Nov 10, 2025

    • transformers

      Public
      🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
      Python
      •
      Apache License 2.0
      •34k•0•0•1•Updated Feb 7, 2025Feb 7, 2025

    • hf-resource-scanner

      Public
      Scan resources consumed during LLM training
      Python
      •
      Apache License 2.0
      •4•8•1•0•Updated Jan 14, 2025Jan 14, 2025

    • blog

      Public
      Public repo for HF blog posts
      Jupyter Notebook
      •1k•0•0•1•Updated Dec 18, 2024Dec 18, 2024

    • moe-distributed-training

      Public
      Demonstration of MoE distributed training using various techniques
      Python
      •0•11•1•0•Updated Oct 31, 2024Oct 31, 2024

    • base-images

      Public
      Dockerfile
      •
      Apache License 2.0
      •4•3•1•0•Updated Oct 28, 2024Oct 28, 2024

    • pod-vllm

      Public
      Source code to launch a number of pods, performing synthetic data generation
      Python
      •
      Apache License 2.0
      •1•1•0•1•Updated Oct 22, 2024Oct 22, 2024

    • fms-lm-eval-service

      Public
      Go
      •
      Apache License 2.0
      •2•1•9•1•Updated Oct 10, 2024Oct 10, 2024

    • fms-extras

      Public
      Python
      •
      Apache License 2.0
      •12•26•4•6•Updated Sep 9, 2024Sep 9, 2024

    • avengers

      Public
      Shell
      •
      Apache License 2.0
      •0•0•4•0•Updated Jul 20, 2024Jul 20, 2024

    • trl

      Public
      Train transformer language models with reinforcement learning.
      Python
      •
      Apache License 2.0
      •2.9k•0•0•2•Updated Mar 5, 2024Mar 5, 2024

    • train-conductor

      Public
      Training job management tool for foundation model service
      Python
      •
      Apache License 2.0
      •4•5•6•0•Updated Feb 28, 2024Feb 28, 2024

    • training-operator

      Public
      Training operators on Kubernetes.
      Python
      •
      Apache License 2.0
      •995•0•0•0•Updated Nov 16, 2022Nov 16, 2022
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.