Skip to content
@ndif-team

National Deep Inference Fabric

The National Deep Inference Fabric is a proposed research computing project that will enable us to crack open the mysteries inside large-scale AI

National Deep Inference Fabric

A research computing project enabling transparent and reproducible experiments on large-scale AI systems.


Projects

nnsight

nnsight

A Python library for interpreting and manipulating the internals of deep learning models. Access activations, modify them to study causal effects, compute gradients, and batch interventions efficiently.

Documentation | GitHub | Paper

pip install nnsight

NDIF

NDIF

The National Deep Inference Fabric — a nationwide research computing infrastructure enabling scientists and students to perform transparent experiments on running AI models without local GPU resources.

Website | GitHub | Paper

pip install ndif

nnterp

nnterp

A unified interface for mechanistic interpretability of transformers. Built on NNsight, it provides standardized naming conventions across all transformer architectures with built-in interventions like logit lens, patchscope, and activation steering.

Documentation | GitHub | Paper

pip install nnterp

Workbench

Workbench

A UI for doing exploratory analysis on open source AI models by applying interpretability techniques. Leverages both NNsight and NDIF to provide an interactive environment for exploring LLM internals.

Use Workbench now! | GitHub


Join the community

Discord | Forum | Twitter

Pinned Loading

  1. nnsight nnsight Public

    The nnsight package enables interpreting and manipulating the internals of deep learned models.

    Python 777 66

Repositories

Showing 10 of 12 repositories
  • nnsight Public

    The nnsight package enables interpreting and manipulating the internals of deep learned models.

    ndif-team/nnsight’s past year of commit activity
    Python 777 MIT 66 42 14 Updated Jan 19, 2026
  • cookbook Public

    Implementations of most mech interp papers

    ndif-team/cookbook’s past year of commit activity
    2 0 0 0 Updated Jan 19, 2026
  • workbench Public
    ndif-team/workbench’s past year of commit activity
    TypeScript 11 5 34 5 Updated Jan 19, 2026
  • ndif Public

    The NDIF server, which performs deep inference and serves nnsight requests remotely

    ndif-team/ndif’s past year of commit activity
    Python 38 MIT 13 12 (3 issues need help) 10 Updated Jan 17, 2026
  • .github Public

    NDIF public profile

    ndif-team/.github’s past year of commit activity
    0 0 0 0 Updated Jan 12, 2026
  • nnterp Public

    Unified access to Large Language Model modules using NNsight

    ndif-team/nnterp’s past year of commit activity
    Python 79 MIT 6 6 (1 issue needs help) 5 Updated Jan 12, 2026
  • nnsight-website Public

    The nnsight website, which explains and documents the open-source nnsight API

    ndif-team/nnsight-website’s past year of commit activity
    Jupyter Notebook 3 2 5 0 Updated Jan 8, 2026
  • skills Public

    Teach LLMs to use NNSight with Skills

    ndif-team/skills’s past year of commit activity
    5 0 0 1 Updated Jan 7, 2026
  • ndif-web-beta Public
    ndif-team/ndif-web-beta’s past year of commit activity
    TypeScript 0 0 0 0 Updated Dec 19, 2025
  • ndif-website Public

    The website for NDIF, the National Deep Inference Fabric

    ndif-team/ndif-website’s past year of commit activity
    HTML 2 1 1 0 Updated Dec 8, 2025