Skip to content
Bojian Zheng edited this page Aug 7, 2023 · 41 revisions

Thank you for your interest in Grape 🍇.

Installation

Please note that since part of Grape 🍇 involves communicating with the NVIDIA GPU kernel module via the /proc filesystem (which, to my best knowledge, cannot be handled easily with Docker), all of the following steps are done natively (i.e., outside the Docker environment). We also assume that the OS is either Ubuntu 20.04 or 22.04.

  1. Checkout Grape's 🍇 source code:

    git clone https://github.com/UofT-EcoSystem/Grape-MICRO56-Artifact
  2. Make sure that common software dependencies are installed properly:

    ./scripts/Installation/0-install_build_essentials.sh
  3. Install our customized NVIDIA GPU driver and then reboot the machine:

    ./scripts/Installation/1-install_NVIDIA_GPU_driver.sh
    sudo reboot

    When the machine is rebooted, make sure that the message NVRM: loading customized kernel module from Grape appears when running the command sudo dmesg. If it does not, reinstall the GPU driver and then reboot again:

    # Note the `--reinstall` option.
    ./scripts/Installation/1-install_NVIDIA_GPU_driver.sh --reinstall
    sudo reboot
  4. Install CUDA:

    ./scripts/Installation/2-install_CUDA.sh
  5. Build PyTorch:

    ./scripts/Installation/3-build_PyTorch.sh
  6. Checkout the HuggingFace Transformers submodule (no building or installation is required):

    git submodule update --init submodules/transformers
  7. Finally, use the activate script to modify the environment variables accordingly:

    source scripts/Installation/activate

Experiment Workflow

Clone this wiki locally