Versions Compared

Version Old Version 2 New Version 3
Changes made by

JM Lopez

JM Lopez

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Login to the server via ssh. Note that the username may change if you further customized the VM with cloud-init

    Code Block
    ssh -p 2222 vss-admin@XXX.XXX.XXX.XXX

  2. Install python3OS dependencies:

    Code Block
    sudo apt install build-essential cmake

  3. Install python 3.11 either from source or via ppa:deadsnakes/ppa:

    Code Block
    sudo add-apt-repository ppa:deadsnakes/ppa
sudo apt update
sudo apt install python3.11-full python3.11-dev -y

  4. Install NVIDIA CUDA Toolkit. Needed to recompile llama-cpp-python later.

    Code Block
    wget https://developer.download.nvidia.com/compute/cuda/repos/debian12/x86_64/cuda-keyring_1.1-1_all.deb
sudo dpkg -i cuda-keyring_1.1-1_all.deb
sudo add-apt-repository contrib
sudo apt-get update
sudo apt-get -y install cuda-toolkit-12-3

...