Elastic GPU Service:Manually install the Tesla driver on a GPU-accelerated compute-optimized Linux instance

(Optional) Enable Persistence Mode by using the NVIDIA Persistence Daemon.

After the Tesla driver is installed, Persistence Mode is in the disabled (Off) state by default. The Tesla driver can achieve more stable performance when Persistence Mode is enabled. To ensure business continuity, we recommend that you enable Persistence Mode by using the NVIDIA Persistence Daemon. For more information, see Persistence Daemon on the official NVIDIA website.

1. Run the following command to run the NVIDIA Persistence Daemon:

   sudo nvidia-persistenced --user username 
   # Replace username with your username.

2. Run the following command to view the status of Persistence Mode:

   nvidia-smi

   If the following command output is displayed, Persistence Mode is in the enabled (On) state.

   

(Optional) Enable Persistence Mode after you restart the system.

If you restart the system, the enabled (On) state of Persistence Mode becomes invalid. You can perform the following operations to enable Persistence Mode:

Install the installation scripts provided by NVIDIA, such as the sample script and the installer script, to the /usr/share/doc/NVIDIA_GLX-1.0/samples/nvidia-persistenced-init.tar.bz2 path by installing the Tesla driver installation package.

1. Run the following commands to decompress and install the installation script provided by NVIDIA:

   cd  /usr/share/doc/NVIDIA_GLX-1.0/samples/
   sudo tar xf nvidia-persistenced-init.tar.bz2
   cd  nvidia-persistenced-init
   sudo sh install.sh

2. Run the following command to check whether the NVIDIA Persistence Daemon runs as expected:

   sudo systemctl status nvidia-persistenced

   If the following command output is displayed, the NVIDIA Persistence Daemon runs as expected.

   

   Note

   You can adapt the NVIDIA Persistence Daemon installation script based on your OS to ensure that the NVIDIA Persistence Daemon works as expected.

3. Run the following command to verify that Persistence Mode is in the enabled (On) state:

   nvidia-smi

4. (Optional) Run the following commands to disable the NVIDIA Persistence Daemon.

   You can disable the NVIDIA Persistence Daemon based on your business requirements.

   sudo systemctl stop nvidia-persistenced
   sudo systemctl disable nvidia-persistenced

(Optional) Enable Persistence Mode by using the NVIDIA Persistence Daemon.

After the Tesla driver is installed, Persistence Mode is in the disabled (Off) state by default. The Tesla driver can achieve more stable performance when Persistence Mode is enabled. To ensure business continuity, we recommend that you enable Persistence Mode by using the NVIDIA Persistence Daemon. For more information, see Persistence Daemon on the official NVIDIA website.

1. Run the following command to run the NVIDIA Persistence Daemon:

   sudo nvidia-persistenced --user username 
   # Replace username with your username.

2. Run the following command to view the status of Persistence Mode:

   nvidia-smi

   If the following command output is displayed, Persistence Mode is in the enabled (On) state.

   

(Optional) Enable Persistence Mode after you restart the system.

If you restart the system, the enabled (On) state of Persistence Mode becomes invalid. You can perform the following operations to enable Persistence Mode:

Install the installation scripts provided by NVIDIA, such as the sample script and the installer script, to the /usr/share/doc/NVIDIA_GLX-1.0/samples/nvidia-persistenced-init.tar.bz2 path by installing the Tesla driver installation package.

1. Run the following commands to decompress and install the installation script provided by NVIDIA:

   cd  /usr/share/doc/NVIDIA_GLX-1.0/samples/
   sudo tar xf nvidia-persistenced-init.tar.bz2
   cd  nvidia-persistenced-init
   sudo sh install.sh

2. Run the following command to check whether the NVIDIA Persistence Daemon runs as expected:

   sudo systemctl status nvidia-persistenced

   If the following command output is displayed, the NVIDIA Persistence Daemon runs as expected.

   

   Note

   You can adapt the NVIDIA Persistence Daemon installation script based on your OS to ensure that the NVIDIA Persistence Daemon works as expected.

3. Run the following command to verify that Persistence Mode is in the enabled (On) state:

   nvidia-smi

4. (Optional) Run the following commands to disable the NVIDIA Persistence Daemon.

   You can disable the NVIDIA Persistence Daemon based on your business requirements.

   sudo systemctl stop nvidia-persistenced
   sudo systemctl disable nvidia-persistenced

(Conditionally required) Install nvidia-fabricmanager that matches the driver version. This operation is required when your GPU-accelerated instance belongs to the ebmgn7 or ebmgn7e instance family.

1. Install nvidia-fabricmanager.

   You can install nvidia-fabricmanager by using the source code or the installation package. The commands that are required to install nvidia-fabricmanager vary based on the OS. In the following examples, the driver versions are 460.91.03 and 535.154.05, and Ubuntu 16.04, Ubuntu 18.04, Ubuntu 20.04, and Ubuntu 22.04 are used. Replace driver_version with the version of the driver that you downloaded in Step 1: Download the Tesla driver.

   Important

   When you install nvidia-fabricmanager on Ubuntu 22.04, the version of the Tesla driver must be later than 515.48.07. In the following sample commands for Ubuntu 22.04, the driver version is 535.154.05.

   • Source code

     Ubuntu 16.04, Ubuntu 18.04, or Ubuntu 20.04

     driver_version=460.91.03
     driver_version_main=$(echo $driver_version | awk -F '.' '{print $1}')
     distribution=$(. /etc/os-release;echo $ID$VERSION_ID | sed -e 's/\.//g')
     sudo wget https://developer.download.nvidia.com/compute/cuda/repos/$distribution/x86_64/cuda-$distribution.pin
     sudo mv cuda-$distribution.pin /etc/apt/preferences.d/cuda-repository-pin-600
     sudo wget https://developer.download.nvidia.com/compute/cuda/repos/$distribution/x86_64/3bf863cc.pub
     sudo apt-key add 3bf863cc.pub
     sudo rm 3bf863cc.pub
     sudo echo "deb https://developer.download.nvidia.com/compute/cuda/repos/$distribution/x86_64 /" | tee /etc/apt/sources.list.d/cuda.list
     sudo apt-get update
     sudo apt-get -y install nvidia-fabricmanager-${driver_version_main}=${driver_version}-*

     Ubuntu 22.04

     driver_version=535.154.05
     driver_version_main=$(echo $driver_version | awk -F '.' '{print $1}')
     distribution=$(. /etc/os-release;echo $ID$VERSION_ID | sed -e 's/\.//g')
     sudo wget https://developer.download.nvidia.com/compute/cuda/repos/$distribution/x86_64/cuda-$distribution.pin
     sudo mv cuda-$distribution.pin /etc/apt/preferences.d/cuda-repository-pin-600
     sudo wget https://developer.download.nvidia.com/compute/cuda/repos/$distribution/x86_64/3bf863cc.pub
     sudo apt-key add 3bf863cc.pub
     sudo rm 3bf863cc.pub
     sudo echo "deb https://developer.download.nvidia.com/compute/cuda/repos/$distribution/x86_64 /" | tee /etc/apt/sources.list.d/cuda.list
     sudo apt-get update
     sudo apt-get -y install nvidia-fabricmanager-${driver_version_main}=${driver_version}-*

   • Installation package

     • Ubuntu 16.04

       driver_version=460.91.03
       driver_version_main=$(echo $driver_version | awk -F '.' '{print $1}')
       sudo wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1604/x86_64/nvidia-fabricmanager-${driver_version_main}_${driver_version}-1_amd64.deb
       sudo dpkg -i nvidia-fabricmanager-${driver_version_main}_${driver_version}-1_amd64.deb

     • Ubuntu 18.04

       driver_version=460.91.03
       driver_version_main=$(echo $driver_version | awk -F '.' '{print $1}')
       sudo wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/nvidia-fabricmanager-${driver_version_main}_${driver_version}-1_amd64.deb
       sudo dpkg -i nvidia-fabricmanager-${driver_version_main}_${driver_version}-1_amd64.deb

     • Ubuntu 20.04

       driver_version=460.91.03
       driver_version_main=$(echo $driver_version | awk -F '.' '{print $1}')
       sudo wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/nvidia-fabricmanager-${driver_version_main}_${driver_version}-1_amd64.deb
       sudo dpkg -i nvidia-fabricmanager-${driver_version_main}_${driver_version}-1_amd64.deb

     • Ubuntu 22.04

       driver_version=535.154.05 
       driver_version_main=$(echo $driver_version | awk -F '.' '{print $1}')
       sudo wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/nvidia-fabricmanager-${driver_version_main}_${driver_version}-1_amd64.deb
       sudo dpkg -i nvidia-fabricmanager-${driver_version_main}_${driver_version}-1_amd64.deb

2. Run the following commands to start nvidia-fabricmanager:

   sudo systemctl enable nvidia-fabricmanager
   sudo systemctl start nvidia-fabricmanager

3. Run the following command to check whether nvidia-fabricmanager is installed:

   systemctl status nvidia-fabricmanager

   If the following command output is displayed, nvidia-fabricmanager is installed.

   

   Note

   The GPU can work as expected only if the version of nvidia-fabricmanager is consistent with the Tesla driver version. For GPU-accelerated compute-optimized instances that run Ubuntu, the apt-daily service may automatically update nvidia-fabricmanager if you installed nvidia-fabricmanager by using an installation package. This results in version inconsistency between nvidia-fabricmanager and the Tesla driver. As a result, nvidia-fabricmanager fails to be started and the GPU cannot work as expected. For more information about how to resolve this issue, see What do I do if the GPU fails to work because the nvidia-fabricmanager version is inconsistent with the Tesla driver version?