This guide will let you install Ollama with an older Nvidia GPU (e.g. P1000, M40 or P40).

This guide works for me Have done it several time on bare metal and in VM's running on Proxmox. With a single P1000 (4GB), a dual P1000 setup, a single P40 (24GB) and a P1000 & P40 setup.

Things done in thi...

It is possible to limit the maximum power usage (default 250W) of the Nvidia Tesla P40.

Adjusting the maximum power usage saves power but also gives less performance.

Enable persistence mode

nvidia-smi -pm ENABLED

Set power limit to 140Watts

nvidia-smi -pl 140

140 watt seems to b...