It is possible to limit the maximum power usage (default 250W) of the Nvidia Tesla P40.
Adjusting the maximum power usage saves power but also gives less performance.
nvidia-smi -pm ENABLED
nvidia-smi -pl 140
140 watt seems to be the most efficient setting performance and powersaving wise.