Is PCIe the bottleneck in a deep learning GPU system, so it makes sense to choose Nvidia NV-Link over more Tesla V100 graphics cards?

2

I'm considering a GPU system for deep learning applications, mainly for training models with large datasets. So I'm not sure whether it makes sense to choose Nvidia NV-Link over more Tesla V100 graphics cards? Is NV-Link the bottleneck that a system with two Tesla V100 and NV-Link is "faster" compared to four Tesla V100 without NV-Link? As I have seen, the Nvidias GPU system DGX-1 and DGX-2 uses NVLink.

user3352632

Posted 2018-09-23T17:17:40.693

Reputation: 291

Question was closed 2020-05-13T21:39:43.770

No answers