eight or even 16 A100 GPUs that can be interconnected with Nvidia’s NVLink and NVSwitch interconnect technology, which provides nearly 10 times the bandwidth of PCIe 4.0, according to Kharya.

However, just like the A100, Tenstorrent's Blackhole is designed ... to-chip and node-to-node networking like Nvidia has to with NVLink and InfiniBand/Ethernet. In this respect, Tenstorrent's ...

A single DGX H100 system will provide 32 petaflops of AI performance, which Kharya said is six times more than the previous DGX A100. By using the NVLink, enterprises can create a 32-node DGX ...