Yesterday, I came across this nice series of articles about GPU Networking, by Austin Lyons.

  1. GPU Networking Basics, Part 1
    Communication during Training, Scale Out, Scale Up, Network Architectures, Switches, etc.

  2. GPU Networking Basics, Part 2
    Front-End & Back-End, North-South & East-West Traffic, DeepSeek Example

  3. GPU Networking Basics Part 3: Scale-Out
    InfiniBand, UEC, Spectrum-X, Surprising Misconceptions

It appears that these articles are written for the investment community as the target audience.

For readers looking to dive deeper, the series offers lots of pointers to specifications, product technical documentation, YouTube videos and even links to GitHub code repositories!

Here’s another article that’s sort of complimentary to GPU Networking.
Please note that some parts of it are behind a paywall.

A Beginner’s Guide to Interconnects in AI Datacenters, by Vikram Sekar