Skip to main content
Search

# Triton

1 related articles

Subscribe to updates
  1. arXiv

    Obaleth puts GPU-initiated networking inside the kernel IR, beating NVSHMEM by 1.25x on a 256-GPU all-to-all

    GPU-initiated network communication has meant calling hand-written device libraries such as NVSHMEM and NCCL, whose transport decisions stay invisible to the compiler and whose every call pays for reservation, fencing and completion polling. Obaleth writes put, signal and wait into the kernel's intermediate representation, optimizes them together with the computation, and lowers them to transport-specific code. On H100 GPUs it sends 8-byte messages at up to 3.3 times NVSHMEM's rate and 4.2 times NCCL GIN's; on 256 GPUs its small-message all-to-all is 1.25 and 2.3 times faster, using 22 MiB of device memory per rank.

You’re all caught up