Skip to main content
Search

# Ternary matrix engine

1 related articles

Subscribe to updates
  1. arXiv

    PENSA runs BitNet b1.58 2B4T end to end on an Alveo U50: 58.09 tok/s at context 128, 2.14–3.14 times a same-model Xeon baseline

    Ternary large language models push linear-layer weights to three values, replacing multiplication with sign-controlled addition and shifting the bottleneck to packed-weight delivery and reduction. PENSA executes the unmodified BitNet b1.58 2B4T end to end on an AMD Alveo U50 FPGA, with two ternary matrix engines reading TQ1_0 packed weights directly from high-bandwidth memory and each processing 1,280 ternary weights per cycle. At 104.1 MHz, two-stream interleaving reaches 58.09 tok/s at context 128 and 24.60 tok/s at context 2048, 2.14–3.14 times a same-model Xeon E-2356G baseline.

You’re all caught up