Skip to main content
Search

# Quaternion channel

1 related articles

Subscribe to updates
  1. arXiv

    Order in linear recurrent memory gets an algebraic test: HyperSSM stays exact on a 32-generator group task with quaternion channels

    Whether a linear recurrent memory can retain the order of its inputs depends on the number system its transition matrices live in. Efficient parallel scans have relied on diagonal recurrences, and real or complex transitions commute, so the state records which inputs occurred but not their order. HyperSSM adds quaternion blocks to each channel while keeping linear-time inference and parallel training, solving group tasks exactly with at most five state numbers, including 32 generators, and staying exact on sequences 25 times longer than training.

You’re all caught up