Skip to main content
Search

# Learnable Bernstein Polynomial Activations

1 related articles

Subscribe to updates
  1. arXiv

    BeFit moves model capacity from weights to Bernstein activations: projected convolutions drop multiplication and land within 1.0 pp of the MLPerf Tiny reference

    On microcontrollers with a few hundred kilobytes of memory and no hardware multiplier, the multiplication cost of neural inference has been a deployment bottleneck. BeFit shifts model capacity from weights to learnable Bernstein polynomial activations: a hardware-aware search and knowledge distillation produce a compact network, then convolutional weights are projected to multiplication-free codes and frozen while the activation curves recover the lost accuracy. On a TI CC3220SF, projected BeCNNs lose 0.8 pp on average versus 2.4 pp for ReLU networks; against the MLPerf Tiny DS-CNN reference, the unprojected BeCNN is 1.0 pp more accurate, 2.2 lower in latency and 6.4 lower in flash, while the projected model stays within 1.0 pp of the reference accuracy and runs 5.9 faster.

You’re all caught up