Skip to main content
Search

# Block Coordinate Descent

1 related articles

Subscribe to updates
  1. arXiv

    4-bit inference drops calibration data: weight-error minimization doubles as activation scaling, matching SmoothQuant on MX and NV formats

    Low-bit inference needs both weights and activations quantized, yet activation quantization usually depends on calibration data. DualQuant casts weight-reconstruction error minimization as a format-constrained non-convex problem solved by block coordinate descent with closed-form updates, and the resulting column scales double as activation rescalings. Across four 4-bit formats on Llama and Qwen it matches or beats calibration-based SmoothQuant without calibration data, clearly outperforming calibration-free baselines, with the largest margins on MX and NV block formats.

You’re all caught up