4-bit inference drops calibration data: weight-error minimization doubles as activation scaling, matching SmoothQuant on MX and NV formats
Low-bit inference needs both weights and activations quantized, yet activation quantization usually depends on calibration data. DualQuant casts weight-reconstruction error minimization as a format-constrained non-convex problem solved by block coordinate descent with closed-form updates, and the resulting column scales double as activation rescalings. Across four 4-bit formats on Llama and Qwen it matches or beats calibration-based SmoothQuant without calibration data, clearly outperforming calibration-free baselines, with the largest margins on MX and NV block formats.