Skip to main content
Search

Rui Zhong

1 related articles

Subscribe to updates
  1. arXiv

    Braco reframes visual-token compression from picking tokens to re-parameterizing them, reaching 95.2% normalized accuracy at 23–64x compression while cutting prefill FLOPs by 84.2%–86.7%

    The work recasts extreme visual-token compression as a token-parameterization problem, separating basis transformation and structured truncation (which fix the retained subspace and compressibility) from coordinate organization (which affects optimization and cross-modal alignment, i.e. learnability), and designs Braco, a lightweight four-step coder combining transform-basis truncation, input-independent basis-coordinate embeddings, budget-dependent orthogonal re-parameterization, and learned spatial residual tokens from lightweight pooling; experiments show Braco forms the favorable empirical accuracy–efficiency frontier under 23x–64x compression and remains competitive at 144x, reaching 95.2% accuracy while reducing prefill FLOPs by 84.2%–86.

You’re all caught up