Vision transformers quantize without original data: RankQ-ViT reaches 82.44% top-1 on ViT-B at 4-bit weights
Deploying vision transformers on edge devices usually requires original training data to calibrate quantization, and privacy constraints can make that data unavailable. RankQ-ViT instead generates calibration samples with a block-aware rank-promotion objective: rather than only maximizing patch-similarity entropy, it uses self-contrastive learning to spread patch features in different directions so that synthetic images approach the similarity-matrix rank of real images. On ImageNet, ViT-B under W4/A8 quantization reaches 82.44% top-1 accuracy, 6.15 points above RepQ-ViT, while data generation runs about 5 times faster than PSAQ-ViT v1.