Skip to main content
Search

# Distance-Aware Dead-Cluster Revival

1 related articles

Subscribe to updates
  1. arXiv

    Small clusters no longer cleared on size alone: a distance check for e-means revival cuts test error by 10% to 80% on isolated groups

    In FAISS, e-means removes small clusters every five mini-batches and reuses their centres, but a small cluster may simply cover a rare group far from other points, and removing it is costly. The new rule adds a distance test to the size test: a small cluster is removed only if the squared distance from its centre to the nearest other centre is at most a few times a running mean-squared-error estimate. On held-out datasets with isolated small groups, test error after two epochs falls by roughly 10% to 80% relative to count-based revival, while results on the e-means paper's embedding benchmarks are identical to the library implementation.

You’re all caught up