Skip to main content
Search

# NumPrint

1 related articles

Subscribe to updates
  1. arXiv

    One integer sequence is enough to name the model: NumPrint identifies among 51 models at 92.72% from a single answer

    Users of model APIs usually judge which model answered from the declared name, although the actual model may differ. The NumPrint benchmark collects 5,036 answers from 51 models, each answer giving 294 integers between 1 and 355 under Chinese, Japanese and English prompts; SMCT pairs a statistical-feature encoder with a causal attention encoder and reaches 92.72% accuracy and 91.10% macro-F1 in 51-class closed-set identification from one sequence, above every method compared.

You’re all caught up