IDiom and RL-SAE: an autoregressive model trained on 54 million predicted IDRs generates composable intrinsically disordered regions via sparse-autoencoder feature reinforcement
The authors present IDiom, an autoregressive protein language model trained on IDiom-DB, a dataset of 54 million predicted intrinsically disordered regions (IDRs) curated from the AlphaFold Database, together with reinforcement learning with sparse autoencoder features (RL-SAE), a post-training method that rewards generation of sequences activating specified feature sets to control function-associated sequence patterns; across eight IDR design tasks, RL-SAE sequences activate on average 90% of 30 targeted features versus 24% for activation steering, improve predicted subcellular localization and transcriptional activity over steering and supervised fine-tuning, and allow features associated with distinct biological functions to be combined within individual sequences.