Skip to main content
Search

# Protein Language Model

17 related articles

Subscribe to updates
  1. Advanced Science

    Enzyme function prediction learns from unlabeled homologs: EZpred lifts four-digit EC F1 to 0.786 on 720 newly annotated enzymes

    EZpred carries the homolog-based features long used in protein structure prediction into enzyme function prediction, taking only sequence features from homologs and ignoring their function labels. Most deep learning models for this task read features from the target sequence alone, and the few that use homologs only aggregate labeled ones. On 720 enzymes with new EC numbers in UniProt 2024_02, EZpred reaches an F1 of 0.786 for full four-digit EC numbers, 27% and 31% above CLEAN and GraphEC.

  2. bioRxiv

    Inside a protein language model, binary patterns form a jellyfish: hydrophobic content sets the main axis while heptad phase curls into a ring

    In ESM2 residue embeddings, polar/nonpolar binary patterns organize into a readable geometry. Generating 50 sequences for each of all 128 heptad binary patterns, 6400 in total, and running position-preserving PCA yields a jellyfish-shaped manifold: hydrophobic content spreads along PC1, while PC2 and PC3 encode heptad phase as near sine and cosine. A charge alphabet stays ordered, but scrambled amino-acid groupings or the non-protein model ByT5 lose the cyclic organization.

  3. arXiv

    Over 46,000 putative beta-lactamases mined from environmental metagenomes, and two low-identity candidates confer multidrug resistance in E. coli

    The functional diversity and mutational potential of beta-lactamases in environmental microbial communities were only partly understood. Combining protein language models with ensemble learning identified more than 46,000 putative beta-lactamases across all four Ambler classes from environmental metagenomes; two class C candidates sharing about 30% sequence identity with known enzymes conferred resistance to multiple beta-lactam antibiotics when expressed in E. coli, and mutations found by combining an inverse-folding model with protein language models altered resistance profiles, including increased carbapenem resistance.

  4. arXiv

    Rename every amino acid and ESM-2's contact map nearly vanishes: protein language models lean on residue identity, not coevolutionary statistics

    A global one-to-one renaming of the amino-acid alphabet leaves alignment-level statistics, column entropies and pairwise edit distances unchanged, yet contact maps from ESM-2, MSA Transformer and AMPLIFY collapse, while an inverse-covariance Potts model stays bit-identical. Across nine proteins and three seeds, ESM-2 650M keeps an overlap of only 0.015 with its own original contact set after random relabeling of all twenty residues, versus 0.655 when relabeling stays inside BLOSUM62 similarity groups. The contact readout therefore depends on canonical residue identity and cannot be cited as proof that these models have internalized coevolutionary statistics.

  5. bioRxiv

    Protein stability predictors no longer contradict themselves: EvoPhi-DDG turns an alignment model into a potential, so forward and reverse scores cancel exactly

    Protein stability-change predictors often disagree with themselves: swapping the two sequences does not flip the sign of the prediction, and paths that detour through intermediate states at the same site fail to close. Without retraining, EvoPhi-DDG rewrites the family-alignment predictor MSAesm_ddG as a difference of an effective potential conditioned on the mutation site and alignment context, giving exact sign reversal and exact same-site additivity under a fixed alignment context. Averaged with equal weights with the published JanusDDG, it reaches a Pearson correlation of 0.59 on S669, against 0.55 for JanusDDG and 0.53 for EvoPhi-DDG.

  6. bioRxiv

    BacLLM folds UniProt annotation knowledge into a protein language model, so sequence-only input can call resistance genes and rank phage candidates

    BacLLM injects semantic representations of UniProt annotations, encoded by a large language model, into an ESM-2 sequence encoder through cross-modal contrastive learning, so inference reads amino acid sequences alone. Across six resistance-prediction benchmarks, BacLLM (4B) beat Ankh, ESM-2, ProteinBERT and ProTrek in mean F1 under both logistic regression and an RBF-kernel support vector machine; on the SHV-1 β-lactamase P0AD64 it recovered six of eight experimentally supported resistance-attenuating sites among the top 65 ranked positions, while ESM-2 recovered none. The text branch is removed after training, so these gains come from sequence input, not annotation input.

  7. bioRxiv

    Protein language model embeddings already encode N-glycosylation sites: MaskNGly reaches AUC 0.940 on N-GlyDE without training

    MaskNGly treats protein language model embeddings as a readable source of coevolutionary signal, using a mask-and-probe readout to decide directly whether an N-X-S/T sequon will be N-glycosylated, without training on annotated data. On the N-GlyDE test set it reaches an AUC of 0.940 and an MCC of 0.808, comparable to published supervised neural-network predictors; in independent glycoproteomic data, 106 of 111 previously unreported sites scored above the 0.5 threshold.

  8. bioRxiv

    Antifreeze peptides break free of known scaffolds: 87,305 candidates yield tandem-repeat families whose short peptides match or beat a literature reference

    Antifreeze peptide discovery has been limited by narrow candidate diversity and reliance on known protein scaffolds. AFPFusionLM fuses sequence and structure-aware representations to reach an AUROC of 0.937 and an AUPRC of 0.957 on an independent reference set; paired with a LoRA-adapted generative model and multi-model consensus screening, it retained 87,305 candidate protein records from UniProt, glacier metagenomes and generated sequences and revealed periodic tandem-repeat architectures across several candidate clusters. Short peptides from the resulting repeat-associated families reached or exceeded the ice recrystallization inhibition of a literature reference peptide measured in the same batch.

  9. CAPO gates protein-model adaptation before training: it refused a Boltz-2 fine-tune and still ranked 11 of 15 targets better

    Adapting a protein foundation model to one laboratory's assay is an expensive, failure-prone step, and existing agents treat fine-tuning as a reliable tool call whose feasibility is estimated and whose infeasibility surfaces only after compute is spent. CAPO reframes adaptation as a gated decision: it measures feasibility on the target accelerator, admits or rejects a configuration against a budget, runs a 200-step canary inside the real training loop, and may decline. One unchanged system chose partial fine-tuning of ESM-2 8M, refused to fine-tune Boltz-2 in favor of a calibrated head over frozen representations, and applied rank-4 low-rank adaptation to ESM-2 150M across three protein tasks.

  10. bioRxiv

    PALM learns overlapping domain and site labels together, reaching 0.941 domain-occurrence F1 on 2.3 million held-out proteins

    Protein sequence databases are growing far faster than curated annotation, and existing language models learn only from sequence likelihood, so InterPro domain and functional-site knowledge stays indirect. PALM builds on ESM2 with LoRA adaptation, learned layer aggregation and a bidirectional LSTM encoder, and uses a soft-target loss that lets one residue keep several valid labels. On 2,309,606 held-out proteins it reached domain- and site-occurrence F1 of 0.941 and 0.877, and still 0.857 and 0.828 in the subset below 20% sequence identity.