Skip to main content
Search

# Contextual Embeddings

2 related articles

Subscribe to updates
  1. bioRxiv

    Gene regulation beyond the single cell: Multicellular Transformer takes a whole tissue sample as input and predicts receptor-ligand pairs zero-shot

    Single-cell foundation models usually take one cell at a time, so their gene representations lean toward cell-intrinsic regulation. Multicellular Transformer instead takes a set of cells from the same tissue sample as input, so each gene's representation carries its expression across that sample together with the sample's cellular composition. On known receptor-ligand pairs from CellChatDB it reaches a zero-shot AUROC of 0.71, against 0.65 for the second-best method, scGPT, and the gain holds across cell-cell contact, secreted signaling and ECM-receptor interaction types.

  2. arXiv

    Retrieval stops chasing one gold chunk: Perplexity's new embedders rank answers and their supporting evidence together

    Perplexity released the pplx-embed-v2-context family, which distills graded chunk-level relevance from a query-aware context compression model instead of gold-chunk labels, so training targets no longer depend on how a document is chunked. The 9B model beats the strongest baseline, voyage-context-4, by 14.4 points at Answer@10 on context-bench and leads on Q2D-Chunk and ConTEB; the 0.6B model shares the 9B embedding space, so a small model can query an index built with the large one.

You’re all caught up