Skip to main content
Search

University of Bern

4 related articles

Subscribe to updates
  1. Causality-guided explainable machine learning shows groundwater accounts for 48% to 101% of aridity's effect on forest photosynthesis across the contiguous United States

    Using satellite observations of solar-induced fluorescence together with model estimates of water table depth and aridity, and applying causality-guided explainable machine learning, this study quantified the relative roles of groundwater and climatic aridity in shaping the spatial pattern of photosynthesis across the contiguous United States, finding that groundwater's relative importance equals 48% to 101% of aridity's effect on forest photosynthesis, 30% to 58% in savannahs and shrublands, 22% to 42% in grasslands, and 15% to 32% in croplands.

  2. SLEEP

    Foundation Models in Sleep Research: Opportunities and Limitations

    This Commentary reviews recently published sleep foundation models by comparing their training cohorts, assessment frameworks, and reported performance, and applies an existing sleep foundation model without fine-tuning to an independent cohort of patients with Narcolepsy Type 1 (n = 51) and healthy controls (n = 28), finding modest zero-shot sleep-staging performance below supervised methods on the same cohort and minimal improvement in disorder classification from PSG-derived embeddings beyond demographic baselines, concluding that sleep foundation models are not yet suitable for clinical deployment.

  3. bioRxiv

    Cortico-subcortical multi-head self-attention as a substrate for cognitive performance

    The work proposes that cortico-thalamic circuits are well suited to implement multi-head self- and cross-attention: layer 2/3 pyramidal cells maintain a recurrent key-value memory while layer 5 pyramidal cells decode the memory retrieved by an incoming query, the computation of keys, values and queries maps onto core and matrix thalamo-cortical projections distributed across the micro- and macro-columns of a cortical area, one cortical area forms an attention head and cortex a multi-head self-attention network, the same thalamo-cortical microcircuit also calculates sensory prediction errors guiding gradient-based synaptic plasticity, and a reward-prediction error gates via basal ganglia the cortical output and the re-activation of hippocampal memories, with the trained network aligning wit

  4. arXiv

    Long-Lived Characters, Local Inference: Incremental Memory Maintenance for Game NPCs

    This work implements a training-free incremental memory-maintenance runtime for a quantized Qwen hybrid recurrent–attention model that removes superseded attention KV entries, computes replacement records at the true sequence tail, and preserves the continuing recurrent state and unchanged KV; experiments show that independent block composition weakens query-conditioned memory selection, that true-tail updates preserve key current-state and historical bindings across eight scripted maintenance rounds, that slot-preserving alternatives repeat a double-subtraction error, and that attention-distribution proximity alone does not explain these semantic differences.

You’re all caught up