Skip to main content
Search

# Tabular Foundation Model

6 related articles

Subscribe to updates
  1. arXiv

    Mediation analysis stops refitting per table: MediPFN learns interval error quantiles in advance and runs 59.1 times faster than bootstrap in paired timing

    Causal mediation analysis splits a treatment effect into an indirect pathway through mediators and a direct pathway through other processes, and attaching a confidence interval to the indirect effect usually means refitting several nuisance functions on every table and resampling repeatedly. MediPFN adapts a pretrained tabular foundation model to predict those nuisance functions, then a separate head learns quantiles of the estimator's standardized error from simulated tables with known indirect effects, with symmetrization and independent calibration producing the interval. On synthetic, distribution-shift and real-covariate tables its coverage sits closer to the 95% nominal level than several comparators, and paired timing gives a median 59.1-fold speedup over bootstrap.

  2. arXiv

    TabOmics reads every feature in one pass with 7.3M parameters: mean AUROC 0.943 across 46 wide omics tasks, and one member matches a model 30 times larger

    TabOmics is an open tabular foundation model with 7.3M parameters, pretrained only on synthetic tables, that processes all features retained after preprocessing jointly in a single forward pass instead of subsampling or compressing them. Across 46 classification tasks from three high-dimensional, low-sample-size benchmarks, the eight-member TabOmics v2.5 reaches a mean AUROC of 0.943, above 0.942 for eight-member TabPFN-3.5; the single-member version reaches 0.941 with no significant paired difference, at roughly five times the runtime per forward pass.

  3. arXiv

    PrivTab embeds a differential-privacy mechanism inside a tabular foundation model, beating DP-LR and DP-MLP on 33 TabArena datasets under moderate-to-strong privacy while cutting fitting time from minutes to about 10 milliseconds

    The authors introduce PrivTab, a tabular foundation model that embeds a differential-privacy mechanism in its architecture: pretrained on simulated datasets, it uses in-context learning to compress sensitive rows into compact, provably private summaries, outperforming DP-LR and DP-MLP on 33 TabArena classification datasets across six privacy regimes under moderate-to-strong privacy, maintaining well-calibrated predictions, and reducing fitting time from minutes to a single forward pass of about 10 milliseconds.

  4. arXiv

    Systematic evaluation of streaming tabular foundation models: TabFM+FIFO leads on nearly all nine streams but serves over an order of magnitude slower than the fastest ensemble

    In a unified prequential (test-then-train) protocol across real and synthetic streams, this study systematically compares tabular foundation models (TFMs) with streaming learners and streaming AutoML, finding that TFMs reach the highest predictive accuracy, recover faster after drift, and stay most accurate under label delay, but cost more than an order of magnitude more to serve; memory size and backbone quality matter more than the memory management policy, and repeated context encoding is the dominant cost, which a compact causal model with cached encoded context can hold nearly constant across memory sizes at close accuracy.

  5. arXiv

    Google's 400M-parameter TabFM tops all 51 TabArena datasets zero-shot, and TabFM-Auto adds Elo with frozen weights

    TabFM is a 400M-parameter tabular foundation model that formulates supervised tabular prediction as in-context learning, is pretrained entirely on synthetic tables generated from structural causal models, and produces calibrated zero-shot predictions in a single forward pass; across all 51 TabArena datasets (38 classification, 13 regression) zero-shot TabFM ranks first among default tabular foundation models and outperforms tuned AutoML pipelines, while its two extensions, TabFM+ (multi-view feature expansion, ensembling, and post-hoc calibration) and TabFM-Auto (LLM-guided, dataset-specific data processing and feature engineering), improve both tracks over the same frozen weights.

  6. bioRxiv

    Data-driven predictive design of engineered living hydrogels

    Using the tabular foundation model TabPFN informed by a small library of living hydrogels, this work predicts macroscopic material properties of Escherichia coli-produced living hydrogels containing CsgA-based fibres fused to genetically encoded PEG-like biopolymers from genetic and process parameters, achieving the strongest prediction for storage modulus G' (R2 = 85.1%) on an independent validation set with a 48.0% RMSE reduction versus linear regression, and further enabling property-guided design to identify parameters for desired properties.

You’re all caught up