Skip to main content
Search

# SoftServe

1 related articles

Subscribe to updates
  1. arXiv

    SoftServe builds positive-definite curvature estimates from a variational objective and reaches lower losses than Adam, Muon, and SOAP on ill-conditioned deep learning tasks

    The authors introduce SoftServe, a family of quasi-Newton methods that derives positive-definite curvature estimates from the variational objective of Berglund et al. (2025), remaining positive definite even under negative curvature, and offers diagonal and Kronecker-factored variants that preserve positive definiteness by construction; it relies on the stable coupled Newton-Schulz iteration to replace costly matrix decompositions with GPU-friendly matrix multiplications, and on severely ill-conditioned problems such as recurrent networks, deep autoencoders, physics-informed neural networks, and a 136M-parameter physics-informed diffusion model it often achieves lower losses than established baselines including Adam, Muon, and SOAP.

You’re all caught up