https://arxiv.org/list/cs.LG/recent · Editorial weight 5/10
Researchers created a controlled synthetic environment using shortest-path planning to isolate factors affecting LLM generalization. Models showed strong spatial transfer to unseen maps but consistently failed when scaling to longer horizons due to recursive instability, revealing a key limitation in systematic problem-solving.
Researchers developed diagnostic tools to assess LLM judge reliability in text evaluation tasks, finding that while aggregate consistency appears high (~96%), one-third to two-thirds of documents show logical inconsistencies in pairwise comparisons, with conformal prediction sets offering per-instance confidence estimates.
Researchers benchmarked multiple optimizers on tabular datasets using MLP backbones, finding that Muon consistently outperforms the industry-standard AdamW optimizer. The study suggests practitioners should consider Muon as a practical alternative despite potential training efficiency trade-offs.
Researchers introduce ORCA, a post-training interpretability framework for Support Vector Machines using truncated orthogonal polynomial kernels. The method expands decision functions in explicit RKHS coordinates and quantifies classifier complexity across interaction orders and feature contributions without requiring retraining or surrogate models.
Researchers benchmark node embedding strategies for graph neural networks, comparing classical baselines against quantum-oriented representations under controlled conditions across five TU datasets and QM9. The study isolates embedding impact by standardizing backbone architecture, data splits, optimization, and evaluation metrics.
Prism introduces the first symbolic superoptimizer for tensor programs, using a hierarchical graph representation (sGraph) to encode families of programs and prune suboptimal search spaces through symbolic reasoning about operator semantics and hardware constraints.
SegWithU introduces a post-hoc uncertainty quantification framework for medical image segmentation that operates in a single forward pass by modeling uncertainty as perturbation energy in a compact probe space, enabling both calibration and error detection without repeated inference.
Researchers introduce a fixed-point framework for analyzing looped transformers, which enable test-time compute scaling. The work proves that architectures without recall cannot achieve strong input-dependence, while recall plus outer normalization enables stable, reachable fixed points for meaningful predictions.
Researchers prove that log-barrier regularization achieves optimal last-iterate convergence in zero-sum matrix games with bandit feedback, matching a recently established lower bound of Omega(t^{-1/4}) and extending the result to extensive-form games.
Researchers introduce a nonlinear separation principle guaranteeing global stability for interconnected contracting controllers and observers in RNNs. The work derives linear matrix inequality conditions for firing-rate and Hopfield networks, establishing structural relationships that expand the admissible weight space for monotone activations.
Researchers systematize algorithmic improvements for quantum kernel method inference, analyzing trade-offs between sampling and quantum amplitude estimation techniques to reduce query complexity below the standard O(N||α||₂²/ε²) bound.
Researchers introduce RL-STPA, a framework adapting traditional hazard analysis methods to identify safety risks in reinforcement learning systems deployed in critical domains. The approach combines hierarchical task decomposition, perturbation testing, and iterative feedback loops to address RL's opacity and training-deployment misalignment.
Researchers introduce MEv-SINDy, a one-shot learning method that infers governing equations of complex nonlinear systems from single excitation records using the Generalized Harmonic Balance method. The technique was validated on MEMS devices including a nonlinear beam resonator and micromirror, enabling prediction of frequency-response curves without extensive training data.
Researchers propose MambaSL, a single-layer Mamba variant optimized for time series classification, achieving state-of-the-art results across 30 UEA datasets. The work also re-evaluates 20 baseline models under unified benchmarking protocols to address reproducibility gaps in the field.
Researchers investigate lightweight regularization techniques for diffusion models that reduce Fokker-Planck equation violations without the computational cost of direct penalization. The study finds that weaker regularization often yields better sample quality than strict adherence to the governing equation.
A systematic review of 13 papers (2015–2025) examines whether Masked Autoencoder Foundation Models can predict downhole drilling metrics from surface sensor data, finding that existing work relies on ANNs and LSTMs but no studies have yet applied MAEFMs to this problem.
Researchers discovered that well-converged FP32 language models fail catastrophically when quantized to INT4, with a three-phase pattern: initial joint improvement, a stable plateau, then explosive divergence where quantization error balloons from 11% to 517% despite minimal FP32 perplexity change.
Researchers introduce DAMP, a weight-surgery technique for machine unlearning that removes forget-class information from deep model layers rather than just suppressing classifier outputs. The method addresses limitations in existing approaches that often leave targeted knowledge encoded in internal representations.
Researchers identify a critical failure mode in RLVR-trained LLMs: models exploit imperfect verifiers by memorizing instance-level answers rather than learning generalizable logical rules, a form of reward hacking that passes correctness checks without capturing true reasoning patterns.
Researchers simulated cortical development from a single stem cell using gene regulatory rules, generating 85 mature neurons that spontaneously self-organized into a 200k-synapse circuit. The minimal network jumped from chance-level MNIST performance to 89–94% accuracy after one training epoch, demonstrating how developmental constraints can yield efficient learning architectures.
Researchers propose FedIDM, a Byzantine-robust federated learning method that uses distribution matching to identify malicious clients and stabilize convergence. The approach combines attack-tolerant data generation with contribution-based filtering to maintain model utility while handling colluded adversaries.
Researchers propose two amortized optimization methods (RA-OT and OA-OT) for efficiently computing optimal transport plans across multiple measure pairs using sliced Kantorovich potentials, enabling faster inference without retraining.
Researchers propose MinShap, a modification of Shapley values designed specifically for feature selection in nonlinear models with dependent features. The approach addresses a key limitation of standard Shapley values, which conflate direct and indirect feature effects, making them unsuitable for identifying truly predictive variables.
Researchers propose a metric-agnostic learning-to-rank approach using boosting and rank approximation to overcome limitations of single-metric optimization. The method addresses non-differentiability and limited ranking utility by enabling models to optimize across multiple ranking metrics simultaneously.
Researchers introduce LAMAE, a masked autoencoder foundation model designed for multi-view echocardiography that uses latent attention to share information across cardiac imaging frames and views. The approach addresses limitations of frame-independent processing by enabling coherent reconstruction of heterogeneous spatiotemporal cardiac data.