2026-10-14T15:40:33Z https://api.figshare.com/v2/oai

oai:figshare.com:article/33793779 2026-09-15T12:50:34Z category_7 category_15 category_16 category_931 category_811 category_122 portal_87 item_type_3 month_year_09_2026

Supervised Random Feature Regression via Projection Pursuit Jingran Zhou (3335040) Ling Zhou (51948) Shaogao Lv (24933849) Medicine Neuroscience Physiology Information Systems not elsewhere classified Mathematical Sciences not elsewhere classified Mental Health Random feature Supervised Projection pursuit Feed-forward two-layer non-parametric estimation <p>Random Feature (RF) methods and Neural Networks (NNs) are two dominant paradigms in nonparametric modeling. RF methods offer computational efficiency but are often limited by their reliance on fixed, data-independent feature representations. NNs achieve strong expressive power through deep architectures, yet at the cost of greater computational complexity, reduced interpretability, and sensitivity to hyperparameter choices—particularly in limited-data settings. This paper proposes a <b>supervised random feature framework based on projection pursuit</b> that bridges these two paradigms. The core estimator, <b>SRF-I</b>, replaces the fixed activation function in classical RF with data-adaptive univariate basis functions learned along random projections in a supervised manner. Building on SRF-I, we develop <b>SRF-II</b>, a blockwise hierarchical extension that aggregates block-level predictions through a projection pursuit regression model, enhancing both scalability and modeling flexibility. We establish an excess risk bound for SRF-I that characterizes the bias–variance trade-off and guarantees consistency under mild conditions. Extensive simulations and real-data experiments demonstrate that the proposed framework combines the computational advantages of RF methods with the expressive power of neural networks, achieving robust performance in limited-data regimes without extensive hyperparameter tuning.</p> 2026-09-15T12:50:34Z Dataset Dataset 10.6084/m9.figshare.33793779.v1 https://figshare.com/articles/dataset/Supervised_Random_Feature_Regression_via_Projection_Pursuit/33793779 CC BY 4.0