Вход на сайт

Просмотр новости

Найдите то, что Вас интересует

Doubly Debiased Robust Subsampling for Transfer Learning

Дата публикации: 17-08-2026 20:26:00


This paper develops a general framework for doubly debiased robust subsampling for transfer learning. The setting arises when massive source datasets are computationally infeasible to use in full, while naive or heuristic subsampling leads to biased estimators that further inherit transfer bias under source-target distributional shifts. We resolve these challenges through two complementary debiasing mechanisms. Inverse probability weighting removes subsampling bias by ensuring that subsample-based estimators represent the full source distribution, while a target-based one-step refinement recenters estimators towards the target distribution, thereby mitigating transfer bias. These corrections are embedded within a distributionally robust optimization design that simultaneously controls worst-case target risk and enforces source-target alignment through maximum mean discrepancy. To optimize subsampling distributions, we propose a scalarized particle swarm algorithm that efficiently explores the robustness-alignment frontier by adjusting a single tuning parameter. We establish theoretical properties, including asymptotic normality, generalization bounds, oracle inequalities, and minimax optimality under distributional uncertainty. Simulation studies and empirical applications in text sentiment and image recognition demonstrate that the proposed method consistently improves prediction accuracy and robustness compared with uniform subsampling, target-only training, and alignment-only approaches, and that both debiasing mechanisms are essential for reliable transfer.

Схожие новости

#Наименование новостиТональностьИнформативностьДата публикации
1 Extrapolated Markov Chain Oversampling Method for Imbalanced Text Classification 05.2317-08-2026
2 Mixing times of data-augmentation Gibbs samplers for high-dimensional probit regression 08.7817-08-2026
3 High-dimensional Parameter Transfer With Fused-Regularizer 09.3817-08-2026
4 Classification Under Local Differential Privacy with Model Reversal and Model Averaging 03.8417-08-2026
5 Robust training of implicit generative models for multivariate and heavy-tailed distributions with an invariant statistical loss 01017-08-2026
6 Cheap Bootstrap for Fast Uncertainty Quantification of Stochastic Gradient Descent 06.3817-08-2026
7 The Sample Complexity of Parameter-Free Stochastic Convex Optimization 05.717-08-2026
8 Transfer Conformal Predictive Inference for Regression 05.0217-08-2026
9 On the Relevance of Byzantine Robust Optimization Against Data Poisoning 04.917-08-2026
10 Exogenous Randomness Empowering Random Forests 0717-08-2026

Классификация: Пресс-релизы. Схожих патентов: 0. Схожих новостей: 10. Тональность: 0. Информативность: 8.06. Источник: jmlr.org.