| <?xml version='1.0' encoding='UTF-8'?> |
| <feed xmlns:opensearch="http://a9.com/-/spec/opensearch/1.1/" xmlns:arxiv="http://arxiv.org/schemas/atom" xmlns="http://www.w3.org/2005/Atom"> |
| <id>https://arxiv.org/api//VkLJYgwgpRJnaaez26RuKDFDnE</id> |
| <title>arXiv Query: search_query=&id_list=2605.17126&start=0&max_results=10</title> |
| <updated>2026-07-21T22:53:23Z</updated> |
| <link href="https://arxiv.org/api/query?search_query=&start=0&max_results=10&id_list=2605.17126" type="application/atom+xml"/> |
| <opensearch:itemsPerPage>10</opensearch:itemsPerPage> |
| <opensearch:totalResults>1</opensearch:totalResults> |
| <opensearch:startIndex>0</opensearch:startIndex> |
| <entry> |
| <id>http://arxiv.org/abs/2605.17126v2</id> |
| <title>Multi-task Linear Regression without Eigenvalue Lower Bounds: Adaptivity, Robustness, and Safety</title> |
| <updated>2026-05-29T08:34:47Z</updated> |
| <link href="https://arxiv.org/abs/2605.17126v2" rel="alternate" type="text/html"/> |
| <link href="https://arxiv.org/pdf/2605.17126v2" rel="related" type="application/pdf" title="pdf"/> |
| <summary>We study the multi-task linear regression problem in the presence of contaminated tasks. We address the setting where the unknown parameters of a majority of tasks are close in the $\ell_2$-norm, while a fraction of tasks are arbitrary outliers. Existing theoretical frameworks for this problem rely heavily on the assumption that the empirical second moment of each task has a minimum eigenvalue bounded away from zero (order $Ω(1)$). Crucially, this assumption fails in many high-dimensional scenarios, rendering prior guarantees vacuous. To overcome this limitation, we propose an estimator based on matrix-weighted norm regularization. We also introduce a relative balancedness condition, quantified by a balancedness constant, that compares each task's second moment with the average inlier geometry and relaxes the need for taskwise second-moment lower bounds. In favorable regimes with moderate balancedness, our prediction MSE bounds match the rate of Duan and Wang (2023) under substantially weaker spectral assumptions; the resulting task-overall MSE is minimax optimal up to logarithmic factors. Furthermore, we demonstrate that our estimator enjoys a safety guarantee: when the relevant balancedness constant is large or infinite, or when tasks are unrelated, the method performs no worse than independent task learning.</summary> |
| <category term="stat.ML" scheme="http://arxiv.org/schemas/atom"/> |
| <category term="cs.LG" scheme="http://arxiv.org/schemas/atom"/> |
| <category term="stat.ME" scheme="http://arxiv.org/schemas/atom"/> |
| <published>2026-05-16T19:06:54Z</published> |
| <arxiv:comment>Accepted at ICML 2026</arxiv:comment> |
| <arxiv:primary_category term="stat.ML"/> |
| <author> |
| <name>Seok-Jin Kim</name> |
| </author> |
| </entry> |
| </feed> |
|
|