Operator-Based Generalization Bound for Deep Learning: Insights on Multi-Task Learning

📝 Original Info

• Title: Operator-Based Generalization Bound for Deep Learning: Insights on Multi-Task Learning
• ArXiv ID: 2512.19184
• Date: 2025-12-22
• Authors: 정보가 제공되지 않음 (논문에 저자 명시가 없습니다).

📝 Abstract

This paper presents novel generalization bounds for vector-valued neural networks and deep kernel methods, focusing on multi-task learning through an operator-theoretic framework. Our key development lies in strategically combining a Koopman based approach with existing techniques, achieving tighter generalization guarantees compared to traditional norm-based bounds. To mitigate computational challenges associated with Koopman-based methods, we introduce sketching techniques applicable to vector valued neural networks. These techniques yield excess risk bounds under generic Lipschitz losses, providing performance guarantees for applications including robust and multiple quantile regression. Furthermore, we propose a novel deep learning framework, deep vector-valued reproducing kernel Hilbert spaces (vvRKHS), leveraging Perron Frobenius (PF) operators to enhance deep kernel methods. We derive a new Rademacher generalization bound for this framework, explicitly addressing underfitting and overfitting through kernel refinement strategies. This work offers novel insights into the generalization properties of multitask learning with deep learning architectures, an area that has been relatively unexplored until recent developments.

💡 Deep Analysis

📄 Full Content

Reference