專題演講 主講人：廖耿德教授 (清華大學統計與數據科學研究所)
題 目：Representation Learning for Generalized Knowledge: From Identifying Invariance to Multimodal Fusion
主講人：廖耿德教授 (清華大學統計與數據科學研究所)
時 間：115年3月27日(星期五)上午10:40-11:30
(上午10:20-10:40茶會於綜合一館428室舉行)
地 點：綜合一館427室
摘要
A fundamental challenge in deep learning lies in distinguishing true causal knowledge from transient correlations. While modern neural networks excel at high-dimensional pattern recognition, they often rely on features that appear predictive during training but fail to represent the underlying data-generating process. Consequently, these models often struggle with environment shifts, causing a lack of robustness when faced with out-of-distribution data.In this talk, I will present our research on learning and representing generalizable knowledge with deep neural networks. I will begin by introducing our work grounded in the invariance principle, where generalization is achieved by enforcing model behaviors remaining stable across diverse data-generating processes. Afterwards, I will extend these concepts to multi-modal fusion, addressing the challenge of learning unified latent representations from heterogeneous sources such as images, text, and audio. I will demonstrate the effectiveness of our work on identifying the underlying shared information, leading to robust performance and interpretable model behaviors in downstream tasks.