tilos

Talk Information Speaker: Claire Boyer (Université Paris-Saclay) Date & Time: Thursday, March 27 @ 2pm PDT Venue: HDSI 123 Title: Single location regression and attention-based models Abstract: Attention-based models, such as Transformer, excel across various tasks but lack a comprehensive theoretical understanding, especially regarding token-wise sparsity and internal linear representations. To address this gap, we introduce the single-location regression task, where […]

TITLE  Foundational Methods for Foundation Models for Scientific Machine Learning| ABSTRACT  The remarkable successes of ChatGPT in natural language processing (NLP) and related developments in computer vision (CV) motivate the question of what foundation models would look like and what new advances they would enable, when built on the rich, diverse, multimodal data that are […]