Wir laden herzlich zum Kolloquium von Prof. Dr. Cees G. M. Snoek ein!
Am 18. März, von 13:30 bis 14:30 Uhr, wird Prof. Dr. Cees G. M. Snoek, Leiter des Video & Image Sense Lab an der University of Amsterdam (Niederlande), einen Research Talk in englischer Sprache halten.
Der Research Talk widmet sich dem Thema „What multimodal foundation models cannot perceive “.
Abstract: Multimodal foundation models are a revolutionary class of AI models that provide impressive abilities to generate multimedia content and do so by interactive prompts in a seemingly creative manner. These foundation models are often self-supervised transformer-based models pre-trained on large volumes of data, typically collected from the web. They already form the basis of all state-of-the-art systems in computer vision and natural language processing across a wide range of tasks and have shown impressive transfer learning abilities. Despite their immense potential, these foundation models face challenges in fundamental perception tasks such as spatial grounding and temporal reasoning, have difficulty to operate on low-resource scenarios, and neglect human-alignment for ethical, legal, and societal acceptance. In this talk I will highlight recent work from my lab that identifies several of these challenges as well as ways to update foundation models to address these challenges and to do so in a sustainable way, without the need to retrain from scratch.
Die Veranstaltung ist kostenfrei. Interessierte sind herzlich eingeladen, teilzunehmen!