Adrien Doerig (Freie Universität), “High-level visual representations in the human brain are aligned with large language models”
SCIoI, Marchstraße 23, 10587 Berlin, Room 2.057The human brain extracts complex information from visual inputs, including objects, their spatial and semantic interrelations, and their interactions with the environment. However, a quantitative approach to capture this information remains elusive. I will present work where we show that LLM embeddings of scene captions successfully characterise brain activity evoked by viewing the natural scenes.
