One of SCIoI’s goals is to establish and evaluate synthetic models for biological data. Achieving this goal is clearly beneficial not only to produce more capable artificial behavior, but also to get a better idea about the processes that may underlie biological intelligence. Why can a cockatoo or mouse open a lock box? What information do we need to provide an artificial agent to perform this task? While this goal is attractive in theory, different projects in SCIoI face diverse practical problems on their way to fulfill this vision. In this joint talk we (Katharina Hohlbaum, Niek Andresen, Danny Driess, and Manuel Baum) will discuss this topic from the perspectives of our individual projects. We aim not only to report on the challenges we face, but would also like to discuss ideas to address these challenges with you.