Analysis on learning a latent structure in a probabilistic reversal learning task
- Akira Masumi, Department of Media Information Engineering, National Institute of Technology, Okinawa College, Nago, Okinawa, Japan
- Takashi Sato, Department of Media Information Engineering, National Institute of Technology, Okinawa College, Nago, Okinawa, Japan
AbstractWe need to be flexible to adapt to dynamically changing circumstances. A probabilistic reversal learning task is one of the experimental paradigms to characterize flexibility of a subject. In recent studies, it is hypothesized that a subject may utilize not only a reward history but also a “cognitive map” representing a latent structure of the task. In this study, we conducted an experiment using the task toward understanding a process of learning a latent structure of the task. We found subjects choose a rewarding option with relatively high frequency in a later phase of the task. Analyzing the subjects’ decision making, it is suggested that they make decision based on their own estimation about the latent structure. A statistical model selection suggested that a reinforcement learning model with state representations fit behavioral data in the later phase. These results suggest the subjects learn the latent structure during the task.