Hiroshi Makino
Professor
Research Interests
Make your next move.
Prepare your application
Review drafts before you send them.
Explore related searches
About
Hiroshi Makino is an Assistant Professor at Nanyang Technological University in Singapore. His research areas include distributed representations in neural networks and short-term memory dynamics. Recent articles authored by Dr. Makino focus on reward prediction errors, hierarchical behavior composition, and sensorimotor integration in both artificial and biological systems.
Articles (5)
Year:
2026
Year:
2025
Year:
2023
The integration of deep learning and theories of reinforcement learning (RL) is a promising avenue to explore novel hypotheses on reward-based learning and decision-making in humans and other animals. Here, we trained deep RL agents and mice in the same sensorimotor task with high-dimensional state and action space and studied representation learning in their respective neural networks. Evaluation of thousands of neural network models with extensive hyperparameter search revealed that learning-dependent enrichment of state-value and policy representations of the task-performance-optimized deep RL agent closely resembled neural activity of the posterior parietal cortex (PPC). These representations were critical for the task performance in both systems. PPC neurons also exhibited representations of the internally defined subgoal, a feature of deep RL algorithms postulated to improve sample efficiency. Such striking resemblance between the artificial and biological networks and their functional convergence in sensorimotor integration offers new opportunities to better understand respective intelligent systems.
Year:
2022
Year:
2022
Collaborators (1)
Tsukasa Kamigaki
Assistant Professor
Nanyang Technological University
Make your next move.
Prepare your application
Review drafts before you send them.