Hiroshi Makino

Professor

Keio University School of Medicine
Country flagJapan

Research Interests

ApplyKite TwinLearns as you apply

Make your next move.

Prepare your application

Review drafts before you send them.

Explore related searches

About

Hiroshi Makino is an Assistant Professor at Nanyang Technological University in Singapore. His research areas include distributed representations in neural networks and short-term memory dynamics. Recent articles authored by Dr. Makino focus on reward prediction errors, hierarchical behavior composition, and sensorimotor integration in both artificial and biological systems.

Articles (5)

Year:

2026

Year:

2025

Year:

2023

The integration of deep learning and theories of reinforcement learning (RL) is a promising avenue to explore novel hypotheses on reward-based learning and decision-making in humans and other animals. Here, we trained deep RL agents and mice in the same sensorimotor task with high-dimensional state and action space and studied representation learning in their respective neural networks. Evaluation of thousands of neural network models with extensive hyperparameter search revealed that learning-dependent enrichment of state-value and policy representations of the task-performance-optimized deep RL agent closely resembled neural activity of the posterior parietal cortex (PPC). These representations were critical for the task performance in both systems. PPC neurons also exhibited representations of the internally defined subgoal, a feature of deep RL algorithms postulated to improve sample efficiency. Such striking resemblance between the artificial and biological networks and their functional convergence in sensorimotor integration offers new opportunities to better understand respective intelligent systems.

Year:

2022

Year:

2022

Collaborators (1)

Tsukasa Kamigaki

Assistant Professor

Nanyang Technological University

SINGAPORE
View details