1) Matsumoto G, Tsujino H: Design of a brain computer using the novel principles of output-driven operation and memory-based architecture. In: Cognition and Emotion in the Brain, International Congress Series 1250, Ono T, Matsumoto G, Llinas R, Berthoz A, Norgen R, Nishijo H, Tamura R (eds.), Elsevier, Amsterdam, 2003, pp529-546
2) Middleton FA, Strick PL: Basal ganglia and cerebellar loops: motor and cognitive circuits. Brain Res Brain Res Rev 31: 236-250, 2000
3) Alexander GE, DeLong MR: Microstimulation of the primate neostriatum. I. Physiological properties of striatal microexcitable zones. J Neurophysiol 53: 1401-1416, 1985
4) Schultz W, Dayan P, Montague PR: A neural substrate of prediction and reward. Science 275: 1593-1599, 1997
5) Reynolds JNJ, Hyland BI, Wickens JR: A cellular mechanism of reward-related learning. Nature 413: 67-70, 2001
6) Koos T, Tepper JM: Inhibitory control of neostriatal projection neurons by GABAergic interneurons. Nat Neurosci 2: 467-472, 1999
7) Hikosaka O, Takikawa Y, Kawagoe R: Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol Rev 80: 953-978, 2000
8) Plenz D, Kitai ST: A basal ganglia pacemaker formed by the subthalamic nucleus and external globus pallidus. Nature 400: 677-682, 1999
9) Middleton FA, Strick PL: Basal ganglia and cerebellar loops: motor and cognitive circuits. Brain Res Brain Res Rev 31: 236-250, 2000
10) Bevan MD, Booth PA, Eaton SA, Bolam JP: Selective innervation of neostriatal interneurons by a subclass of neuron in the globus pallidus of the rat. J Neurosci 18: 9438-9452, 1998
11) Sato F, Lavallee P, Levesque M, Parent A: Single-axon tracing study of neurons of the external segment of the globus pallidus in primate. J Comp Neurol 417: 17-31, 2000
12) Thrun S, Burgard W, Fox D: Probabilistic Robotics. MIT Press, Cambridge, MA, 2005
13) Sutton RS, Barto AG: Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA, 1998
14) Samejima K, Doya K: Multiple representations of belief states and action values in cortico-basal ganliga loops. Ann N Y Acad Sci 1104: 213-228, 2007
15) Rummery GA, Niranjan M: On-line Q-learning using connectionist systems. Technical Report CUED/F-INFENG/TR 166, Cambridge University Engineering Department, Cambridge, 1994
16) Takeuchi J, Shouno O, Tsujino H: Connectionist reinforcement learning with cursory intrinsic motivations and linear dependencies to multiple representation. In: Proceedings of 2006 International Joint Conference on Neural Networks (IJCNN), 2006, pp54-61
17) Doya K, Samejima K, Katagiri K, Kawato M: Multiple model-based reinforcement learning. Neural Comput 14: 1347-1369, 2002
18) Jaeger H: The ‘echo state' approach to analysing and training recurrent neural networks. German National Research Center for Information Technology, GMD Report 148, 2001
19) Kohonen T: Self-Organizing Maps, Springer-Verlag, Heidelberg, Berlin, 1995
20) Nishida S, Ishii K, Furukawa T: An online adaptation control system using mnSOM. In: Proceedings of 13th International Conference of Neural Information Processing (ICONIP), 2006, pp935-942
21) Barto AG, Singh S, Chentanez N: Intrinsically motivated learning of hierarchical collection of skills. In: Proceedings of the 3rd International Conference on Developmental Learning (ICDL), 2004