1Editorial Special issue on approximate dynamic programming and reinforcement learningSilvia Ferrari, Jagannathan Sarangapani, Frank L. Lewis3092Approximate policy iteration: a survey and some new methodsDimitri P. BERTSEKAS310-3353A review of stochastic algorithms with continuous value function approximation and some new approximate policy iteration algorithms for multidimensional continuous applicationsWarren B. POWELL, Jun MA336-3524Adaptive dynamic programming for online solution of a zero-sum differential gameDraguna VRABIE, Frank LEWIS353-3605Online optimal control of nonlinear discrete-time systems using approximate dynamic programmingTravis DIERKS, Sarangapani JAGANNATHAN361-3696Approximate dynamic programming solutions with a single network adaptive critic for a class of nonlinear systemsJie DING, S. N. BALAKRISHNAN370-3807Finite horizon optimal control of discrete-time nonlinear systems with unfixed initial state using adaptive dynamic programmingQinglai WEI, Derong LIU381-3908A model-based approximate λ-policy iteration approach to online evasive path planning and the video game Ms.Pac-ManGreg FODERARO, Vikrarn RAJU, Silvia FERRARI391-3999Asymptotic tracking by a reinforcement learning-based adaptive critic controllerShubhendu BHASIN, Nitin SHARMA, Parag PATRE, Warren DIXON400-40910Stable reinforcement learning with recurrent neural networksJames Nate KNIGHT, Charles ANDERSON410-42011Semi-Markov adaptive critic heuristics with application to airline revenue managementKetaki KULKARNI, Abhijit GOSAVI, Susan MURRAY, Katie GRANTHAM421-43012Multiresolution state-space discretization for Q-Learning with pseudorandomized discretizationAmanda LAMPTON, John VALASEK, Mrinal KUMAR431-43913Hierarchical state-abstracted and socially augmented Q-Learning for reducing complexity in agent-based learningXueqing SUN, Tao MAO, Laura RAY, Dongqing SHI, JeraldKRALIK440-45014Moving least-squares approximations for linearly-solvable stochastic optimal control problemsMingyuan ZHONG, Emanuel TODOROV451-46315Information for Authors465 