We recently published a paper on deep reinforcement learning with Double Q-learning, demonstrating that Q-learning learns overoptimistic action values when combined with deep neural networks, even on deterministic environments such as Atari video games, and that this can be remedied by using a variant of Double Q-learning.  The resulting Double DQN algorithm greatly improves over the performance of the DQN algorithm. Abstract:…