Tag: q-learning

25 What is the relation between Q-learning and policy gradients methods? 2018-04-28T03:11:16.087

15 Why doesn't Q-learning converge when using function approximation? 2019-04-05T18:23:46.233

13 Why does DQN require two different networks? 2018-07-02T07:47:23.303

9 How do we prove the n-step return error reduction property? 2018-12-08T05:24:56.380

8 Are Q-learning and SARSA the same when action selection is greedy? 2020-05-10T10:52:49.730

7 How does Q-learning work in stochastic environments? 2018-03-29T09:57:12.370

7 Is Q-Learning suitable for continous (state or action) spaces? 2019-05-11T11:11:43.090

6 How to implement exploration function and learning rate in Q Learning 2018-02-16T05:12:24.747

6 Q-Learning the generic maze solution 2018-10-17T12:00:49.070

6 Can Q-learning be used in a POMDP? 2019-04-03T02:40:29.227

6 Does AlphaZero use Q-Learning? 2019-07-01T17:02:00.180

6 What does the symbol $\mathbb E$ mean in these equations? 2019-08-27T14:46:48.670

5 Why is the target $r + \gamma \max_{a'} Q(s', a'; \theta_i^-)$ in the loss function of the DQN architecture? 2017-12-13T19:25:59.450

5 Reinforcement Learning (Fitted Q): Qn on Concept & Implementation 2018-08-07T20:00:59.637

5 Is the discount not needed in a deterministic environment for Reinforcement Learning? 2018-08-15T16:58:56.453

5 Can DQN perform better than Double DQN? 2019-04-08T09:08:16.597

5 Deciding on a reward per each action in a given state (Q-learning) 2019-05-12T00:15:10.860

5 Can exogenous variables be state features in reinforcement learning? 2019-08-25T07:12:44.720

5 What are some online courses for deep reinforcement learning? 2020-03-25T14:46:24.230

5 Is the Bellman equation that uses sampling weighted by the Q values (instead of max) a contraction? 2020-07-23T17:32:14.873

4 State representation of position in 2D plane for Reinforcement Learning (Q Learning) 2016-09-09T10:19:56.087

4 Is Q-learning a type of model-based RL? 2017-12-19T03:04:18.840

4 How to apply or extend the $Q(\lambda)$ algorithm to semi-MDPs? 2019-03-10T20:54:06.810

4 Why is there inconsistency in the definitions of the retrace? 2019-04-29T08:07:22.677

4 Q-learning, am I interpreting correctly $Q(s,a) = r + \gamma \max_{a'} Q(s',a')$? 2019-05-15T15:15:16.280

4 Is tabular Q-learning considered interpretable? 2019-08-12T16:08:40.787

4 Does using the softmax function in Q learning not defeat the purpose of Q learning? 2019-12-07T09:40:07.557

4 How can a DQN backpropagate its loss? 2020-01-14T17:51:38.797

4 What is the target Q-value in DQNs? 2020-04-19T03:25:51.150

4 Is there any good reference for double deep Q-learning? 2020-05-28T15:55:49.123

4 Upper limit to the maximum cumulative reward in a deep reinforcement learning problem 2020-07-18T13:27:17.247

4 Why do DQNs tend to forget? 2020-07-27T11:51:00.447

3 How q-learning solves the issue with value iteration in model-free settings 2016-10-30T23:56:59.217

3 Which Reinforcement Learning algorithms are efficient for episodic problems? 2018-01-13T03:48:19.280

3 Should the actor or actor-target model be used to make predictions after training is complete (DDPG)? 2018-02-27T13:27:26.843

3 Q-learning in Python 2018-03-12T10:23:44.230

3 What are good learning strategies for Deep Q-Network with opponents? 2018-04-04T09:13:15.360

3 Snake path finding variant : Algorithm choice 2018-04-07T21:06:37.043

3 Training AI to play NES/SNES games on NN python 2018-04-29T01:34:48.543

3 Action Probability with Thompson Sampling in Deep Reinforcement Learning 2018-06-15T09:11:56.317

3 Number of Neuron in Q-Learning of Chess 2018-06-28T08:19:24.323

3 Difficulty in understanding identifiability in the "Dueling Network Architectures for Deep Reinforcement Learning" paper 2018-09-25T01:08:12.727

3 Reason for issues with correlation in the dataset in DQN 2018-11-02T08:06:45.560

3 How to define the final / terminal state for Q learning? 2019-01-31T13:23:24.273

3 Meaning of Actor Output in Actor Critic Reinforcement Learning 2019-02-06T15:04:21.750

3 Can Q-learning be used to derive a stochastic policy? 2019-02-08T01:47:33.333

3 My DQN is stuck and can't see where the problem is 2019-02-22T20:55:03.887

3 Why is the max a non-expansive operator? 2019-03-14T20:50:46.340

3 What are the differences between the DQN variants? 2019-03-23T12:38:31.063

3 Why Q2 is a more or less independant estimate in Twin Delayed DDPG (TD3)? 2019-03-24T05:26:49.420

3 Deep Q-Learning agent poor performing actions. Need help optimizing 2019-04-11T23:18:09.190

3 Experience Replay Not Always Giving Better Results 2019-04-29T15:30:20.570

3 How do I represent a multi-dimensional state using a neural network? 2019-05-16T06:16:22.003

3 What is the difference between return and expected return? 2019-06-30T15:12:14.500

3 Is it possible to have a dynamic $Q$-function? 2019-07-18T20:57:51.023

3 How can I use Q-learning for inventory decision making? 2019-07-19T19:54:35.257

3 Can Google's patented ML algorithms be used commercially? 2019-11-17T03:06:57.037

3 Is the Q value updated at every episode? 2020-01-06T09:34:45.043

3 Why Monte Carlo epsilon-soft approach cannot compute $\max Q(s,a)$? 2020-01-16T08:24:37.940

3 How does the optimization process in hindsight experience replay exactly work? 2020-03-12T10:19:55.543

3 Is this a good approach to solving Atari's "Montezuma's Revenge"? 2020-03-13T10:58:40.600

3 Are Q values estimated from a DQN different from a duelling DQN with the same number of layers and filters? 2020-04-13T03:46:47.127

3 Relationship between the reward rate and the sampled reward in a Semi-Markov Decision Process 2020-04-16T13:16:38.073

3 Does Q Learning learn from an opponent playing random moves? 2020-05-03T22:05:05.463

3 Effect of the order of the reward function 2020-05-14T09:01:12.057

3 What is the difference between on-policy and off-policy for continuous environments? 2020-05-18T15:11:12.333

3 If agent chooses an action that the environment can't operate, how should I handle this situation? 2020-05-19T03:39:50.190

3 Convergence of a delayed policy update Q-learning 2020-05-22T19:20:39.537

3 How to take actions at each episode and within each step of the episode in deep Q learning? 2020-06-05T20:32:22.853

3 How to know if my DQN is optimized? 2020-06-20T05:38:04.100

3 What happens when you select actions using softmax instead of epsilon greedy in DQN? 2020-06-23T16:47:51.683

3 Why is it not advisable to have a 100 percent exploration rate? 2020-06-26T16:58:12.707

3 When do SARSA and Q-Learning converge to optimal Q values? 2020-08-09T15:35:20.917

3 What are the differences between Q-Learning and A*? 2020-08-16T21:58:50.113

3 Is there a logical method of deducing an optimal batch size when training a Deep Q-learning agent with experience replay? 2020-08-25T22:16:33.010

2 Q learning tic tac toe 2017-04-12T13:32:49.070

2 Why is the access to the dynamics model unrealistic in Q-Learning? 2017-12-13T13:26:14.637

2 How to use DQN to handle an imperfect but complete information game? 2018-03-27T13:19:29.650

2 Should the exploration rate be reset after each trial in Q-learning? 2018-05-12T22:23:09.803

2 Convergence in multi-agent environment 2018-07-08T12:46:01.443

2 Deep Q-Learning poor convergence on Stochastic Environment 2018-11-17T11:39:38.267

2 Why are Q values updated according to the greedy policy? 2018-11-17T16:23:25.537

2 How to build AI bots for board games like monopoly? 2018-11-23T17:17:43.920

2 Concrete Example for Q Learning 2019-01-04T14:11:38.477

2 Using the opponent's mixed strategy in estimating the state value in minimax Q learning 2019-01-10T10:01:16.663

2 Will Q-learning converge to the optimal state-action function when the reward periodically changes? 2019-02-06T15:06:38.913

2 How do updates in SARSA and Q-learning differ in code? 2019-02-09T15:33:02.100

2 What is the next state for a two-player board game? 2019-02-09T23:56:24.377

2 Why does Deep Q Network outputs multiple Q values? 2019-02-19T09:14:56.147

2 Is there a way to train an RL agent without any environment? 2019-03-06T10:41:05.043

2 Is there any grid world dataset or generator for reinforcement learning? 2019-03-07T02:18:47.097

2 Hindsight Experience Replay with multiple goals 2019-03-19T15:59:36.103

2 Maximum Q value for new state in Q-Learning never exists 2019-04-18T08:16:04.020

2 How to stop DQN Q function from increasing during learning? 2019-04-24T14:15:02.803

2 Deep Reinforcement Learning: Rewards suddenly dip down 2019-06-18T19:45:18.273

2 How to stop evaluation phase in reinforcement learning with epsilon-greedy Monte Carlo agent? 2019-06-29T10:46:52.620

2 How does Friend-or-Foe Q-learning intuitively work? 2019-07-13T10:50:54.687

2 If deep Q learning involves adjusting the value function for a specific policy, then how do I choose the right policy? 2019-07-13T21:48:24.443

2 Will the target network, which is less trained than the normal network, output inferior estimates? 2019-07-20T03:17:34.007