Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about DQN inputs #19

Open
TheInvoker opened this issue Nov 17, 2016 · 0 comments
Open

Question about DQN inputs #19

TheInvoker opened this issue Nov 17, 2016 · 0 comments

Comments

@TheInvoker
Copy link

TheInvoker commented Nov 17, 2016

I am trying to understand the inputs for the example given here
http://cs.stanford.edu/people/karpathy/reinforcejs/index.html

env.getNumStates()
This is the size of the vector that represents the variables of the current game configuration?

env.getMaxNumActions
For this one, is it the total number of configurations the game can have? Or is it the number of actions the play can currently do in the current game configuration, such as in a grid maze, the player has up to 4 directions to move, so it would be 4.

Inside the "setInterval" function, "s" is not defined. It is the vector of the variables of the current game configuration that I have to get myself?

And "reward" is something I have to calculate too based on the current "s" vector?

Also why is getNumStates and getMaxNumActions a function, when they seem to return a constant value? Is it supposed to support returning dynamic values? Can the vector size be allowed to be different at anytime? And the Max num of actions, is that dynamic too?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant