GitHub/ReAgent
1
0
Fork 0
mirror of https://github.com/facebookresearch/ReAgent.git synced 2026-06-16 12:44:41 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,339 Commits 5 Branches 0 Tags
master
Commit Graph
2 Commits
Author SHA1 Message Date
Kittipat Virochsiri bb88559350 Simplifying model API 
Summary:
- Delete SingleQValue and AllActionQValues; returns tensor directly
- CategoricalDQN is now taking a ModelBase which returns 3-D tensor (batch_size, num_actions, num_atoms)
- FullyConnectedDQN's constructor has one more argument, num_atoms, which default to None. When it's not None, returns 3-D tensor like above
- DuelingQNetwork takes 3 sub networks: shared_network, value_network, advantage_network. The parametric version is split out to ParametricDuelingQNetwork for better readability.
- Introduces a subclass of Sequential conforming to ModelBase API. `input_prototype()` returns the value from the first module.

Reviewed By: czxttkl

Differential Revision: D21336534

fbshipit-source-id: 629c688b0de4754effb30cd61f4a6da3cca021ab
 2020-05-07 15:09:36 -07:00
Zhengxing Chen 8ece668954 Update docs 
Summary: Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/178

Reviewed By: kittipatv

Differential Revision: D18165626

Pulled By: czxttkl

fbshipit-source-id: 034ed0a37924df1113c5a1332a771bd4e0aeb5bb
 2019-10-28 23:15:36 -07:00