mirror of
https://github.com/facebookresearch/ReAgent.git
synced 2026-05-17 12:40:39 +00:00
Kittipat Virochsiri
bb88559350
Summary: - Delete SingleQValue and AllActionQValues; returns tensor directly - CategoricalDQN is now taking a ModelBase which returns 3-D tensor (batch_size, num_actions, num_atoms) - FullyConnectedDQN's constructor has one more argument, num_atoms, which default to None. When it's not None, returns 3-D tensor like above - DuelingQNetwork takes 3 sub networks: shared_network, value_network, advantage_network. The parametric version is split out to ParametricDuelingQNetwork for better readability. - Introduces a subclass of Sequential conforming to ModelBase API. `input_prototype()` returns the value from the first module. Reviewed By: czxttkl Differential Revision: D21336534 fbshipit-source-id: 629c688b0de4754effb30cd61f4a6da3cca021ab
151 lines
3.0 KiB
ReStructuredText
151 lines
3.0 KiB
ReStructuredText
ml.rl.models package
|
|
====================
|
|
|
|
Submodules
|
|
----------
|
|
|
|
ml.rl.models.actor module
|
|
-------------------------
|
|
|
|
.. automodule:: ml.rl.models.actor
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.base module
|
|
------------------------
|
|
|
|
.. automodule:: ml.rl.models.base
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.bcq module
|
|
-----------------------
|
|
|
|
.. automodule:: ml.rl.models.bcq
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.categorical\_dqn module
|
|
------------------------------------
|
|
|
|
.. automodule:: ml.rl.models.categorical_dqn
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.cem\_planner module
|
|
--------------------------------
|
|
|
|
.. automodule:: ml.rl.models.cem_planner
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.convolutional\_network module
|
|
------------------------------------------
|
|
|
|
.. automodule:: ml.rl.models.convolutional_network
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.dqn module
|
|
-----------------------
|
|
|
|
.. automodule:: ml.rl.models.dqn
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.dueling\_q\_network module
|
|
---------------------------------------
|
|
|
|
.. automodule:: ml.rl.models.dueling_q_network
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.dueling\_quantile\_dqn module
|
|
------------------------------------------
|
|
|
|
.. automodule:: ml.rl.models.dueling_quantile_dqn
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.example\_sequence\_model module
|
|
--------------------------------------------
|
|
|
|
.. automodule:: ml.rl.models.example_sequence_model
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.fully\_connected\_network module
|
|
---------------------------------------------
|
|
|
|
.. automodule:: ml.rl.models.fully_connected_network
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.mdn\_rnn module
|
|
----------------------------
|
|
|
|
.. automodule:: ml.rl.models.mdn_rnn
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.no\_soft\_update\_embedding module
|
|
-----------------------------------------------
|
|
|
|
.. automodule:: ml.rl.models.no_soft_update_embedding
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.parametric\_dqn module
|
|
-----------------------------------
|
|
|
|
.. automodule:: ml.rl.models.critic
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.quantile\_dqn module
|
|
---------------------------------
|
|
|
|
.. automodule:: ml.rl.models.quantile_dqn
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.seq2slate module
|
|
-----------------------------
|
|
|
|
.. automodule:: ml.rl.models.seq2slate
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
ml.rl.models.world\_model module
|
|
--------------------------------
|
|
|
|
.. automodule:: ml.rl.models.world_model
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|
|
|
|
|
|
Module contents
|
|
---------------
|
|
|
|
.. automodule:: ml.rl.models
|
|
:members:
|
|
:undoc-members:
|
|
:show-inheritance:
|