Summary: Follow the instructions in T66611582. Now the only remaining problem is that headers must include copyright.
Reviewed By: alexnikulkov
Differential Revision: D32583915
fbshipit-source-id: 13d390d756825c5e91e7801bf0dc4efec9b8b1f7
Summary:
Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/299
This diff accomplishes several items:
1. Remove PageHandler and consolidate all training functions into one function, using polymorphism to handle model-specific logic
2. Make BatchRunner the sole place where FB vs. OSS context is decided (by choosing FbBatchRunner or OssBatchRunner)
3. Transform ModelManager into a stateless provider.
4. With the exception of model manager, remove all duplicate classes by creating oss & internal versions and using polymorphism, or moving out of workflow/* entirely
5. Replace signals-and-slots API with interfaces
6. Create a DataFetcher class, unifying the APIs to query data on OSS and FB.
Reviewed By: kaiwenw
Differential Revision: D22702504
fbshipit-source-id: 3eb8e93144ca12ac650a4fafc875e29d8ade89e3
Summary:
- Delete SingleQValue and AllActionQValues; returns tensor directly
- CategoricalDQN is now taking a ModelBase which returns 3-D tensor (batch_size, num_actions, num_atoms)
- FullyConnectedDQN's constructor has one more argument, num_atoms, which default to None. When it's not None, returns 3-D tensor like above
- DuelingQNetwork takes 3 sub networks: shared_network, value_network, advantage_network. The parametric version is split out to ParametricDuelingQNetwork for better readability.
- Introduces a subclass of Sequential conforming to ModelBase API. `input_prototype()` returns the value from the first module.
Reviewed By: czxttkl
Differential Revision: D21336534
fbshipit-source-id: 629c688b0de4754effb30cd61f4a6da3cca021ab
Summary: We no longer use Thrift for configuration
Reviewed By: czxttkl
Differential Revision: D18242481
fbshipit-source-id: bfdfa1e7baa21be92bb51a7103d0f379dafee2b2
Summary:
Update several things so that sphinx compiled successfully:
conf.py (add onnx in autodoc_mock_imports and add Horizon root to sys.path)
ml/rl/caffe_utils.py (update __getattr__ such that sphnix wouldn't throw exception)
ml/rl/tensorboardX.py (update __getattr__ such that sphnix wouldn't throw exception)
Pull Request resolved: https://github.com/facebookresearch/Horizon/pull/146
Test Plan: Wait for all integration tests and unit tests pass
Reviewed By: kittipatv
Differential Revision: D16243745
Pulled By: czxttkl
fbshipit-source-id: e3b8af37ec520bde44a4a59379341bceaa981070
Zhengxing Chen
Jason Gauci
Kittipat Virochsiri
Zhengxing Chen