39385e8d83
Tune SAC and CRR Models. Initial support for batch gym training ( #470 )
...
Summary: Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/470
Reviewed By: czxttkl
Differential Revision: D28093192
fbshipit-source-id: 6b260c3e8d49c8b302e40066e2be49a0bfe96688
2021-05-18 09:27:48 -07:00
af019527e6
Separate unittest to two and add code coverage for e2e ( #261 )
...
Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/261
Reviewed By: kittipatv
Differential Revision: D21489212
Pulled By: kaiwenw
fbshipit-source-id: a9a7793ab3889753a64946cf3c608d0e4ad52ad3
2020-05-11 20:01:24 -07:00
2d824a7813
add sac to circle ci ( #255 )
...
Summary: Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/255
Test Plan: CircleCI
Reviewed By: kittipatv
Differential Revision: D21440433
Pulled By: kaiwenw
fbshipit-source-id: 3b376b55b70a22850f609d97022771e3659c3977
2020-05-08 00:31:10 -07:00
a2bab0d525
Offline workflow for SAC ( #244 )
...
Summary:
Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/244
Implement Batch RL workflow for SAC for OSS.
Reviewed By: kittipatv
Differential Revision: D21297915
fbshipit-source-id: f782ed1011580e041edace6000859d5901b4ce96
2020-05-02 10:21:07 -07:00
e7c7b26554
Write end-to-end workflow with new open-sourced workflow code ( #237 )
...
Summary:
- Use refactored gymrunner for making data batch
- Implement train_and_evaluate_generic
- (partially) fill out discrete_dqn_reporter
- fill out model_manager.train_workflow
- replace test_oss_workflow.py with new test.
- simplify Preprocessor.scala and remove unused params in Timeline.scala
Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/237
Test Plan: Run workflow in scripts/ci/run_end_to_end_test.sh.
Reviewed By: kittipatv
Differential Revision: D21181946
Pulled By: kaiwenw
fbshipit-source-id: 6b53d25dc87a59bb8d82a68b29339c722f648349
2020-04-24 22:54:17 -07:00
d9bbcfafc2
Fix CI ( #230 )
...
Summary: Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/230
Reviewed By: kaiwenw
Differential Revision: D21025113
Pulled By: kittipatv
fbshipit-source-id: 9e7c5b514ea1c2ad72c7f6da53d71e2d8f1d5604
2020-04-14 14:53:23 -07:00
1daa98effa
Simplify CI setup ( #225 )
...
Summary:
No need to build custom docker image anymore.
- Use sdkman to install compilers for Spark app
- Use miniconda to install build deps for RASP
Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/225
Reviewed By: MisterTea
Differential Revision: D20974491
Pulled By: kittipatv
fbshipit-source-id: 680ab3f60c6c63aea5854f99242243b5f1d348bc
2020-04-10 19:44:01 -07:00
7d4a99da0e
fix CI error ( #203 )
...
Summary:
See this CI error after commit d52ac7c382https://circleci.com/gh/facebookresearch/ReAgent/304?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link
Some suggested to add `git submodule update --force --recursive --init --remote`: https://stackoverflow.com/a/56621295/1758727
Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/203
Reviewed By: MisterTea
Differential Revision: D19262142
Pulled By: czxttkl
fbshipit-source-id: 7c18ecc63944fc8969b98d4cc55ecfe251aa3095
2020-01-02 13:39:32 -08:00
fed370d1b9
Fix usage example ( #196 )
...
Summary:
Fix the usage example such that it obtains a reasonable policy.
Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/196
Test Plan:
Imported from GitHub, without a `Test Plan:` line.
Existing tests pass.
Manually ran `run_end_to_end_test.sh` and it passed.
Reviewed By: kittipatv
Differential Revision: D19078228
Pulled By: czxttkl
fbshipit-source-id: d50f4fd258583635d16b087f324cd75d18931200
2019-12-29 05:14:49 -08:00
fad30d7aff
Remove thrift and add RASP to setup.sh ( #187 )
...
Summary:
Part of addressing https://github.com/facebookresearch/ReAgent/issues/185
Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/187
Reviewed By: kittipatv
Differential Revision: D18597259
Pulled By: MisterTea
fbshipit-source-id: 57953d0ba65f5f6a327adea13c96381f365bb04c
2019-11-29 07:52:14 -08:00
0e3831df70
Update CI setup ( #180 )
...
Summary:
- We no longer need onnx & tensorflow
- Install libtorch in cpu docker image
- Initialize submodules in `run_rasp_test.sh`
Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/180
Differential Revision: D18314173
Pulled By: kittipatv
fbshipit-source-id: 72469ed466bc6e75da4c9210390636cc695ffd51
2019-11-04 22:45:16 -08:00
a2eb407b31
Fix building RASP on linux and add to CI
...
Summary: Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/179
Reviewed By: kittipatv
Differential Revision: D18187136
Pulled By: MisterTea
fbshipit-source-id: 4d3ebd116b50035a5aea42a43a8cce7f62bb399c
2019-10-29 12:33:18 -07:00
adfa6abe7c
Parallelize CI tests
...
Summary: Pull Request resolved: https://github.com/facebookresearch/ReAgent/pull/174
Reviewed By: czxttkl
Differential Revision: D17956417
fbshipit-source-id: 9ba6059fcec6b463aa96b914bded3e8cbec87b27
2019-10-17 12:24:19 -07:00
6203114ecf
Add copyright headers
...
Summary: Add copyright headers
Reviewed By: kittipatv
Differential Revision: D14543177
fbshipit-source-id: 18084c145f7b2bf5d955b2d4c8fa3ad4831330f2
2019-03-20 13:57:08 -07:00
bbea36948b
Fix Apache thrift compatibility ( #61 )
...
Summary:
Only use features available in Apache Thrift
Pull Request resolved: https://github.com/facebookresearch/Horizon/pull/61
Reviewed By: MisterTea
Differential Revision: D12960250
Pulled By: kittipatv
fbshipit-source-id: 303f526d98feb50de1b85fbb459e04b5dc991390
2018-11-07 14:17:30 -08:00
d7c6d9bf14
Use thriftpy when available
...
Summary: Pull Request resolved: https://github.com/facebookresearch/Horizon/pull/59
Reviewed By: kittipatv
Differential Revision: D12936913
Pulled By: MisterTea
fbshipit-source-id: c4e75cb53192e32edeaf7ee606620d8ab948698a
2018-11-06 17:59:24 -08:00
396ff0fb2e
Add Tensorboard Support
...
Summary: Pull Request resolved: https://github.com/facebookresearch/Horizon/pull/43
Reviewed By: kittipatv
Differential Revision: D12827211
Pulled By: econti
fbshipit-source-id: d40f00a33f989209de5679f98cdb423c5c3843af
2018-10-29 17:10:01 -07:00
33f35390de
Update setup instructions
...
Summary: Use OpenJDK everywhere & update script permission
Reviewed By: MisterTea
Differential Revision: D10467346
fbshipit-source-id: 4c2be27678e5694a1f8dfd39fd87e9e0e42b7256
2018-10-19 10:56:58 -07:00
f33f3d0cce
Get end-to-end training working
...
Summary: title
Reviewed By: MisterTea
Differential Revision: D10440251
fbshipit-source-id: 5bb237b695dad63e2ad820273e65ac65cbd19533
2018-10-18 13:43:44 -07:00
358232bd8f
Update oss info
...
Summary: Pull Request resolved: https://github.com/facebookresearch/Horizon/pull/42
Reviewed By: kittipatv
Differential Revision: D10440812
Pulled By: MisterTea
fbshipit-source-id: bb1f5960f67d6bb9c96dd118810cdb4a57666750
2018-10-17 19:31:53 -07:00
56e7fab44f
Spark changes: Write timeline in .parquet, Change feature IDs to ints. Add metrics column. ( #41 )
...
Summary:
[WIP] Spark changes: Write timeline in .parquet, Change feature IDs to ints. Add metrics column.
Pull Request resolved: https://github.com/facebookresearch/Horizon/pull/41
Reviewed By: kittipatv
Differential Revision: D10419376
Pulled By: MisterTea
fbshipit-source-id: 8062872304fcecaa1b6f105edf706265a8f3651e
2018-10-17 15:59:04 -07:00
c1a592fd03
Take number of shards as argument and update readme
...
Summary: title
Reviewed By: kittipatv
Differential Revision: D10410363
fbshipit-source-id: 1046a290ccc7c453e8d96d4c54d633537e144b8a
2018-10-16 14:42:59 -07:00
db7465d92c
Minor tweaks to scripts
...
Summary: Pull Request resolved: https://github.com/facebookresearch/Horizon/pull/38
Reviewed By: kittipatv
Differential Revision: D10403632
Pulled By: MisterTea
fbshipit-source-id: 0be0bfe01b18c261025f6ef6f4c529fe2c2e006d
2018-10-16 10:45:18 -07:00
7ab6f8b4fa
Udpate Horizon Readme
...
Summary:
title
(Note: this ignores all push blocking failures!)
Reviewed By: MisterTea
Differential Revision: D10384852
fbshipit-source-id: 503f6c22dc397854250636534da88bc4cd085f6e
2018-10-15 17:16:07 -07:00
Jason Gauci
Kai Wen Wang
Kaiwen Wang
Kittipat Virochsiri
Zhengxing Chen
Jason Gauci
Edoardo Conti