Summary: Returning NULL values breaks hive reader in our fblearner flows. However, empty values are required if adding terminal states to training data. This diff changes the columns values for terminal states from NULL to the corresponding empty data structure ({}, [], "", etc).
Reviewed By: MisterTea
Differential Revision: D13704487
fbshipit-source-id: 8398cb272e756f413f379f2459165a583546e8c8
Summary:
Write a new spark pipeline for supporting multi-step RL.
The test in dataswarm is in D13125518
Reviewed By: kittipatv
Differential Revision: D13049646
fbshipit-source-id: e388ca415de6c227c46439474fec5de7f6ff8220
Summary:
The evaluator has become difficult to work with. This diff does the following:
1. Creates an EvaluationDataPage similar to TrainingDataPage.
2. Separates datasets into training and evaluation. Evaluation datasets are stored in order so we do not need to un-shuffle them.
3. Assumes the evaluator can process all of the data in one shot. This assumption is now true because we don't need to store features in EvaluationDataPage and we don't need to evaluate during training.
4. Split evaluator.py into: evaluator.py, cpe.py, *_estimator.py
The diff creates some TODOs that I'll turn into tasks (likely bootcamp tasks):
1. Write tests for the estimators
Reviewed By: econti
Differential Revision: D13279810
fbshipit-source-id: fb11ac35ccfb785051f272abfcb9a549fa8fbe64
Summary: Remove reward timeline since we compute MC loss at end of epoch.
Reviewed By: kittipatv
Differential Revision: D10528238
fbshipit-source-id: 67c17a50df65ef9a37945e8f578bb884ed83df22
Jason Gauci
Edoardo Conti
Zhengxing Chen
Jason Gauci