197bf2c563
Open sourcing Aggregation Framework, a config-driven Summingbird based framework for generating real-time and batch aggregate features to be consumed by ML models. |
||
|---|---|---|
| .. | ||
| real_time | ||
| BCELabelTransformFromUUADataRecord.scala | ||
| BUILD | ||
| FeatureSelectorConfig.scala | ||
| README.md | ||
| RecapUserFeatureAggregation.scala | ||
| RectweetUserFeatureAggregation.scala | ||
| TimelinesAggregationConfig.scala | ||
| TimelinesAggregationConfigDetails.scala | ||
| TimelinesAggregationConfigTrait.scala | ||
| TimelinesAggregationKeyValInjections.scala | ||
| TimelinesAggregationSources.scala | ||
README.md
Timelines Aggregation Jobs
This directory contains the specific definition of aggregate jobs that generate features used by the Heavy Ranker.
The primary files of interest are TimelinesAggregationConfigDetails.scala, which contains the defintion for the batch aggregate jobs and real_time/TimelinesOnlineAggregationConfigBase.scala which contains the definitions for the real time aggregate jobs.
The aggregation framework that these jobs are based on is here.