mirror of
https://github.com/twitter/the-algorithm.git
synced 2024-06-02 09:18:49 +02:00
197bf2c563
Open sourcing Aggregation Framework, a config-driven Summingbird based framework for generating real-time and batch aggregate features to be consumed by ML models.
653 B
653 B
Timelines Aggregation Jobs
This directory contains the specific definition of aggregate jobs that generate features used by the Heavy Ranker.
The primary files of interest are TimelinesAggregationConfigDetails.scala
, which contains the defintion for the batch aggregate jobs and real_time/TimelinesOnlineAggregationConfigBase.scala
which contains the definitions for the real time aggregate jobs.
The aggregation framework that these jobs are based on is here.