Mirrors/the-algorithm
2
0
Fork 0
mirror of https://github.com/twitter/the-algorithm.git synced 2024-06-02 17:28:45 +02:00
Code Issues Packages Projects Releases Wiki Activity
main
the-algorithm/src/scala/com/twitter/interaction_graph/scio/agg_notifications
History
twitter-team ef4c5eb65e Twitter Recommendation Algorithm 
Please note we have force-pushed a new initial commit in order to remove some publicly-available Twitter user information. Note that this process may be required in the future.
2023-03-31 17:36:31 -05:00
..
BUILD Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00
InteractionGraphNotificationsJob.scala Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00
InteractionGraphNotificationsOption.scala Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00
InteractionGraphNotificationUtil.scala Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00
README.md Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00

README.md

InteractionGraphClientEventLogs Dataflow Job

IntelliJ

fastpass create --name rg_labels --intellij src/scala/com/twitter/interaction_graph/scio/agg_notifications

Compile

bazel build src/scala/com/twitter/interaction_graph/scio/agg_notifications:interaction_graph_notifications_scio

Build Jar

bazel bundle src/scala/com/twitter/interaction_graph/scio/agg_notifications:interaction_graph_notifications_scio

Run Scheduled Job

export PROJECTID=twttr-recos-ml-prod
export REGION=us-central1
export JOB_NAME=interaction-graph-notifications-dataflow

bin/d6w schedule \
  ${PROJECTID}/${REGION}/${JOB_NAME} \
  src/scala/com/twitter/interaction_graph/scio/agg_notifications/config.d6w \
  --bind=profile.user_name=cassowary \
  --bind=profile.project=${PROJECTID} \
  --bind=profile.region=${REGION} \
  --bind=profile.job_name=${JOB_NAME} \
  --bind=profile.environment=prod \
  --bind=profile.date=2022-05-10 \
  --bind=profile.output_path=processed/interaction_graph_agg_notifications_dataflow