Mirrors/the-algorithm
2
0
Fork 0
mirror of https://github.com/twitter/the-algorithm.git synced 2024-06-02 17:28:45 +02:00
Code Issues Packages Projects Releases Wiki Activity
main
the-algorithm/src/scala/com/twitter/interaction_graph/scio/agg_negative
History
twitter-team ef4c5eb65e Twitter Recommendation Algorithm 
Please note we have force-pushed a new initial commit in order to remove some publicly-available Twitter user information. Note that this process may be required in the future.
2023-03-31 17:36:31 -05:00
..
BUILD Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00
InteractionGraphNegativeJob.scala Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00
InteractionGraphNegativeOption.scala Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00
README.md Twitter Recommendation Algorithm 2023-03-31 17:36:31 -05:00

README.md

InteractionGraphNegative Dataflow Job

IntelliJ

fastpass create --name rg_neg --intellij src/scala/com/twitter/interaction_graph/scio/agg_negative

Compile

bazel build src/scala/com/twitter/interaction_graph/scio/agg_negative:interaction_graph_negative_scio

Build Jar

bazel bundle src/scala/com/twitter/interaction_graph/scio/agg_negative:interaction_graph_negative_scio

Run Scheduled Job

export PROJECTID=twttr-recos-ml-prod
export REGION=us-central1
export JOB_NAME=interaction-graph-negative-dataflow

bin/d6w schedule \
  ${PROJECTID}/${REGION}/${JOB_NAME} \
  src/scala/com/twitter/interaction_graph/scio/agg_negative/config.d6w \
  --bind=profile.user_name=cassowary \
  --bind=profile.project=${PROJECTID} \
  --bind=profile.region=${REGION} \
  --bind=profile.job_name=${JOB_NAME} \
  --bind=profile.environment=prod \
  --bind=profile.date=2022-10-19 \
  --bind=profile.output_path=processed/interaction_graph_agg_negative_dataflow \
  --bind=profile.bq_dataset="twttr-bq-cassowary-prod:user"