Commit Graph

25 Commits

Author SHA1 Message Date
twitter-team 5edbbeedb3 Open-sourcing Representation Scorer
Representation Scorer (RSX) serves as a centralized scoring system, offering SimClusters or other embedding-based scoring solutions as machine learning features.
2023-04-28 14:18:16 -05:00
twitter-team 43cdcf2ed6 Open-sourcing Representation Manager
Representation Manager (RMS) serves as a centralized embedding management system, providing SimClusters or other embeddings as facade of the underlying storage or services.
2023-04-28 14:17:58 -05:00
twitter-team 197bf2c563 Open-sourcing Timelines Aggregation Framework
Open sourcing Aggregation Framework, a config-driven Summingbird based framework for generating real-time and batch aggregate features to be consumed by ML models.
2023-04-28 14:17:02 -05:00
twitter-team b5e849b029 User Signals in Candidate Sourcing Stage
Add the overview readme about how Twitter uses user signals in candidate retrieval.
2023-04-28 14:16:22 -05:00
twitter-team 31e82d6474 improvements from external prs
-fix corner case where dr converter failed when initializing

Closes twitter/the-algorithm#550
2023-04-28 10:37:15 -05:00
twitter-team 23fa75d406 [Medium][UUA] Clean up BCE in UUA
This is to clean up the BCE adapters and services in UUA since BCE no longer exists.
2023-04-28 10:29:20 -05:00
twitter-team 4df87a278e Latest navi open source refresh
latest code change including the global thread pool

Closes twitter/the-algorithm#452
Closes twitter/the-algorithm#505
2023-04-28 10:26:53 -05:00
twitter-team 6e5c875a69 [opensource] Update README to include all new modules
Since the first batch of open sourcing, we have added the following components:
- User signal service
- Unified user actions
- Topic social proof service

Update the README to include these.
2023-04-14 16:53:45 -05:00
twitter-team 617c8c787d Open-sourcing Unified User Actions
Unified User Action (UUA) is a centralized, real-time stream of user actions on Twitter, consumed by various product, ML, and marketing teams. UUA makes sure all internal teams consume the uniformed user actions data in an accurate and fast way.
2023-04-14 16:45:37 -05:00
twitter-team f1b5c32734 Open-sourcing User Signal Service
User Signal Service (USS) is a centralized online platform that supplies comprehensive data on user actions and behaviors on Twitter. This service stores information on both explicit signals, such as Favorites, Retweets, and replies, and implicit signals like Tweet clicks, profile visits, and more.
2023-04-14 16:45:37 -05:00
twitter-team 94ff4caea8 Open-sourcing Topic Social Proof Service
Topic Social Proof Service (TSPS) delivers highly relevant topics tailored to a user's interests by analyzing topic preferences, such as following or unfollowing, and employing semantic annotations and other machine learning models.
2023-04-14 16:45:36 -05:00
twitter-team 138bb51997 [cr-mixer/home-mixer] Remove `getLinearRankingParams` in EarlybirdTensorflowBasedSimilarityEngine
Remove unused ranking params which are specified by services when making an Earlybird relevance search.

For cr-mixer: since we always set useTensorflowRanking = true in EarlybirdSimilarityEngineRouter, we will only ever use the TensorFlowBasedScoringFunction for ranking search results. That function doesn't rely on any of the linear params specified in getLinearRankingParams, nor the boosts because we set applyBoosts = false in the request. These parameters are therefore strictly redundant.

The parameters in home-mixer can be removed for essentially the same reason—the parameters are redundant given that we use the Tensorflow scoring function and don't apply boosts.
2023-04-04 20:39:52 -05:00
twitter-team 3496189edb [docs] Fix broken navi link in README
Closes twitter/the-algorithm#1655
2023-04-04 20:38:43 -05:00
twitter-team 3f6974687f [VF] updates includes addressing Ukraine labels
Closes twitter/the-algorithm#1489
Closes twitter/the-algorithm#1524
Closes twitter/the-algorithm#1659
Closes twitter/the-algorithm#1520
2023-04-04 20:35:00 -05:00
twitter-team bb095608b7 [minor] Fix grammar + typo issues
Closes #557, closes #678, closes #748, closes #806, closes #818, closes #842, closes #866, closes #948, closes #1024, closes #1313, closes #1458, closes #1461, closes #1465, closes #1491, closes #1503, closes #1539, closes #1611
2023-04-04 16:13:24 -05:00
dzhao 36588c650e
Merge pull request #452 from pouriya/refactor-dr_transform
Refactor `navi/dr_transform`
2023-04-04 11:06:35 -07:00
dzhao e8147d8e5f
Update README.md 2023-04-04 09:32:40 -07:00
dzhao 9f0afc0ec4
Merge pull request #550 from MrAuro/improve-navi-docs
(docs): Improve README file for Navi
2023-04-04 09:30:11 -07:00
twitter-team d1cab28a10 [home-mixer] fix has_gte_10k_favs typo
Fixes #384, closes #242, closes #362, closes #572, closes #577, closes #650, closes #745, closes #935, closes #1076, closes #1079, closes #1105, closes #1561
2023-04-03 20:47:10 -05:00
Auro 9115361f00
(docs): Improve README file for Navi 2023-03-31 17:52:31 -07:00
Pouriya Jahanbakhsh ee5e7fc18d feat(navi/dr_transform): add filename:line to file reader error message 2023-04-01 02:33:51 +03:30
Pouriya Jahanbakhsh 2dbdfe173c ref(navi/dr_transform): fix clippy & formatting issues 2023-04-01 02:21:44 +03:30
twitter-team ec83d01dca Remove stats collection code measuring how often Tweets from specific user groups are served 2023-03-31 17:39:34 -05:00
twitter-team 64e754887b Fix simclusters README 2023-03-31 17:39:21 -05:00
twitter-team ef4c5eb65e Twitter Recommendation Algorithm
Please note we have force-pushed a new initial commit in order to remove some publicly-available Twitter user information. Note that this process may be required in the future.
2023-03-31 17:36:31 -05:00