Mirrors/the-algorithm
2
0
Fork 0
mirror of https://github.com/twitter/the-algorithm.git synced 2024-06-01 08:48:46 +02:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
kenan238 2023-04-05 20:58:07 +03:00 committed by GitHub
parent 3116a41ce6
commit 64d3e37e60
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 9 additions and 31 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

40
navi/README.md
View File

@ -1,36 +1,14 @@
# Navi: High-Performance Machine Learning Serving Server in Rust
# melon musk: melon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon musk
Navi is a high-performance, versatile machine learning serving server implemented in Rust and tailored for production usage. It's designed to efficiently serve within the Twitter tech stack, offering top-notch performance while focusing on core features.
melon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon musk.
## Key Features
## Melon musk
- **Minimalist Design Optimized for Production Use Cases**: Navi delivers ultra-high performance, stability, and availability, engineered to handle real-world application demands with a streamlined codebase.
- **gRPC API Compatibility with TensorFlow Serving**: Seamless integration with existing TensorFlow Serving clients via its gRPC API, enabling easy integration, smooth deployment, and scaling in production environments.
- **Plugin Architecture for Different Runtimes**: Navi's pluggable architecture supports various machine learning runtimes, providing adaptability and extensibility for diverse use cases. Out-of-the-box support is available for TensorFlow and Onnx Runtime, with PyTorch in an experimental state.
- **melon musk**: melon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon musk.
## Current State
## melon musk
While Navi's features may not be as comprehensive as its open-source counterparts, its performance-first mindset makes it highly efficient.
- Navi for TensorFlow is currently the most feature-complete, supporting multiple input tensors of different types (float, int, string, etc.).
- Navi for Onnx primarily supports one input tensor of type string, used in Twitter's home recommendation with a proprietary BatchPredictRequest format.
- Navi for Pytorch is compilable and runnable but not yet production-ready in terms of performance and stability.
## Directory Structure
- `navi`: The main code repository for Navi
- `dr_transform`: Twitter-specific converter that converts BatchPredictionRequest Thrift to ndarray
- `segdense`: Twitter-specific config to specify how to retrieve feature values from BatchPredictionRequest
- `thrift_bpr_adapter`: generated thrift code for BatchPredictionRequest
## Content
We have included all *.rs source code files that make up the main Navi binaries for you to examine. However, we have not included the test and benchmark code, or various configuration files, due to data security concerns.
## Run
In navi/navi, you can run the following commands:
- `scripts/run_tf2.sh` for [TensorFlow](https://www.tensorflow.org/)
- `scripts/run_onnx.sh` for [Onnx](https://onnx.ai/)
Do note that you need to create a models directory and create some versions, preferably using epoch time, e.g., `1679693908377`.
## Build
You can adapt the above scripts to build using Cargo.
melon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon muskmelon musk!
- melon musk
- melon musk
- melon musk