inference-ser

Here is 1 public repository matching this topic...

Fast, Unified, Rust-Native, Axum-Compatible inference Endpoints for Burn models and LLMs

rust high-performance deep http-server production-ready burn machine-le fast-inference ml-serving inference-ser

To associate your repository with the inference-ser topic, visit your repo's landing page and select "manage topics."