text-embeddings-inference
A blazing fast inference solution for text embeddings models
About this project
Text Embeddings Inference A blazing fast inference solution for text embeddings models. Benchmark for BAAI/bge-base-en-v1.5 on an NVIDIA A10 with a sequence length of 512 tokens: Table of contents — Get Started — Supported Models — Docker — Docker Images — API Documentation — Using a private or gated model — Air gapped deployment — Using Re-rankers models — Using Sequence Classification models — Using SPLADE pooling — Distributed Tracing — gRPC — Local Install — Apple Silicon (Homebrew) — Docker Build — ARM64 / aarch64 — AMD Instinct GPUs (ROCm) — Examples Text Embeddings Inference (TEI) is a toolkit for deploying and serving open source text embeddings…
Technologies
Project health
GitHub
Reviews
Built by
Maintain huggingface/text-embeddings-inference? Claiming verifies admin access through your GitHub account and gives you control of this listing.
