Smg

communication MCP Server

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

Verified
communicationcommunication
8 views328 stars95 forksApache-2.0

Why This Matters

Discovered via github-topic:mcp and last synced 3mo ago.

Verified
Source
github-topic:mcp
Stars
328
Last synced
3mo ago
Install
Check source

Install

Install instructions not detected yet

Check the source repository for the latest setup steps.

View source instructions
6
Tools
0
Resources
0
Prompts
Standard I/O
Transport

Available Tools (6)

Feature

Description

TensorRT-LLM

Google Gemini

Self-Hosted

Cloud Providers

vLLM

OpenAI

Ollama

AWS Bedrock

SGLang

Anthropic