Fontana provides built-in support for 20 LLM gateways, from unified routers such as OpenRouter and LLM API to direct vendor APIs, cloud-hosted foundation models on AWS Bedrock, and Custom & Self-Hosted endpoints that speak the OpenAI /v1 API (Ollama, LM Studio, vLLM, llama.cpp, LocalAI, SGLang, and similar). All calls route through one gateway abstraction with Bring Your Own Key (BYOK): you supply the API keys and endpoint settings your organisation holds, and administrators approve which gateways and models are reachable in production. Embeddings run on a single active profile you select in Admin → Models → Embeddings: in-cluster TEI or Infinity by default when those services are configured, an OpenAI-compatible gateway using your BYOK key, or Amazon Bedrock Titan using the same AWS credentials as Bedrock chat.
For retention and no-training posture on each gateway, see Zero Data Retention (ZDR).
| Icon | Gateway | Examples | Documentation |
|---|
| … | OpenRouter | 300+ models via one key | openrouter.ai/docs |
| … | LLM API | Secondary unified gateway | llmapi.ai/docs |
| … | Merge Gateway | Unified routing and failover | docs.merge.dev/merge-gateway |
| … | Requesty | AI gateway and LLM router | docs.requesty.ai |
| … | OpenAI | GPT / o-series | platform.openai.com/docs |
| … | Anthropic | Claude | docs.anthropic.com |
| … | Google | Gemini | ai.google.dev |
| … | Groq | Fast LPU inference | console.groq.com/docs |
| … | Mistral | Mistral Large / Small / Pixtral | docs.mistral.ai |
| … | NVIDIA | Nemotron and hosted LLMs (NIM) | build.nvidia.com/docs |
| … | Together AI | 200+ open models | docs.together.ai |
| … | DeepInfra | Open-source LLMs | deepinfra.com/docs |
| … | Fireworks AI | Serverless open models | docs.fireworks.ai |
| … | Baseten | Frontier open models | docs.baseten.co |
| … | Cerebras | Ultra-fast inference (Llama, Qwen, GPT-OSS, GLM) | inference-docs.cerebras.ai |
| … | xAI (Grok) | Grok chat | docs.x.ai |
| … | DeepSeek | DeepSeek-V3 chat and DeepSeek-R1 reasoning | api-docs.deepseek.com |
| … | Hugging Face | Open-weights chat via Inference Providers router | huggingface.co/docs |
| … | Custom & Self-Hosted | Local and self-hosted (Ollama, LM Studio, vLLM, llama.cpp, LocalAI, SGLang) | |
| … | AWS Bedrock | Claude, Llama, Titan, Nova on your AWS account | docs.aws.amazon.com/bedrock |
