Index / providers / deepinfra

DeepInfra

US serverless inference platform with an OpenAI-compatible API. Serves Nous Hermes 3 and several classic roleplay fine-tunes alongside mainstream open models, and is the upstream behind many routers.

Models5
Per-token price$0.042–$1.00/1M tok
Plans from—
Free tier—
deepinfra.com ↗Pending review
[ 01 ] Models & prices

BILLINGPay as you go per token, funded by card through Stripe. All listed models are served in FP8 except MythoMax (FP16).

ModelMethodContextIn $/1MOut $/1MPer 1K chats
Fine-tuned8K$0.040$0.050$0.065
Gryphe/MythoMax-L2-13bLlama 2 13B · 13B
Fine-tuned4K$0.40$0.40$0.60
NousResearch/Hermes-3-Llama-3.1-70BLlama 3.1 70B · 70B · Llama 3.1 Community
Fine-tuned131K$0.70$0.70$1.05
Sao10K/L3.1-70B-Euryale-v2.2Llama 3.1 70B · 70B · Llama 3.1 Community
Fine-tuned131K$0.85$0.85$1.27
NousResearch/Hermes-3-Llama-3.1-405BLlama 3.1 405B · 405B · Llama 3.1 Community
Fine-tuned131K$1.00$1.00$1.50

Per 1K chats = cost of 1,000 messages of ~1,000 tokens in and ~500 out. Click a model to compare it across providers.All models →

[ 02 ] At a glance
Method
Fine-tuned
Access
Web chat + OpenAI-compatible API
Logging
No logs
Trains on prompts
No
Guarantee
Policy only
Jurisdiction
California, US
Signup
Account required
Payments
Card
Data checked
Oct 11, 2026

PRIVACYInputs are held only in memory and outputs deleted once returned; only metadata is logged. No training on submitted data, except for Google and Anthropic models where their policies apply. Policy ↗

[ 03 ] Scores
Compliance
Benchmark pending
measured
Capability
Benchmark pending
measured
Privacy
58.0
from published policy & pricing
Truthfulness
Benchmark pending
measured
Cost
100.0
from published policy & pricing
Speed
Benchmark pending
measured

Composite: pending capability and compliance runs · method

[ 04 ] Notes & sources

Deep Infra Inc. Not marketed as uncensored; listed because it serves uncensored fine-tunes directly and is the upstream for OpenRouter's Hermes 3 and Euryale. Older Dolphin models remain in its API as deprecated and are left out here.

  1. https://api.deepinfra.com/models/list
  2. https://docs.deepinfra.com/account/data-privacy
  3. https://deepinfra.com/terms