Blog
LiteLLM alternatives: when self-hosting stops being free
LiteLLM is the best answer to a specific question: nothing leaves our infrastructure and we have the team to run it. People search for alternatives when either half stops being true. Here is the managed field, with the honest math on what free actually costs.
Skip the read: get a measured recommendation in a few quick questions. Run the Stack Finder
The main managed alternatives to LiteLLM in 2026 are Portkey ($49/month flat control plane), OpenRouter (5.5% fee on credits, 400+ models), Requesty (5% token markup, caching included), and Pareto (a blended model billed at cost). LiteLLM stays the right choice when data cannot leave your infrastructure and you have a team to run it.
What LiteLLM is genuinely best at
Full control of the data path, zero markup, one interface to every provider, and a config file you own. If your constraint is regulatory or your traffic is enormous, self-hosting is not just fine, it is correct. This page is for the other case: the team that adopted LiteLLM because it was free and is now paying for it in maintenance windows.
The managed alternatives
| Option | Fee model | What it adds over LiteLLM | What you lose |
|---|---|---|---|
| Portkey | $49/mo flat | hosted control plane, logs, guardrails, compliance | data transits their infrastructure |
| OpenRouter | 5.5% on credits | 400+ model catalog, one key, zero ops | a percentage fee that scales with spend |
| Requesty | 5% token markup | managed routing, caching included, EU residency | same percentage-scaling problem |
| Pareto | models at cost | auto-routes each request for you, with published receipts | model selection control; slower on hardest reasoning |
Fee details and the ~$900/mo crossover math in our gateway comparison, which includes the measured latency data.
The math on "free"
Price the ops honestly: provisioning, version upgrades, provider-API breakage, key rotation, and being the person paged when the gateway is the outage. At two engineer-hours a week and a loaded $120/hour, self-hosting runs about $1,000 a month before the first incident. Portkey's flat tier is $49. OpenRouter's fee on $5,000 of monthly spend is $275. The percentage options get expensive at scale; the ops option is expensive at every scale unless infrastructure is already your team's job.
That framing also says when LiteLLM wins outright: if you already run a platform team with on-call, the marginal ops cost approaches zero and nothing managed beats free-plus-control. This is why the right answer is a fork in the road, not a ranking.
The different question worth asking
Every option above, LiteLLM included, leaves model selection with you: which model for which traffic, re-evaluated every time the catalog changes. That decision, made wrong, costs more than any fee or any ops budget. Pareto is our answer to that harder problem: one endpoint that auto-routes each request to the optimal model and bills at cost, with the evidence published on the model card: all seven benchmarks matched or beaten against Opus 4.8 at 1 to 45 cents on the dollar per task.
Common questions
Is LiteLLM really free?
The software is genuinely free and open source. The total cost is operational: engineer-hours for setup, upgrades, provider breakage, and incident duty. Teams with existing platform-ops absorb that at near zero marginal cost; teams without one pay more in time than a managed gateway charges in fees.
What is the closest managed equivalent to LiteLLM?
Portkey, functionally: hosted gateway, routing, retries, logs, at a flat $49/mo Production tier rather than a percentage. Its gateway is also open source, which makes it the smoothest two-way door if you later want to self-host again.
Can I switch away from LiteLLM without a rewrite?
Almost always. LiteLLM exposes the OpenAI-compatible surface, and so does everything in the table above, so the migration is a base URL and a key. Config-level features like LiteLLM's routing rules do not travel; budget an afternoon to re-express them.
Does LiteLLM add latency?
Any hop adds something. We measured a full routing gateway at +68ms median time-to-first-token versus a direct provider call, with p95 actually lower through the gateway; a well-run LiteLLM instance sits in the same range. Details and a runnable script in our gateway comparison.
Not sure which model fits?
The Stack Finder asks a few quick questions about your workload and gives you a straight recommendation. No account required.