Directory · API
LiteLLM
Unified OpenAI-compatible proxy for 100+ LLM providers — routing, fallbacks, cost tracking, and key management in one gateway.
Best for
Multi-model routing, cost control, provider fallbacks, self-hosted API gateway
Pros and cons
Pros
- One SDK for every major provider
- Built-in fallbacks and load balancing
- Cost and usage logging per key
Cons
- Another service to operate in production
- Provider quirks still leak through edge cases
- Docs dense for first-time setup
Alternatives
More api tools
Exa
API
Semantic web search API. Find niche papers, blogs, and primary sources by meaning, not just keyword.
Best for
Research agents that need to find specific kinds of content
Pros
- Semantic search beats keyword for niche queries
- Filterable by category
- Strong recall on long-tail content
Cons
- Smaller index than Google
- Pricier than basic search APIs
Alternatives
Fal
API
Fast inference platform for image, video, and audio models. Sub-second latency on diffusion workflows.
Best for
Production workflows needing fast image/video generation
Pros
- Lowest latency for diffusion models
- Wide model selection
- Good streaming support
Cons
- Newer than Replicate
- Pricier on lowest tier
Alternatives
Groq
API
LPU-accelerated inference for open-weights LLMs. Hundreds of tokens per second; the speed leader.
Best for
Real-time UIs, agentic workflows where token speed matters
Pros
- Fastest LLM inference available
- OpenAI-compatible API
- Generous free tier
Cons
- Limited model selection
- Quality depends on chosen open model
Alternatives