Best LLM Ops tools
A curated ranking of the LLM Ops tools in the IndieBoot catalog, ordered by community traction on GitHub.
14 in catalog
Top LLM Ops tools
-
LiteLLM
One interface for all LLM APIs
#1 — 58,797 GitHub stars
LLM Ops -
Langfuse
The open-source LLM engineering platform
#2 — 34,643 GitHub stars
LLM Ops -
promptfoo
Test your LLM app before you ship
#3 — 25,137 GitHub stars
LLM Ops -
Opik
Open-source LLM evaluation and observability
#4 — 22,272 GitHub stars
LLM Ops -
DeepEval
The open-source LLM evaluation framework
#5 — 18,279 GitHub stars
LLM Ops -
Portkey
The AI gateway and guardrails
#6 — 13,000 GitHub stars
LLM Ops -
Arize Phoenix
Open-source AI observability
#7 — 11,472 GitHub stars
LLM Ops -
Weights & Biases
The AI developer platform
#8 — 11,264 GitHub stars
LLM Ops -
Helicone
LLM observability in one line
#9 — 6,158 GitHub stars
LLM Ops -
Agenta
The open-source workspace for your agents
#10 — 4,757 GitHub stars
LLM Ops -
Braintrust
Enterprise AI evaluation
#11
LLM Ops -
LangSmith
Build trustworthy AI agents
#12
LLM Ops -
Pydantic Logfire
The AI observability platform that sees your whole app
#13
LLM Ops -
W&B Weave
Observability and continuous improvement for production agents
#14
LLM Ops
Frequently asked questions
- What is the best LLM Ops for indie makers?
- Based on the IndieBoot catalog, LiteLLM, Langfuse, promptfoo are strong starting points among the 14 curated LLM Ops listings.
- How many LLM Ops does the IndieBoot catalog include?
- IndieBoot currently lists 14 curated LLM Ops entries, each with official links and context.
- How are the best LLM Ops ranked?
- Listings are ranked by GitHub stars (highest first) and then alphabetically, so community-backed options surface at the top.