Best LLM Ops tools — Observability
A curated ranking of the LLM Ops tools in the IndieBoot catalog, ordered by community traction on GitHub.
12 in catalog
Best Observability LLM Ops tools
-
LiteLLM
One interface for all LLM APIs
#1 — 58,797 GitHub stars
LLM Ops -
Langfuse
The open-source LLM engineering platform
#2 — 34,643 GitHub stars
LLM Ops -
promptfoo
Test your LLM app before you ship
#3 — 25,137 GitHub stars
LLM Ops -
DeepEval
The open-source LLM evaluation framework
#4 — 18,279 GitHub stars
LLM Ops -
Portkey
The AI gateway and guardrails
#5 — 13,000 GitHub stars
LLM Ops -
Arize Phoenix
Open-source AI observability
#6 — 11,472 GitHub stars
LLM Ops -
Helicone
LLM observability in one line
#7 — 6,158 GitHub stars
LLM Ops -
Agenta
The open-source workspace for your agents
#8 — 4,757 GitHub stars
LLM Ops -
Braintrust
Enterprise AI evaluation
#9
LLM Ops -
LangSmith
Build trustworthy AI agents
#10
LLM Ops -
Pydantic Logfire
The AI observability platform that sees your whole app
#11
LLM Ops -
W&B Weave
Observability and continuous improvement for production agents
#12
LLM Ops
Frequently asked questions
- What is the best observability LLM Ops for indie makers?
- Based on the IndieBoot catalog, LiteLLM, Langfuse, promptfoo are strong starting points among the 12 curated observability LLM Ops listings.
- How many observability LLM Ops does the IndieBoot catalog include?
- IndieBoot currently lists 12 curated observability LLM Ops entries, each with official links and context.
- How are the best observability LLM Ops ranked?
- Listings are ranked by GitHub stars (highest first) and then alphabetically, so community-backed options surface at the top.