Best LLM Ops tools — Open source
A curated ranking of the LLM Ops tools in the IndieBoot catalog, ordered by community traction on GitHub.
9 in catalog
Best Open source LLM Ops tools
-
LiteLLM
One interface for all LLM APIs
#1 — 58,797 GitHub stars
LLM Ops -
Langfuse
The open-source LLM engineering platform
#2 — 34,643 GitHub stars
LLM Ops -
promptfoo
Test your LLM app before you ship
#3 — 25,137 GitHub stars
LLM Ops -
Opik
Open-source LLM evaluation and observability
#4 — 22,272 GitHub stars
LLM Ops -
DeepEval
The open-source LLM evaluation framework
#5 — 18,279 GitHub stars
LLM Ops -
Portkey
The AI gateway and guardrails
#6 — 13,000 GitHub stars
LLM Ops -
Arize Phoenix
Open-source AI observability
#7 — 11,472 GitHub stars
LLM Ops -
Helicone
LLM observability in one line
#8 — 6,158 GitHub stars
LLM Ops -
Agenta
The open-source workspace for your agents
#9 — 4,757 GitHub stars
LLM Ops
Frequently asked questions
- What is the best open source LLM Ops for indie makers?
- Based on the IndieBoot catalog, LiteLLM, Langfuse, promptfoo are strong starting points among the 9 curated open source LLM Ops listings.
- How many open source LLM Ops does the IndieBoot catalog include?
- IndieBoot currently lists 9 curated open source LLM Ops entries, each with official links and context.
- How are the best open source LLM Ops ranked?
- Listings are ranked by GitHub stars (highest first) and then alphabetically, so community-backed options surface at the top.