AltCatalog
CatalogAI evaluation platforms

AI evaluation platforms

8 apps ranked by verified data. See how ranking works

Sponsored Paid slot. Never affects the ranked order below. Promote here →
01

Opik is an open-source LLM evaluation platform from Comet for tracing, evaluating, and monitoring LLM applications, with datasets, LLM-as-judge metrics, and a prompt playground.

Apache-2.0 Web
Alt Score

Alt Score · 100

How this alternative ranks. How it works →

Verified coverage 90%100
Visibility 10%100

Verified coverage = sourced yes and partial answers in the category checklist. Visibility = relative app-page views on AltCatalog over 30 days, neutral below 500 category views. Payment, votes, and vendor opinions are never score inputs.

View
02

Langfuse is an open-source LLM engineering platform providing tracing, prompt management, evaluations, datasets, and analytics for LLM applications; self-hostable or cloud.

MIT Web
Alt Score

Alt Score · 100

How this alternative ranks. How it works →

Verified coverage 90%100
Visibility 10%100

Verified coverage = sourced yes and partial answers in the category checklist. Visibility = relative app-page views on AltCatalog over 30 days, neutral below 500 category views. Payment, votes, and vendor opinions are never score inputs.

View
03

Phoenix is an open-source observability and evaluation library from Arize AI for tracing, evaluating, and troubleshooting LLM applications, built on OpenTelemetry.

Elastic License 2.0 (ELv2) Web
Alt Score

Alt Score · 96

How this alternative ranks. How it works →

Verified coverage 90%96
Visibility 10%100

Verified coverage = sourced yes and partial answers in the category checklist. Visibility = relative app-page views on AltCatalog over 30 days, neutral below 500 category views. Payment, votes, and vendor opinions are never score inputs.

View
04

Braintrust is an evaluation and observability platform for AI products, with datasets, LLM-as-judge scorers, prompt playground, and production logging.

Proprietary (platform); MIT (autoevals library) Web
Alt Score

Alt Score · 96

How this alternative ranks. How it works →

Verified coverage 90%96
Visibility 10%100

Verified coverage = sourced yes and partial answers in the category checklist. Visibility = relative app-page views on AltCatalog over 30 days, neutral below 500 category views. Payment, votes, and vendor opinions are never score inputs.

View
05

HoneyHive is an AI evaluation and observability platform for testing, tracing, and monitoring LLM applications, with datasets, LLM-as-judge evaluators, and human review.

Proprietary Web
Alt Score

Alt Score · 93

How this alternative ranks. How it works →

Verified coverage 90%92
Visibility 10%100

Verified coverage = sourced yes and partial answers in the category checklist. Visibility = relative app-page views on AltCatalog over 30 days, neutral below 500 category views. Payment, votes, and vendor opinions are never score inputs.

View
06

LangSmith is a platform for debugging, testing, evaluating, and monitoring LLM applications, with tracing, datasets, and LLM-as-judge evaluations.

Proprietary (platform); MIT (client SDK) Web
Alt Score

Alt Score · 93

How this alternative ranks. How it works →

Verified coverage 90%92
Visibility 10%100

Verified coverage = sourced yes and partial answers in the category checklist. Visibility = relative app-page views on AltCatalog over 30 days, neutral below 500 category views. Payment, votes, and vendor opinions are never score inputs.

View
07

Weave is the Weights & Biases toolkit for tracking, evaluating, and monitoring LLM applications, with tracing, scorers, and experiment comparison.

Apache-2.0 Web
Alt Score

Alt Score · 93

How this alternative ranks. How it works →

Verified coverage 90%92
Visibility 10%100

Verified coverage = sourced yes and partial answers in the category checklist. Visibility = relative app-page views on AltCatalog over 30 days, neutral below 500 category views. Payment, votes, and vendor opinions are never score inputs.

View
08

Helicone is an open-source LLM observability platform offering request logging, cost and token tracking, caching, prompt management, and evaluations via a proxy or async SDK.

Apache License 2.0 Web
Alt Score

Alt Score · 76

How this alternative ranks. How it works →

Verified coverage 90%73
Visibility 10%100

Verified coverage = sourced yes and partial answers in the category checklist. Visibility = relative app-page views on AltCatalog over 30 days, neutral below 500 category views. Payment, votes, and vendor opinions are never score inputs.

View