Braintrust
Braintrust is an evaluation and observability platform for LLM applications that helps teams systematically test, score, and compare model outputs, prompts, and application versions before and after deployment. It provides tooling for building evaluation datasets, running automated scoring, and tracing production LLM…
7 resources across 1 library
Glossary Terms(7)
AgentOps
AgentOps is an observability and monitoring platform purpose-built for AI agents, providing session replays, cost tracking, and debugging tools for multi-step,…
Portkey
Portkey is an AI gateway and observability platform that sits between applications and LLM providers, offering unified API access, intelligent routing, caching…
Helicone
Helicone is an open-source observability platform for LLM applications that logs, monitors, and analyzes API requests to providers like OpenAI and Anthropic, g…
Braintrust
Braintrust is an evaluation and observability platform for LLM applications that helps teams systematically test, score, and compare model outputs, prompts, an…
Humanloop
Humanloop is an LLM development platform focused on prompt management, evaluation, and collaboration between engineers and domain experts, helping teams versio…
Arize AI
Arize AI is an ML and LLM observability platform that monitors model performance, data drift, and output quality in production, extending from traditional mach…
Galileo AI
Galileo is an AI evaluation and observability platform for generative AI and LLM applications, providing automated metrics to detect hallucinations, measure ou…