Open Source LLM Observability & Evaluation using Upstash Redis
A curated collection of the best open source tracing, monitoring, and evaluation platforms for LLM and AI-agent applications. using Upstash Redis.
LLM observability: cost, latency, and traces in one place
Stars
12Last commit
2 days agoLicense
MIT
Drop-in observability platform for OpenAI, Anthropic, and Gemini that logs every request, tracks costs, traces agent workflows, and flags anomalies and PII.
Open Source Alternative to:
Trace, evaluate, and protect every LLM call in one SDK
Stars
7Last commit
12 hours agoLicense
AGPL-3.0
An AI gateway that sits on the request path to handle PII redaction, prompt injection blocking, tracing, evals, and cost tracking for OpenAI, Anthropic, and Gemini.
Open Source Alternative to:
Capture – Capture screenshots, generate PDFs, scrape content, extract metadata, and automate browsers with one API.
Capture