The Observability Index / Online Evaluation / #108
prajeesh-chavan/OpenLLM-Monitor
by prajeesh-chavan · Online Evaluation · updated 2mo ago
OpenLLM Monitor is a plug-and-play, real-time observability dashboard for monitoring and debugging LLM API calls across OpenAI, Ollama, OpenRouter, and more. Tracks tokens, latency, cost, retries, and lets you replay prompts — fully open-source and self-hostable.
40
momentum
43
stars
8
forks
#108
rank
aillmmachine-learningmodel-evaluationmodel-monitoringmodel-performancemonitoringnlpollamaopenaiopenllmplug-and-play
View on GitHub →
More in Online Evaluation
phoenix
Arize-ai
AI Observability & Evaluation
helicone
Helicone
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and exper
ai-engineer-notebooks
calmrocks
Hands-on, framework-free Colab notebooks for the AI Engineer / Forward Deployed Engineer (
judgeval
JudgmentLabs
The Continuous-Improvement Stack for Agents. Our environment data and evals power agent im