The Observability Index / Online Evaluation / #20
calmrocks/ai-engineer-notebooks
by calmrocks · Online Evaluation · updated 14d ago
Hands-on, framework-free Colab notebooks for the AI Engineer / Forward Deployed Engineer (FDE) skill set — model APIs, structured output, tool calling, RAG, evals-as-the-spine, agents (loop from scratch, tool design, guardrails, MCP, Skills), fine-tuning vs LoRA, prompt-injection/security, LLMOps, and customer craft. Runs on the free Groq API.
73
momentum
620
stars
42
forks
#20
rank
agentsai-engineerai-engineeringcolabevalsfine-tuningforward-deployed-engineergenerative-aigroqjupyter-notebookllmllm-as-judge
View on GitHub →
More in Online Evaluation
phoenix
Arize-ai
AI Observability & Evaluation
helicone
Helicone
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and exper
judgeval
JudgmentLabs
The Continuous-Improvement Stack for Agents. Our environment data and evals power agent im
applied-ai-field-guide
davidahmann
The Applied AI and FDE Guide: fieldwork, value engineering, and operations for agents that