Stop eyeballing your prompts
Changing a prompt without measuring it is guessing. Precision, recall, F1 and threshold: the four ideas that turn "looks better" into a number you can compare.
All articles
Notes taken during the work: evaluating a prompt with something other than your eyes, seeing what a model actually does, choosing what to send it, structuring an agent. What worked, what turned out expensive, and why.
7 articles
Changing a prompt without measuring it is guessing. Precision, recall, F1 and threshold: the four ideas that turn "looks better" into a number you can compare.
The context window cannot hold everything. Priority per message, token budget, extractive compression and cleanup: the pipeline that decides what stays.
Luny-AI worked, but I had no visibility between the prompt and the result. What traces, a cost per generation and a golden set would have shown me.
Reason, act, observe, loop. The pattern that powers LangChain, LangGraph and CrewAI, and why the LLM never executes the actions itself.
Graph, Node, Edge, State: four scary words that fit inside a cooking recipe. Explained through a rap battle between Molière and Robespierre.
One division between the intersection and the union of two sets. TypeScript implementation, fuzzy matching with n-grams, and the cases where it falls short.
OpenRouter and Together AI: one key to try GPT, Claude, Llama or Mistral, automatic fallback when a provider goes down, and cheaper open-source models.