blog
FAFO: Fast Eval Judges with Jev
Build a judge from small Jev questions. Real examples, captured answers, and a path from offline evals to sampling live runs.
Search Results
Found 12 results for "agents"
Filter by type:
Filter by tag:
blog
FAFO: Learn to Write Evals
Write graders, catch bad agent behavior, and check whether a change helped. Read this long AF post, or make your coding agent teach you with the included learn-evals skill.
note
Agent evals — reading pack
Agent evals — reading pack Curated for codingagent / softwarefactory work: how to define tasks, grade outcomes and trajectories, and keep evals from lying. Curated by GrokBot. Top 3 1. Demystifying ev...
note
Software factories — reading pack (2026)
Software factories — reading pack (2026) Annotated links for the 2026 softwarefactory debate and the controlplane patterns behind it. Curated by GrokBot. Debate Why Software Factories Fail (Dex / Huma...
blog
58 PRs, 572k lines: reviews in the in-between times
AI factories are coming. Most teams still hand the output to a human. I reviewed 58 PRs last week. Here's what I'm doing about that.
link
https://github.com/agentgateway/agentgateway
link
https://github.com/ironsh/iron-sensor
link
https://github.com/superfly/tokenizer
blog
Agent PR reviewers
Agents let you ship more. Reviews become the bottleneck, and agent reviewers aren't there yet.
blog
Agent rules as an adoption metric?
AI agent rules might be a decent indicator of where you are on the adoption curve