Writing

2 posts · tagged models · oldest Mar 2025

Agent Flywheel1 post · 2026watch demo

2026·10·09Closer than the spread is a tieA benchmark is an evaluation with three promises: frozen, shared, comparable. Sixty evaluations of three agents on four models ran in 21 minutes for 5.39 USD, and the top five variants were a tie. What has to be frozen, how many runs one variant needs, and why a benchmark must never pay twice for the same measurement.agentsevaluationmodels11 min

OpenOperator1 post · 2025github watch demo

2025·03·07We tried every vision model we could get our hands onMagma, Llama 3.2 Vision, Gemma 3, Phi-4, GPT-4o, Claude — including feeding a screen recording instead of stills. What actually moved the needle was not the model.aiagentsmodels5 min