From Vibe to Verifier: How I Built an AI Evals Manager in a Weekend