Discussion about this post

User's avatar
Arpit's avatar

The line that agents can follow every step and still miss the mark is the most underrated point in this issue. Synthetic users have the same trap: they pass the script and miss the edge case. Since I work on it, All Things PM has a chapter on agents and evals for PMs: https://www.allthingspm.app/

Ready for more?