23:20
35d ago
→Why independent eval startups fail
The author argues independent eval startups rarely survive because eval talent earns more and has more influence in post-training or app dev. The customer pool is tiny: technical devs run their own evals, non-technical buyers want solutions, not benchmark reports. Even if a startup survives, big labs game the leaderboards, making scores unreliable. Safety evals are the exception—they need external audits and talent is less likely to defect for money.
72
SCORE
H1·K1·R1