Business Insider has published a look inside METR, describing it as an "AI umpire" — a tiny lab whose job is to sit outside the big AI companies and evaluate what their models can actually do.
The headline finding, according to Business Insider, is a hiring problem: even salaries of around $500,000 aren't enough to fix a talent shortage at the organization. The piece is framed as an inside account of a small operation trying to staff up in a market where the same people it needs are being recruited elsewhere.
The story surfaced through a Google News feed tracking OpenAI, which is a signal in itself — evaluation outfits like METR are covered as part of the same beat as the frontier labs whose systems they scrutinize.
Beyond that, the available source material is a single headline and outlet attribution. It does not spell out how many roles METR is trying to fill, which specific skills are scarce, who it's losing candidates to, or how the lab is funded. Those details sit in the full Business Insider report rather than in the summary available here.
Why it matters: if the independent groups meant to referee AI systems can't hire the people needed to do that work — even at half-a-million-dollar pay — then the checks on the industry stay thinner than the industry itself.