AI Lab Hiring Benchmark Integrity Specialist; Running the Benchmarks Listed as Nice to Have

SAN FRANCISCO—Frontier AI developer Metacortex Intelligence is seeking a Senior Benchmark Integrity Specialist to join its Evaluations team at a base salary of $175,000 to $240,000, according to a job listing reviewed by The Artifice.

The role requires "deep familiarity with major ML benchmarks," "exceptional attention to detail under deadline pressure," and "the ability to manage cross-functional relationships in the weeks preceding a product launch."

Responsibilities include maintaining a comprehensive library of standard evaluation tasks, coordinating with the pre-training team to flag benchmark items "whose downstream inclusion may affect score interpretability," and preparing benchmark result summaries "for audiences who do not require technical context."

Under a section labeled "Nice to Have," the listing includes: "Experience running the benchmarks themselves."

Compensation includes full benefits, equity, and a performance bonus "tied to quarter-over-quarter improvement on key capability metrics."

The listing was removed from LinkedIn four hours after publication and replaced with a posting for a "Model Capabilities Communicator."

"We're looking for someone who is genuinely passionate about measurement," said Metacortex's head of talent in an AI-generated recruiting video that remained live. "Someone who understands that how you score matters just as much as what you score."

"I thought it was a job about catching cheating," said one applicant who withdrew her candidacy after a first-round interview. "It was not a job about catching cheating."