LLM Financial Backtests Are Contaminated—Models Know More Than They Claim

LLM-based financial backtests are widely used to validate trading strategies, yet the most common safeguards—asking the model what it knows, trusting a stated cutoff, instructing it to answer as of a past date—all systematically fail. The corruption is invisible and widespread across frontier models.