The sneaky part is that an AI trading strategy can look profitable in testing without actually predicting anything.
Say you ask it to build a strategy, test it on old prices, then keep tweaking until the chart looks good. You’ve effectively let it study the answer key. It may just be fitting historical noise.
A more useful test is to:
- Keep a later chunk of data completely out of development.
- Test the frozen strategy on that untouched period, using only information available at each trade.
- Include fees, bid–ask spreads and realistic execution prices.
- Compare it with a simple benchmark, not just “did it make money?”
Even passing that doesn’t guarantee future profits. But “look, the backtest goes up” is a much lower bar than it sounds. Automating the search can just help you find a convincing bad strategy faster.
Lmfao I saw someone on the train just last week asking chat gpt how they can turn a profit from all their Friday morning losses
Off of Robinhood screenshots too