Habr AI→ original

Why Neural Networks Fail to Predict Moscow Exchange Markets—and Where ML Actually Helps Traders

Neural networks rarely deliver reliable price predictions in trading: noisy markets, latency, commissions, and nonstationarity quickly break even…

AI-processed from Habr AI; edited by Hamidun News
Why Neural Networks Fail to Predict Moscow Exchange Markets—and Where ML Actually Helps Traders
Source: Habr AI. Collage: Hamidun News.
◐ Listen to article

At a meeting on machine learning in trading in Moscow, a sobering thesis was presented: neural networks are almost useless as a tool for direct price forecasting. However, ML really helps with narrower tasks — determining market mode, filtering out bad trades, and reducing execution slippage.

The Illusion of Price Forecasting

The market is still home to a popular fantasy: just show a model a chart of Sber or an index, and it will output the exact price for tomorrow. In practice, this falls apart very quickly. Price is too noisy, the market constantly changes, and any pattern found in historical data often disappears the moment the strategy goes live with real money. In high-frequency trading, the situation is even tougher: nanoseconds matter, and a heavy model can simply kill the system with latency.

"ML does not provide control over the market and is not a magic button

for 'money'."

That's why experienced market participants view machine learning not as a generator of ready-made signals, but as a supporting layer above the base strategy. Even if the model guesses the direction of movement more often than random, that's not enough. Between a beautiful forecast and money lies the order queue, slippage, broker and exchange commissions. As a result, a formally strong model can show losses where backtesting looked almost perfect.

Where ML Works

The most sensible thought from the discussion is simple: machine learning brings value where the task is narrow and verifiable. Instead of trying to predict the market itself, the model helps break it down into components: what mode it's in, which signals to skip, and where costs will eat into potential profits. This approach is much closer to the real practice of a solo algo trader, who cannot afford hedge fund infrastructure.

  • Market phase determination: trend, sideways, volatility spike
  • Signal filtering: which base strategy trades to skip
  • Execution optimization: how to enter a position with less slippage
  • Order book microstructure analysis: pattern search in order flow

For a retail trader, this is especially important because they often combine all roles at once: finding data, cleaning it, engineering features, building the model, testing hypotheses, calculating risks, and then deploying the result to production themselves. In this configuration, ML is useful not as a showcase with loud promises, but as a tool for specific narrow improvements — for example, turning off a trend strategy in a tight sideways market or avoiding a trade with poor expected execution.

Why Strategies Die

Most problems start not in the model, but earlier — at the data and hypothesis testing stage. If a day is missing in the candles, futures are merged with errors, or features accidentally contain information from the future, the algorithm instantly finds a non-existent pattern. On historical data it looks like the Holy Grail, but in live trading it ends very quickly. Hence the main principle: garbage in, garbage out. Data quality and experimental honesty matter more here than choosing between trendy libraries and architectures.

From the discussion emerges a useful filter of five questions that should be run before writing code: is there a specific task, is there honest data, can the idea be tested accounting for commissions and delays, does the forecast translate into real action, and does it produce economic value. If there's no confident answer to even one question, ML is being deployed too early. Otherwise, you get the typical trap: there's a forecast, but no profit after all the costs.

What This Means

For the market, this is a good signal of sobriety. Neural networks do not replace a trading system and do not eliminate risk, but they do help make targeted improvements to processes where humans are already hitting the limits of data volume or reaction speed. Another important conclusion — the market lacks experience sharing: as long as individuals repeat the same mistakes separately, ML remains not a profit accelerator, but an accelerator of expensive experiments.

ZK
Hamidun News
AI news without noise. Daily editorial selection from 400+ sources. A product by Zhemal Khamidun, Head of AI at Alpina Digital.

Want to stop reading about AI and start using it?

AI News is a curated feed of AI/tech news. Hamidun Academy teaches you to use AI systematically in your work.

What do you think?
Loading comments…