What does the MT5 Strategy Tester do well?
The MT5 Strategy Tester does three things very well: it is free and already installed, it models at tick level with several fidelity settings, and it runs against the same terminal that will execute the strategy.
That last point is underrated. When your research environment and your execution environment are the same program, an entire class of translation errors disappears — no reimplementing indicator logic in a second language, no discovering that your platform's EMA seeds differently from your backtester's.
The genetic optimiser is genuinely capable, the visual mode is useful for spotting logic errors that no metric would reveal, and the multi-currency and multi-timeframe support has improved considerably since the MT4 days. For an EA developer working in MQL5, this is the natural home and there is no strong reason to leave it for the mechanics of running a test.
Where does the MT5 Strategy Tester mislead you?
The tester misleads mainly through its defaults and its data, not through its arithmetic — which means the results are wrong in ways the output does not flag.
Your broker supplies the history. Two traders backtesting the same EA on the same pair through different brokers can get materially different results, because the underlying bars differ. Different feeds, different aggregation, different handling of the daily rollover and of thin periods. The tester is only as good as the feed behind it, and that feed is neither standardised nor described anywhere in the report.
Modelling quality is a setting, not a guarantee. "Every tick based on real ticks" is genuinely strong when the broker has real tick history. "Every tick" without that is reconstructed from available M1 data using an interpolation rule, and wherever that M1 data is thin the reconstruction is an assumption dressed as precision.
No out-of-sample split by default. The tester optimises over the range you choose and reports the best parameters across that range. Forward-testing that result on unseen data is a separate exercise you have to remember to run, structure correctly and interpret honestly.
The optimiser is a search, and it is a fast one. Running thousands of parameter combinations and keeping the best is precisely the process that manufactures edges out of noise. MT5 hands you a powerful search and leaves the entire multiplicity problem to you, with no trial-count adjustment anywhere in the output.
Why do MT5 backtest results differ from live trading?
Backtest and live results diverge for four reasons, and in almost every case the backtest was the optimistic one.
Spread assumptions. Backtests frequently use a fixed or average spread. Live spreads widen around news, at session boundaries and at rollover — often exactly when a strategy is most active.
Slippage. Often not modelled at all. Stop orders in fast conditions fill worse than requested, and that is precisely when your strategy is exiting.
Data differences. Historical bars from the broker's archive are not always identical to the live feed that would have generated your fills.
Fitted parameters. The most common cause by a distance. If the parameters were chosen by optimising over the same period that produced the reported result, the result is a description of that period. Live trading is then the out-of-sample test, conducted with real money, which is an expensive way to run one.
How do you use MT5's tester properly?
You use it properly by imposing the discipline the tool does not impose on you, and the steps are unglamorous but short.
Split your history explicitly. Optimise on the first portion, then run the chosen parameters once on the later portion and accept whatever that produces. Once you look at the out-of-sample result and adjust, it is no longer out-of-sample — it has become a slower form of in-sample.
Record how many variants you tested, including the ones you abandoned. That number belongs in your judgement of the winner, even if no software will apply it for you.
Set costs above what you expect rather than below. Being too conservative understates a real edge, which is the safe direction to be wrong in.
Check your data before trusting anything built on it. Missing bars, weekend artefacts and gaps around holidays all produce trades that could never have existed.
Finally, vary each parameter around its chosen value and watch what happens. A real effect degrades gently. A fitted one falls off a cliff, and the cliff is the most informative chart in the whole exercise.
When is a dedicated backtester worth it?
A dedicated backtester is worth it when you want validation applied rather than remembered, or when you need data that does not change with your broker.
If your workflow already includes a disciplined train/test split, consistent history, honest costs and a correction for how many variants you tried, MT5 is entirely adequate and free. The tool is not the constraint in that case.
If it does not — and for most traders it genuinely does not — then the value of a dedicated platform is not extra features. It is that the checks happen whether or not you were thinking about them on the evening you ran the test.
The other case is instrument breadth. Testing the same idea across thirty markets to see whether it generalises is tedious in MT5 and is the fastest way to discover that an edge exists on exactly one pair, which is usually the sign that it does not exist at all.