This post will provide an insight into the concept of testing a trading strategy. It will also explain how you can avoid the common pitfalls of curve fitting, which can have a devastating impact on your trading account if left unchecked.
Back-Testing
Many of my students will remember me advocating the process of back-testing. This is to ensure the profitability of a trading strategy before you waste time turning it into something traded on your live account.
The process involves looking back over historical price moves and determining whether or not your trading strategy would have profited from the moves that occurred.
To conduct back-testing effectively, you must have firm rules for your strategy. These rules should include stop loss placement, a clear trade management process and exit rules which you can follow easily. By having these things decided before you start back-testing, you can clearly see the results that they generate based on historical data.
This is the best way of determining the true performance of a past strategy.
Curve Fitting
Curve fitting is a similar process to back-testing, but one that produces the opposite effect. Instead of saving time and giving a clear picture of the strategy’s true performance over the recent past, curve fitting provides false information, which is almost always positive. This causes traders to mistakenly pursue the system further, wasting time and money in the process.
So how does curve fitting do this?
The basic premise of this trap is that the trader bases the system around the past price action, rather than basing it around a familiar concept. This causes the system to be optimised based on those historical moves. Thus, it gives near perfect performance. The problem with this is that those past moves will probably never again happen in quite the same way, nor at the same time or in the same order. This is because price moves are random occurrences caused by traders and institutions reacting to individual events.
Of course, the price will always go up and down and sometimes range from side to side. However, the manner and timing of these events are all random and unique.
Therefore, you need a trading strategy that is robust and flexible enough to catch these moves, whilst allowing for the unique nature of each one as it occurs. If you over-optimize based on the past, your strategy will very quickly become redundant. And this usually happens just when you are about to take trades using real money!
Conclusion
The next time you analyse how a strategy performs on historical data, ask yourself the following question:
Does the system fit to make the results better on that data or are you simply creating a method and then testing it on random data as it plays out?
The results of the latter will almost certainly be poorer in terms of performance. But they will also be much more reliable and something you can depend on during a live market environment.
Another great tactic is to partially back-test and then partially forward-test. Manually take the trades on live price action as you would when trading it on a real account.
The results from both of these endeavors should roughly match. At this point, you will know that you have found something that works!
At no time should anyone view the information presented anywhere on this website as advice, recommendation or proven. Everything reflected is merely opinion and may not be accurate. The purpose of the site is to express the opinions and views of Jarratt Davis. There is no intention to offer specific help, advice or suggestions to anyone reading any of the content posted here.
Recommended Content
Editors’ Picks
EUR/USD stabilizes near 1.0800 as trading action turns subdued
EUR/USD holds steady near 1.0800 on Thursday and remains on track to end the day in negative territory following upbeat macroeconomic data releases from the US. The action in financial markets turn subdued as trading volumes thin out heading into Easter holiday.
GBP/USD extends sideways grind above 1.2600
GBP/USD fluctuates in a narrow channel above 1.2600 on Thursday. The better-than-expected Initial Jobless Claims data from the US and the upward revision to the Q4 GDP growth help the USD stay resilient against its rivals and limits the pair's upside.
Gold pulls away from daily highs, holds above $2,200
Gold retreats from daily highs but holds comfortably above $2,200 in the American session on Thursday. The benchmark 10-year US Treasury bond yield stays near 4.2% after upbeat US data and makes it difficult for XAU/USD to gather further bullish momentum.
XRP price falls to $0.60 support as Ripple ruling doesn’t help Coinbase lawsuit against SEC
XRP programmatic sales ruling by Judge Torres was completely rejected by another US Court that ruled in favor of the SEC in a lawsuit against Coinbase.
Portfolio rebalancing and reflation trades emerge into Q2
Yesterday’s price action pointed at a possible end-of-quarter portfolio rebalancing as the session saw the laggards of the quarter like Apple and Tesla gain, and the stars like Microsoft and Nvidia retreat.