{"id":604630,"date":"2024-01-19T15:00:00","date_gmt":"2024-01-19T14:00:00","guid":{"rendered":"https:\/\/ftmo.com\/?p=604630"},"modified":"2024-10-15T14:36:31","modified_gmt":"2024-10-15T12:36:31","slug":"which-are-the-worst-backtesting-mistakes","status":"publish","type":"post","link":"https:\/\/ftmo.com\/en\/which-are-the-worst-backtesting-mistakes\/","title":{"rendered":"Which are the worst backtesting mistakes?"},"content":{"rendered":"
Backtesting should be an integral part of the process of creating a functional trading strategy for every trader. Although it may seem like a simple tool that anyone can master, many traders make mistakes in backtesting that lead to distorted results and subsequent losses in real trading.<\/em><\/p>\n We have written several times about backtesting<\/a>, its uses, and how you can use it to improve the inputs and outputs of your existing strategy. But today we’ll look at what you should avoid when backtesting so that your strategy doesn’t become a black hole for your funded trading account<\/a>.<\/p>\n Before you even start backtesting, you should be clear on a few basic rules. Backtesting should be done on as large a sample of data as possible, you should have a defined trading plan before the actual backtesting, and you should have clear risk management rules within the strategy that you will follow.<\/p>\n Just like a trading journal works for trading, you should keep detailed records of your results for backtesting and after the backtesting itself you should do a proper analysis to help you determine\/improve the basic parameters of the strategy such as RRR, MAE, MFE<\/a>, success rate, profit and loss streaks, maximum drawdown, etc.<\/p>\n Once you know what to do and get down to backtesting, you should avoid a few basic mistakes that are made by both novice traders and professional traders using sophisticated tools for backtesting.<\/p>\n <\/a><\/p>\n One of the basic mistakes of backtesting is using data that you might not yet have in normal trading. This is the same as using tomorrow’s prices in the real market today to make your entry decisions. This can then lead to biased results and misleading conclusions.<\/p>\n This error can occur when you unknowingly include an investment instrument in your strategy that has performed very well over a period of time (for example, a stock index before the bull market began or a currency pair that has been in a long and strong trend over a period of time). In reality, however, you would not have known at the beginning of the period that it would perform so well in the future and your strategy might not work in the real market. So you need to take this possibility into account when building your strategy<\/a>, and you can avoid it by extending the period in which you test your strategy.<\/p>\n This is a mistake you can make when you try to optimize and refine your strategy based on past data until it works as you want it to on a given sample of data. When backtesting your strategy, you can commit this error along with the previous one. At first glance, this is a logical step to improve your strategy, but in reality it is just adapting your strategy to a given sample of data.<\/p>\n The solution may be to simplify the strategy and then test it in a “basic setup” on a larger number of instruments. If you don’t want to test your strategy on different instruments, the best solution is to add a time interval in which you test the strategy. For example, if the strategy has worked in the last two years and will continue to work after extending the interval to five years or more, you have a better chance of being successful in real-world conditions.<\/p>\nConsistency pays off<\/h2>\n
Look-ahead Bias<\/h2>\n
Optimization Bias<\/h2>\n