Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

RichardCox

Backtesting As a Multi-Step Process

Recommended Posts

Technical analysis traders looking to find and implement new trading strategies will often look to backtesting as a means for assessing the general efficacy of a given method (or series of parameters). Relying solely on these results is a mistake, however, as backtesting results have only a limited ability to determine the profitability of any system when used in live markets. To be sure, backtesting can offer traders some valuable information in terms of the potential success or failure present in any trading strategy.

 

But it should be remembered that these results will often be misleading and should be thought of as just one element of the overall evaluation process. Other elements to consider can be found in forward testing and out-of-sample testing, which can help to achieve a better understanding of which markets work best with certain trading strategies. It is important to analyze these results before real money is put at risk in a trade, as this can help to avoid haphazard methods that lack depth.

 

When these three assessment methods (backtesting, forward testing, and out-of-sample testing) are conducted, good correlation is the best indication of a trading system’s viability. Here (and in part 2 to this article), we will look at some of the key elements of that correlation so that backtesting methods can be refined for live market trades.

 

Basics of Backtesting

 

At its core, backtesting is the practice of applying trading systems through historical price fluctuations in order to monitor its level of success or failure over a given time period. Technical analysis strategies can be tested relatively quickly in this fashion without risking real money. Any trading strategy can be tested, from the most basic ideas to the most complex. One example of a simple tested strategy would be to look at moving average crossovers as a basis for trading positions. More complicated tests would involve a larger number of inputs and triggers.

 

Any trading system that can be quantified is suitable for backtesting. Some computer programming ability can be helpful, especially in cases where less common trading platforms are used, or a wider variety of variables will be tested. For example, better knowledge in these areas will enable traders to change the commonly used inputs (the moving average periods themselves). Here, a trader might then be able to test a large number of moving average periods and determine which variables have the best success rates over time.

 

Strategy Optimization

 

Some of the more commonly used trading platforms will enable traders to use “optimization” features during the process. This feature allows traders to input a range of variable (such as a range of moving averages). The computer then looks at the number of successful trades for each input and will determine which period has the highest rate of profitability. Multi-variable optimization can be used for strategies with more than one input variable.

 

In the moving average example, this would mean that the trader would input a range for two moving averages and then the software would be able to identify which combination works best. For example, crossover strategies using a 100-period average and a 55-period moving average might lead to more successful trades than a 100-period moving average and a 50-period moving average.

 

The main benefit of this feature is there there will be some cases where an unprofitable strategy can undergo a few simple tweaks (or “optimizations”), and be transformed into a profitable strategy. It should be remembered, however, that this “profitability” will be in past terms. This does not necessarily mean that this same success rate will be seen in the future in live markets. Curve-fitting uses optimization analytics to identify scenarios with the largest number of successful trades and the best potential for profits.

 

Problems can arise here, however, as methods are “optimized” for the specific data set being analyzed. Since that same price history will not be seen again, many of these systems will become unreliable in the future. So, while backtests and optimization procedures can offer some interesting benefits when looking to develop and assess a trading strategy, the results should not be viewed in isolation. The next part of the process is to test the same strategy against historical price data that was not used in the original tests.

 

Using Out-of-Sample Price Data

 

Once you have a strategy you want to test, it is important to section off historical periods for the testing process. The first set of data is used to test and later optimize the original strategy. This initial data set becomes the “in-sample” data. The other time periods that have been sectioned-off (and not yet tested) now make up the “out-of-sample” data set. It is important to make these differentiations (separating the time periods) because this is the only way to test your original idea on new historical price activity.

 

Initially, your optimization process “custom-designed” its inputs based on a specific set of price action. In order for the strategy to be considered valid, it must be used successfully in new scenarios that were in no way influenced by the optimization process. While this does not remove all of the potential problems in the backtesting process, it does create a greater likelihood that your trading strategy will work in live markets if it is successful in more than one historical time period.

 

The in-sample data is the key component for testing your original strategy, finding its weak points and then optimizing the process to enhance the number of profitable trades. Since this is such a critical component of the original test, traders will usually devote a larger period of time to the in-sample data set. Once the system has been optimized, the system must then be applied to the smaller out-of-sample price data. An added benefit of this approach is that traders can compare the results between the two data sets. When similar performances are seen, there is a better chance for profitability when using the same system with a real trading account.

 

Conclusion

 

Backtesting can allow traders to find, develop, and optimize a technical analysis trading strategy based on the price activity markets have experienced in the past. While this information does have a good deal of value, it is not enough to simply take these backtesting results at face value and expect the success to continue when applied to live markets. For this reason, backtesting is always conducted using a demo account, as additional refinements will be needed before real funds are put at risk. It should also be understood that true backtesting analysis is a multistep procedure that divides price data into different (but necessary segments) In the next sections of this article, we will look at correlation and forward testing as the next key components of the process.

5aa711e516f14_images(1).jpg.adfe797011249baff15b5c3ce246eb48.jpg

Share this post


Link to post
Share on other sites
The in-sample data is the key component for testing your original strategy, finding its weak points and then optimizing the process to enhance the number of profitable trades. Since this is such a critical component of the original test, traders will usually devote a larger period of time to the in-sample data set. Once the system has been optimized, the system must then be applied to the smaller out-of-sample price data. An added benefit of this approach is that traders can compare the results between the two data sets. When similar performances are seen, there is a better chance for profitability when using the same system with a real trading account.

 

You may want to read the first part of this article. If one backtests 10 systems and finds one that performs well when applied to both in-sample and out-of-sample data chances are the result was due to data-mining.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • Date: 29th March 2024. GBPUSD Analysis: The Pound Trades Higher But For How Long? The global Stocks Markets are closed due to Easter Friday (Good Friday). The NASDAQ continued to follow the sideways trend while other indices again rose. The SNP500 reaches an all-time high, but the NASDAQ remains under pressure from Tesla, Meta and Apple. The Euro continues to trade lower against all major currencies including the US Dollar, Euro and Japanese Yen. The British Pound is the best performing currency during this morning’s Asian session. However, investors are largely fixing their attention on this afternoon’s Core PCE Price Index. GBPUSD – The Pound Trades Higher but For How Long? The GBPUSD is slightly higher than the day’s open and is primary due to the Pound’s strong performance. At the moment, the British Pound is increasing in value against all major currencies. However, the US Dollar Index is also trading 0.10% higher and for this reason there is a slight conflict here. If investors wish to avoid this conflict, the EURUSD is a better option. This is because, the Euro depreciating against the whole currency market avoiding the “tug-of-war” scenario. The GBPUSD is trading slightly lower than the 2-month’s average price and is trading at 49.10 on the RSI. For this reason, the price of the exchange is at a “neutral” level and is signalling neither a buy nor a sell. The day’s price action and future signals are possibly likely to be triggered by this afternoon’s Core PCE Price Index. Analysts expect the Core PCE Price Index to read 0.3% which is slightly lower than the previous month but will result in the annual figure remaining at 2.85%. The PCE rate is different to the inflation rate and the Fed aims for a rate between 1.5% to 2.00%. Therefore, even if the annual rate remains at 2.85%, as analysts expect, it would be too high for the Fed. If the rate increases, even if only slightly, the US Dollar can again renew bullish momentum and the stock market can come under pressure. This includes the SNP500. Investors are focused on the publication of data on the UK’s gross domestic product (GDP) for the last quarter of 2023: the quarterly figures decreased by 0.3%, and 0.2% over the past 12-months. This confirms the state of a shallow recession and the need for stimulation. The data, combined with a cooling labor market and a steady decline in inflation, increase the likelihood that the Bank of England will soon begin interest rate cuts. In the latest meeting the Bank of England representatives did not see any members vote for a hike. USA500 – The SNP500 Rises to New Highs, But Cannot Hold Onto Gains! The price of the SNP500 rises to an all-time high, before correcting 0.33% and ending the day slightly lower than the open price. Nonetheless, the index performs better than the NASDAQ which came under pressure from Tesla, Meta and Apple which hold a higher weight compared to the SNP500. For the SNP500, these 3 stocks hold a weight of 9.25%, whereas the 3 stocks make up 14.63% of the NASDAQ. The SNP500 is also supported by ExxonMobil’s gains due to higher energy prices. The market will remain closed on Friday due to Easter. However, the market will reopen on Monday for the US and investors can expect high volatility. Investors will also need to take into consideration how the PCE Price Index and the changed value of the US Dollar is likely to affect the stock market next week. Always trade with strict risk management. Your capital is the single most important aspect of your trading business. Please note that times displayed based on local time zone and are from time of writing this report. Click HERE to access the full HFM Economic calendar. Want to learn to trade and analyse the markets? Join our webinars and get analysis and trading ideas combined with better understanding on how markets work. Click HERE to register for FREE! Click HERE to READ more Market news. Michalis Efthymiou Market Analyst HFMarkets Disclaimer: This material is provided as a general marketing communication for information purposes only and does not constitute an independent investment research. Nothing in this communication contains, or should be considered as containing, an investment advice or an investment recommendation or a solicitation for the purpose of buying or selling of any financial instrument. All information provided is gathered from reputable sources and any information containing an indication of past performance is not a guarantee or reliable indicator of future performance. Users acknowledge that any investment in FX and CFDs products is characterized by a certain degree of uncertainty and that any investment of this nature involves a high level of risk for which the users are solely responsible and liable. We assume no liability for any loss arising from any investment made based on the information provided in this communication. This communication must not be reproduced or further distributed without our prior written permission.
    • MT4 is good and will be good until their parent company keep updating the software, later mt4 users will have to switch to mt5.
    • $SOUN SoundHound AI stock at 5.91 support area , see https://stockconsultant.com/?SOUN
    • $ELEV Elevation Oncology stock bull flag breakout watch , see https://stockconsultant.com/?ELEV
    • $AVDX AvidXchange stock narrow range breakout watch above 13.32 , see https://stockconsultant.com/?AVDX
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.