Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

cowcool

Best Strategy Backtesting Software

Recommended Posts

Many errors can occur when you back test your strategy. Postdictive error is one of them. It is vital to make sure that when you backtest a system that only information that is available in the past at that point in time is used in backtesting. With manual backtesting you can accomplish this quite easily, but with automated backtesting the postdictive error can sneak into your trading system.

 

There are more problems which trader can face during backtesting but it is hard for me to describe all of them in just a single post I will do it if needed.

No one strategy is best, no one is worst either. Its trader skill and experience, which make the worst into best and the best into worst.

Share this post


Link to post
Share on other sites

I wonder why you say avoid NeoTicker? It has a steep learning curve (some would say very steep) but it can do an awful lot of stuff Tradestation can't. The tick precise technology is particularly useful. Each to there own I guess. (Having said that I've not used it for years).

Share this post


Link to post
Share on other sites
Backtesting can be misleading:

 

For backtesting:

Avoid MT4.

Avoid Ninja.

Avoid Neoticker

Avoid Amibroker

Avoid MC .

TS - Is fine, if you know what you are doing.

 

Care to expand why to avoid everything but TS?

Share this post


Link to post
Share on other sites

TS from my experience seems to be terrible at backtesting. Only forward testing seems to provide a true picture of a system's performance, however, it's very time consuming and then when changes are needed, you have to forward test again. It's like constantly trying to hit a moving target travelling at the speed of light.

 

DaveDM

Share this post


Link to post
Share on other sites
TS from my experience seems to be terrible at backtesting. Only forward testing seems to provide a true picture of a system's performance, however, it's very time consuming and then when changes are needed, you have to forward test again. It's like constantly trying to hit a moving target travelling at the speed of light.

 

DaveDM

 

I am using TS 2000i and thought its backtesting is decent, but have not used any of the newer versions of TS. Why do you say it is terrible? Is it calculate results incorrectly, lacking features, or what? Can you provide a bit more detail what you find terrible about it?

Share this post


Link to post
Share on other sites
TS from my experience seems to be terrible at backtesting. Only forward testing seems to provide a true picture of a system's performance, however, it's very time consuming and then when changes are needed, you have to forward test again. It's like constantly trying to hit a moving target travelling at the speed of light.

DaveDM

 

 

Do you know another software that has more experience and more capabilities in backtesting than TradeStation?

 

 

LOL

Share this post


Link to post
Share on other sites

The problem here is not which software package. The issue is peoples' expectations from automation.

 

Markets continually change modes between vertical and horizontal activity. Without building something into a trading system that copes with this phenomenon, expectations will not be met as the forward testing data will most certainly be different to the backtested data on which the system was tuned.

Share this post


Link to post
Share on other sites

ts = very slow. does not take advantage of multicore.

also if it crashes say good bye to your results. no resuming.

 

i had this experience recently. i tested my start for 28 hours or so over 2 months on @ES with great results (28k for the two months). then it crashed. now i cannot get back to those results.

 

attached is the snapshot i was able to take. I was taking snapshots whenever i could but when it crashed i was at work so don t what happend after the above snapshot.

 

i tried multicharts which is able to take advantage of multicore but has a memory leak issues and also crashes eventually. they are both good for short term backtesting and/or limited inputs.

.

multicharts is highly recommended if 1. you have multicore cpu, a lot of memory, short time frame and a lot of parameters.

otherwise ts is good

 

this is just my experience and opinion good luck..

PS2.thumb.jpg.03d5bd56a7d3c78d5f27223dd4305bfb.jpg

Share this post


Link to post
Share on other sites

MultiCharts is very power in backtesting and optimization; it utilizes all the CPU cores available to the operating system.

 

Here's a screen shot of the TaskManager during one of my backtests.

 

10157d1239675263-backtesting-strategy-multicore.jpg

 

 

 

p.s. I have been using MultiCharts since 2006... never encountered memory leaks.

Share this post


Link to post
Share on other sites

Sorry for the delay in responding...

 

My problem with TradeStation are severalfold, and I admit it could be limitations on my part too, but here they are, as I see them...

 

- TS crashes and hangs a lot.

 

- Lots of data disconnects.

 

- Minor changes in system settings ie. switches, flags etc. that you setup for the way it tests or is supposed to calculate will completely throw off the results entirely and you never know if you have your system settings set properly. I'm refering to look inside back bar testing and intrabar order generation. It's quirky.

 

- It's great at coding up ideas relatively quickly and easily and getting an idea visually if things look good or not, don't get me wrong. I just think that after being in the market so long and as much experience as they have, they could make a more stable platform with better explaination of how the flags/settings affect results and how to configure for more accurate results.

 

- They could also explain simple concepts like "if your profit/loss per trade is under x number of dollars there's a good chance that the strategy won't work out".

 

- Depending on how well their data is coming through as well, I've had changes in backtesting results, this was really weird and caused major problems for me when coding.

 

Would I stop using TS? No, every product has their drawbacks. No system is perfect. It is expensive but has many good qualities, but definitely LOTS of room for improvement still after all these years.

 

Hope that makes sense.

 

BTW I think TS is great for coding indicators and such.

 

DaveDM

Share this post


Link to post
Share on other sites
Ninja Trader is good and free;)

 

 

Ninja Trader offers great support and a nice interface, however, I find that it uses a lot of resources....... the new version is supposed to reduce the use of resources.

Share this post


Link to post
Share on other sites
Does anyone know when the new NinjaTrader is due out?

 

A few months ago we talked to the management of both Ninja & Zen Fire about migrating all of our work from Trade Station to Ninja and after expending much time, effort and expense we decided no way for a lot of reasons starting with issues we had with the data and on to the immaturity of Ninja.

 

The only thing we found really attractive about Ninja was the price and we believe that it will take at least several more years before Ninja is ready for prime time users.

 

We have been using products from Bill Cruz and his brother since long before there was a Trade Station and longer than any other Trade Station customer. Of course there are issues with Trade Station and always will be but we still find it the best around and so do others:

 

tsawards.jpg

Share this post


Link to post
Share on other sites
Take a look at the videos of Investor/RT's backtesting capabilities on this page: Investor/RT - Video Library

 

From what I can see of Investor/RT is that it has long way to go and that I don't see the slightest hint of any feature that hasn't been in Trade Station for years plus I see many features in Trade Station that are not yet available in RT - Genetic Optimization routines and RT auto execution to name a couple - there are more.

 

Maybe in a few years it might catch up to where Trade Station is today but by then Trade Station wont still be where it is today.

 

Certainly, as a very long time user with over 4k indicators, functions, strategies and dll's that we have written for use in and around Easy Language we are very involved with the platform - But not so involved that we would hesitate to migrate if we thought the migration would add any significant value. Just a few months ago we took an in depth look at Ninja and found more problems than solutions for very little added value.

 

The only 2 issues we have with Trade Station are 1) the lack of granularity with their time stamp and 2) infrequent latency in the data. We have found ways around the time stamp issue and the latency issue is so small and so infrequent that it dosn't bother us.

Edited by UrmaBlume

Share this post


Link to post
Share on other sites

Genetic Optimization is available in Investor/RT (in the form of "express optimization") and auto-execution is available as well. The execution aspect is not a strength currently, but something that Linn Software is presently devoting a great deal of time to. Look for auto-execution to become a strength in the very near future (within a month or two).

 

In response to the OP, I guess it depends on what your needs are in regards to which is best. If you need execution, today, then I/RT probably is not the best for you. I think you'll find that it's much quicker/easier to code your system in Investor/RT using RTL than with "easy" language. For a taste of how easy RTL is, you can read through a tutorial I've been working on recently: RTL 101.

 

Just providing an alternative for the OP to look at.

Share this post


Link to post
Share on other sites
A few months ago we talked to the management of both Ninja & Zen Fire about migrating all of our work from Trade Station to Ninja and after expending much time, effort and expense we decided no way for a lot of reasons starting with issues we had with the data and on to the immaturity of Ninja.

 

The only thing we found really attractive about Ninja was the price and we believe that it will take at least several more years before Ninja is ready for prime time users.

 

We have been using products from Bill Cruz and his brother since long before there was a Trade Station and longer than any other Trade Station customer. Of course there are issues with Trade Station and always will be but we still find it the best around and so do others:

 

tsawards.jpg

 

The Cruz folks are also smart enough to know how to make money giving away bells and whistles for commissions to traders who can't make a dime with or without their product.

 

A much better business plan then risking capital like their customers.

Share this post


Link to post
Share on other sites
The Cruz folks are also smart enough to know how to make money giving away bells and whistles for commissions to traders who can't make a dime with or without their product.

 

A much better business plan then risking capital like their customers.

 

 

ZOSO,

 

Don't most of the customers at EVERY Brokerage lose money? Didn't they risk capital building Trade Station and their other ventures?

 

I don't understand your complaint/praise. Is it becasue they build good software, because some of their customers make money, because you can't make money using their software or just because you are feeling negative and not sure what about?

 

The Cruz brothers have built a substantial company with a very competitive platform that I, thousands of other customers, Barron's and "The Technical Analysis of Stocks and Commodities" find to be the best around. So what is it you are mad about?

 

tsawards.jpg

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • Date: 17th April 2024. Market News – Appetite for risk-taking remains weak. Economic Indicators & Central Banks:   Stocks, Treasury yields and US Dollar stay firmed. Fed Chair Powell added to the recent sell off. His slightly more hawkish tone further priced out chances for any imminent action and the timing of a cut was pushed out further. He suggested if higher inflation does persist, the Fed will hold rates steady “for as long as needed.” Implied Fed Fund: There remains no real chance for a move on May 1 and at their intraday highs the June implied funds rate future showed only 5 bps, while July reflected only 10 bps. And a full 25 bps was not priced in until November, with 38 bps in cuts seen for 2024. US & EU Economies Diverging: Lagarde says ECB is moving toward rate cuts – if there are no major shocks. UK March CPI inflation falls less than expected. Output price inflation has started to nudge higher, despite another decline in input prices. Together with yesterday’s higher than expected wage numbers, the data will add to the arguments of the hawks at the BoE, which remain very reluctant to contemplate rate cuts. Canada CPI rose 0.6% in March, double the 0.3% February increase BUT core eased. The doors are still open for a possible cut at the next BoC meeting on June 5. IMF revised up its global growth forecast for 2024 with inflation easing, in its new World Economic Outlook. This is consistent with a global soft landing, according to the report. Financial Markets Performance:   USDJPY also inched up to 154.67 on expectations the BoJ will remain accommodative and as the market challenges a perceived 155 red line for MoF intervention. USOIL prices slipped -0.15% to $84.20 per barrel. Gold rose 0.24% to $2389.11 per ounce, a new record closing high as geopolitical risks overshadowed the impacts of rising rates and the stronger dollar. Market Trends:   Wall Street waffled either side of unchanged on the day amid dimming rate cut potential, rising yields, and earnings. The major indexes closed mixed with the Dow up 0.17%, while the S&P500 and NASDAQ lost -0.21% and -0.12%, respectively. Asian stock markets mostly corrected again, with Japanese bourses underperforming and the Nikkei down -1.3%. Mainland China bourses were a notable exception and the CSI 300 rallied 1.4%, but the MSCI Asia Pacific index came close to erasing the gains for this year. Always trade with strict risk management. Your capital is the single most important aspect of your trading business. Please note that times displayed based on local time zone and are from time of writing this report. Click HERE to access the full HFM Economic calendar. Want to learn to trade and analyse the markets? Join our webinars and get analysis and trading ideas combined with better understanding on how markets work. Click HERE to register for FREE! Click HERE to READ more Market news. Andria Pichidi Market Analyst HFMarkets Disclaimer: This material is provided as a general marketing communication for information purposes only and does not constitute an independent investment research. Nothing in this communication contains, or should be considered as containing, an investment advice or an investment recommendation or a solicitation for the purpose of buying or selling of any financial instrument. All information provided is gathered from reputable sources and any information containing an indication of past performance is not a guarantee or reliable indicator of future performance. Users acknowledge that any investment in FX and CFDs products is characterized by a certain degree of uncertainty and that any investment of this nature involves a high level of risk for which the users are solely responsible and liable. We assume no liability for any loss arising from any investment made based on the information provided in this communication. This communication must not be reproduced or further distributed without our prior written permission.vvvvvvv
    • Date: 16th April 2024. Market News – Stocks and currencies sell off; USD up. Economic Indicators & Central Banks:   Stocks and currencies sell off, while the US Dollar picks up haven flows. Treasuries yields spiked again to fresh 2024 peaks before paring losses into the close, post, the stronger than expected retail sales eliciting a broad sell off in the markets. Rates surged as the data pushed rate cut bets further into the future with July now less than a 50-50 chance. Wall Street finished with steep declines led by tech. Stocks opened in the green on a relief trade after Israel repulsed the well advertised attack from Iran on Sunday. But equities turned sharply lower and extended last week’s declines amid the rise in yields. Investor concerns were intensified as Israel threatened retaliation. There’s growing anxiety over earnings even after a big beat from Goldman Sachs. UK labor market data was mixed, as the ILO unemployment rate unexpectedly lifted, while wage growth came in higher than anticipated – The data suggests that the labor market is catching up with the recession. Mixed messages then for the BoE. China grew by 5.3% in Q1 however the numbers are causing a lot of doubts over sustainability of this growth. The bounce came in the first 2 months of the year. In March, growth in retail sales slumped and industrial output decelerated below forecasts, suggesting challenges on the horizon. Today: Germany ZEW, US housing starts & industrial production, Fed Vice Chair Philip Jefferson speech, BOE Bailey speech & IMF outlook. Earnings releases: Morgan Stanley and Bank of America. Financial Markets Performance:   The US Dollar rallied to 106.19 after testing 106.25, gaining against JPY and rising to 154.23, despite intervention risk. Yen traders started to see the 160 mark as the next Resistance level. Gold surged 1.76% to $2386 per ounce amid geopolitical risks and Chinese buying, even as the USD firmed and yields climbed. USOIL is flat at $85 per barrel. Market Trends:   Breaks of key technical levels exacerbated the sell off. Tech was the big loser with the NASDAQ plunging -1.79% to 15,885 while the S&P500 dropped -1.20% to 5061, with the Dow sliding -0.65% to 37,735. The S&P had the biggest 2-day sell off since March 2023. Nikkei and ASX lost -1.9% and -1.8% respectively, and the Hang Seng is down -2.1%. European bourses are down more than -1% and US futures are also in the red. CTA selling tsunami: “Just a few points lower CTAs will for the first time this year start selling in size, to add insult to injury, we are breaking major trend-lines in equities and the gamma stabilizer is totally gone.” Short term CTA threshold levels are kicking in big time according to GS. Medium term is 4873 (most important) while the long term level is at 4605. Always trade with strict risk management. Your capital is the single most important aspect of your trading business. Please note that times displayed based on local time zone and are from time of writing this report. Click HERE to access the full HFM Economic calendar. Want to learn to trade and analyse the markets? Join our webinars and get analysis and trading ideas combined with better understanding on how markets work. Click HERE to register for FREE! Click HERE to READ more Market news. Andria Pichidi Market Analyst HFMarkets Disclaimer: This material is provided as a general marketing communication for information purposes only and does not constitute an independent investment research. Nothing in this communication contains, or should be considered as containing, an investment advice or an investment recommendation or a solicitation for the purpose of buying or selling of any financial instrument. All information provided is gathered from reputable sources and any information containing an indication of past performance is not a guarantee or reliable indicator of future performance. Users acknowledge that any investment in FX and CFDs products is characterized by a certain degree of uncertainty and that any investment of this nature involves a high level of risk for which the users are solely responsible and liable. We assume no liability for any loss arising from any investment made based on the information provided in this communication. This communication must not be reproduced or further distributed without our prior written permission.
    • Date: 15th April 2024. Market News – Negative Reversion; Safe Havens Rally. Trading Leveraged Products is risky Economic Indicators & Central Banks:   Markets weigh risk of retaliation cycle in Middle East. Initially the retaliatory strike from Iran on Israel fostered a haven bid, into bonds, gold and other haven assets, as it threatens a wider regional conflict. However, this morning, Oil and Asian equity markets were muted as traders shrugged off fears of a war escalation in the Middle East. Iran said “the matter can be deemed concluded”, and President Joe Biden has called on Israel to exercise restraint following Iran’s drone and missile strike, as part of Washington’s efforts to ease tensions in the Middle East and minimize the likelihood of a widespread regional conflict. New US and UK sanctions banned deliveries of Russian supplies, i.e. key industrial metals, produced after midnight on Friday. Aluminum jumped 9.4%, nickel rose 8.8%, suggesting brokers are bracing for major supply chain disruption. Financial Markets Performance:   The USDIndex fell back from highs over 106 to currently 105.70. The Yen dip against USD to 153.85. USOIL settled lower at 84.50 per barrel and Gold is trading below session highs at currently $2357.92 per ounce. Copper, more liquid and driven by the global economy over recent weeks, was more subdued this morning. Currently at $4.3180. Market Trends:   Asian stock markets traded mixed, but European and US futures are slightly higher after a tough session on Friday and yields have picked up. Mainland China bourses outperformed overnight, after Beijing offered renewed regulatory support. The PBOC meanwhile left the 1-year MLF rate unchanged, while once again draining funds from the system. Nikkei slipped 1% to 39,114.19. On Friday, NASDAQ slumped -1.62% to 16,175, unwinding most of Thursday’s 1.68% jump to a new all-time high at 16,442. The S&P500 fell -1.46% and the Dow dropped 1.24%. Declines were broadbased with all 11 sectors of the S&P finishing in the red. JPMorgan Chase sank 6.5% despite reporting stronger profit in Q1. The nation’s largest bank gave a forecast for a key source of income this year that fell below Wall Street’s estimate, calling for only modest growth. Apple shipments drop by 10% in Q1. Always trade with strict risk management. Your capital is the single most important aspect of your trading business. Please note that times displayed based on local time zone and are from time of writing this report. Click HERE to access the full HFM Economic calendar. Want to learn to trade and analyse the markets? Join our webinars and get analysis and trading ideas combined with better understanding on how markets work. Click HERE to register for FREE! Click HERE to READ more Market news. Andria Pichidi Market Analyst HFMarkets Disclaimer: This material is provided as a general marketing communication for information purposes only and does not constitute an independent investment research. Nothing in this communication contains, or should be considered as containing, an investment advice or an investment recommendation or a solicitation for the purpose of buying or selling of any financial instrument. All information provided is gathered from reputable sources and any information containing an indication of past performance is not a guarantee or reliable indicator of future performance. Users acknowledge that any investment in FX and CFDs products is characterized by a certain degree of uncertainty and that any investment of this nature involves a high level of risk for which the users are solely responsible and liable. We assume no liability for any loss arising from any investment made based on the information provided in this communication. This communication must not be reproduced or further distributed without our prior written permission.
    • The morning of my last post I happened to glance over to the side and saw “...angst over the FOMC’s rate trajectory triggered a flight to safety, hence boosting the haven demand. “   http://www.traderslaboratory.com/forums/topic/21621-hfmarkets-hfmcom-market-analysis-services/page/17/?tab=comments#comment-228522   I reacted, but didn’t take time to  respond then... will now --- HFBlogNews, I don’t know if you are simply aggregating the chosen narratives for the day or if it’s your own reporting... either way - “flight to safety”????  haven ?????  Re: “safety  - ”Those ‘solid rocks’ are getting so fragile a hit from a dandelion blowball might shatter them... like now nobody wants to buy longer term new issues at these rates...yet the financial media still follows the scripts... The imagery they pound day in and day out makes it look like the Fed knows what they’re doing to help ‘us’... They do know what they’re doing - but it certainly is not to help ‘us’... and it is not to ‘control’ inflation... And at some point in the not too distant future, the interest due will eat a huge portion of the ‘revenue’ Re: “haven” The defaults are coming ...  The US will not be the first to default... but it will certainly not be the very last to default !! ...Enough casual anti-white racism for the day  ... just sayin’
    • Date: 12th April 2024. Producer Inflation On The Rise, But Will Earnings Hold Demand Steady?     Producer inflation rose slightly less than previous expectations, but the annual figure continues to rise. The annual PPI rose to 2.1% and the Core PPI rose to 2.4%. The NASDAQ and SNP500 end the day higher, but the Dow Jones continues to struggle. This morning earnings kick off with the banking sector including JP Morgan, BlackRock and Wells Fargo. All 3 stocks trade higher during pre-trading hours. The Euro trades lower against all currencies despite the ECB’s attempt to establish a hawkish tone. USA100 – The NASDAQ Climbs Higher, But Is the Growth Sustainable? The NASDAQ was the only index which did not witness a significant decline at the opening of the US session. In addition to this, the USA100 is the only index which is witnessing indications of a bullish market. The price has crossed onto a higher high breaking the resistance level at $18,269. The index is also trading above the 75-Bar EMA and at the 65.00 level on the RSI which signals buyers are controlling the market. However, a similar large bullish impulse wave was also formed on the 3rd and 5th of the month and was followed by a correction. Therefore, investors need to be cautious of a bearish breakout which may signal a correction back to the 75-bar EMA (18,165). The medium-term growth and its sustainability will depend on the upcoming earnings data.   Bond yields declined during this morning’s Asian session by 18 points, which is positive for the stock market. However, even with the decline, bond yields remain significantly higher than Monday’s opening yield. This week the 10-year bond yield rose from 4.424 to 4.558, which is a concern. If bond yields again start to rise, the stock market potentially can again become pressured. 25% of the NASDAQ ended the day lower and 75% higher. This gives a clear indication of the sentiment towards the technology sector and reassures traders about the price movement. Another positive was all of the top 12 influential stocks rose in value. Apple, NVIDIA and Broadcom saw the strongest gains, all rising more than 4%. Producer inflation read slightly lower than expectations, however, the index continues to rise. The Producer Price Index rose from 1.6% to 2.1% and the Core PPI from 2.1% to 2.4%. Therefore, it is not indicating inflation will become easier to tackle in the upcoming months. For this reason, investors should note that inflation and the monetary policy is still a risk and can trigger strong bearish impulse waves. EURUSD – The Euro Declines Against Major Currencies The European Central Bank is attempting to concentrate on the positive factors and give no indications of when the committee may opt to cut rates. For example, President Lagarde advises “sales figures” remain stable, but the issue remains they are stably low. Officials said the decline in prices generally confirms medium-term forecasts and is ensured by a decrease in the cost of food and goods. Most experts continue to believe that the first reduction in interest rates will happen in June, and there may be three or four in total during the year. Due to this, the Euro is declining against all currencies including the Pound, Yen and Swiss Franc. The US Dollar Index on the other hand trades 0.39% higher and is almost trading at a 23-week high. Due to this momentum, the price of the exchange continues to indicate a decline in favor of the US Dollar.   Always trade with strict risk management. Your capital is the single most important aspect of your trading business. Please note that times displayed based on local time zone and are from time of writing this report. Click HERE to access the full HFM Economic calendar. Want to learn to trade and analyse the markets? Join our webinars and get analysis and trading ideas combined with better understanding on how markets work. Click HERE to register for FREE! Click HERE to READ more Market news. Michalis Efthymiou Market Analyst HMarkets Disclaimer: This material is provided as a general marketing communication for information purposes only and does not constitute an independent investment research. Nothing in this communication contains, or should be considered as containing, an investment advice or an investment recommendation or a solicitation for the purpose of buying or selling of any financial instrument. All information provided is gathered from reputable sources and any information containing an indication of past performance is not a guarantee or reliable indicator of future performance. Users acknowledge that any investment in FX and CFDs products is characterized by a certain degree of uncertainty and that any investment of this nature involves a high level of risk for which the users are solely responsible and liable. We assume no liability for any loss arising from any investment made based on the information provided in this communication. This communication must not be reproduced or further distributed without our prior written permission.
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.