Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

cowcool

Best Strategy Backtesting Software

Recommended Posts

Many errors can occur when you back test your strategy. Postdictive error is one of them. It is vital to make sure that when you backtest a system that only information that is available in the past at that point in time is used in backtesting. With manual backtesting you can accomplish this quite easily, but with automated backtesting the postdictive error can sneak into your trading system.

 

There are more problems which trader can face during backtesting but it is hard for me to describe all of them in just a single post I will do it if needed.

No one strategy is best, no one is worst either. Its trader skill and experience, which make the worst into best and the best into worst.

Share this post


Link to post
Share on other sites

I wonder why you say avoid NeoTicker? It has a steep learning curve (some would say very steep) but it can do an awful lot of stuff Tradestation can't. The tick precise technology is particularly useful. Each to there own I guess. (Having said that I've not used it for years).

Share this post


Link to post
Share on other sites
Backtesting can be misleading:

 

For backtesting:

Avoid MT4.

Avoid Ninja.

Avoid Neoticker

Avoid Amibroker

Avoid MC .

TS - Is fine, if you know what you are doing.

 

Care to expand why to avoid everything but TS?

Share this post


Link to post
Share on other sites

TS from my experience seems to be terrible at backtesting. Only forward testing seems to provide a true picture of a system's performance, however, it's very time consuming and then when changes are needed, you have to forward test again. It's like constantly trying to hit a moving target travelling at the speed of light.

 

DaveDM

Share this post


Link to post
Share on other sites
TS from my experience seems to be terrible at backtesting. Only forward testing seems to provide a true picture of a system's performance, however, it's very time consuming and then when changes are needed, you have to forward test again. It's like constantly trying to hit a moving target travelling at the speed of light.

 

DaveDM

 

I am using TS 2000i and thought its backtesting is decent, but have not used any of the newer versions of TS. Why do you say it is terrible? Is it calculate results incorrectly, lacking features, or what? Can you provide a bit more detail what you find terrible about it?

Share this post


Link to post
Share on other sites
TS from my experience seems to be terrible at backtesting. Only forward testing seems to provide a true picture of a system's performance, however, it's very time consuming and then when changes are needed, you have to forward test again. It's like constantly trying to hit a moving target travelling at the speed of light.

DaveDM

 

 

Do you know another software that has more experience and more capabilities in backtesting than TradeStation?

 

 

LOL

Share this post


Link to post
Share on other sites

The problem here is not which software package. The issue is peoples' expectations from automation.

 

Markets continually change modes between vertical and horizontal activity. Without building something into a trading system that copes with this phenomenon, expectations will not be met as the forward testing data will most certainly be different to the backtested data on which the system was tuned.

Share this post


Link to post
Share on other sites

ts = very slow. does not take advantage of multicore.

also if it crashes say good bye to your results. no resuming.

 

i had this experience recently. i tested my start for 28 hours or so over 2 months on @ES with great results (28k for the two months). then it crashed. now i cannot get back to those results.

 

attached is the snapshot i was able to take. I was taking snapshots whenever i could but when it crashed i was at work so don t what happend after the above snapshot.

 

i tried multicharts which is able to take advantage of multicore but has a memory leak issues and also crashes eventually. they are both good for short term backtesting and/or limited inputs.

.

multicharts is highly recommended if 1. you have multicore cpu, a lot of memory, short time frame and a lot of parameters.

otherwise ts is good

 

this is just my experience and opinion good luck..

PS2.thumb.jpg.03d5bd56a7d3c78d5f27223dd4305bfb.jpg

Share this post


Link to post
Share on other sites

MultiCharts is very power in backtesting and optimization; it utilizes all the CPU cores available to the operating system.

 

Here's a screen shot of the TaskManager during one of my backtests.

 

10157d1239675263-backtesting-strategy-multicore.jpg

 

 

 

p.s. I have been using MultiCharts since 2006... never encountered memory leaks.

Share this post


Link to post
Share on other sites

Sorry for the delay in responding...

 

My problem with TradeStation are severalfold, and I admit it could be limitations on my part too, but here they are, as I see them...

 

- TS crashes and hangs a lot.

 

- Lots of data disconnects.

 

- Minor changes in system settings ie. switches, flags etc. that you setup for the way it tests or is supposed to calculate will completely throw off the results entirely and you never know if you have your system settings set properly. I'm refering to look inside back bar testing and intrabar order generation. It's quirky.

 

- It's great at coding up ideas relatively quickly and easily and getting an idea visually if things look good or not, don't get me wrong. I just think that after being in the market so long and as much experience as they have, they could make a more stable platform with better explaination of how the flags/settings affect results and how to configure for more accurate results.

 

- They could also explain simple concepts like "if your profit/loss per trade is under x number of dollars there's a good chance that the strategy won't work out".

 

- Depending on how well their data is coming through as well, I've had changes in backtesting results, this was really weird and caused major problems for me when coding.

 

Would I stop using TS? No, every product has their drawbacks. No system is perfect. It is expensive but has many good qualities, but definitely LOTS of room for improvement still after all these years.

 

Hope that makes sense.

 

BTW I think TS is great for coding indicators and such.

 

DaveDM

Share this post


Link to post
Share on other sites
Ninja Trader is good and free;)

 

 

Ninja Trader offers great support and a nice interface, however, I find that it uses a lot of resources....... the new version is supposed to reduce the use of resources.

Share this post


Link to post
Share on other sites
Does anyone know when the new NinjaTrader is due out?

 

A few months ago we talked to the management of both Ninja & Zen Fire about migrating all of our work from Trade Station to Ninja and after expending much time, effort and expense we decided no way for a lot of reasons starting with issues we had with the data and on to the immaturity of Ninja.

 

The only thing we found really attractive about Ninja was the price and we believe that it will take at least several more years before Ninja is ready for prime time users.

 

We have been using products from Bill Cruz and his brother since long before there was a Trade Station and longer than any other Trade Station customer. Of course there are issues with Trade Station and always will be but we still find it the best around and so do others:

 

tsawards.jpg

Share this post


Link to post
Share on other sites
Take a look at the videos of Investor/RT's backtesting capabilities on this page: Investor/RT - Video Library

 

From what I can see of Investor/RT is that it has long way to go and that I don't see the slightest hint of any feature that hasn't been in Trade Station for years plus I see many features in Trade Station that are not yet available in RT - Genetic Optimization routines and RT auto execution to name a couple - there are more.

 

Maybe in a few years it might catch up to where Trade Station is today but by then Trade Station wont still be where it is today.

 

Certainly, as a very long time user with over 4k indicators, functions, strategies and dll's that we have written for use in and around Easy Language we are very involved with the platform - But not so involved that we would hesitate to migrate if we thought the migration would add any significant value. Just a few months ago we took an in depth look at Ninja and found more problems than solutions for very little added value.

 

The only 2 issues we have with Trade Station are 1) the lack of granularity with their time stamp and 2) infrequent latency in the data. We have found ways around the time stamp issue and the latency issue is so small and so infrequent that it dosn't bother us.

Edited by UrmaBlume

Share this post


Link to post
Share on other sites

Genetic Optimization is available in Investor/RT (in the form of "express optimization") and auto-execution is available as well. The execution aspect is not a strength currently, but something that Linn Software is presently devoting a great deal of time to. Look for auto-execution to become a strength in the very near future (within a month or two).

 

In response to the OP, I guess it depends on what your needs are in regards to which is best. If you need execution, today, then I/RT probably is not the best for you. I think you'll find that it's much quicker/easier to code your system in Investor/RT using RTL than with "easy" language. For a taste of how easy RTL is, you can read through a tutorial I've been working on recently: RTL 101.

 

Just providing an alternative for the OP to look at.

Share this post


Link to post
Share on other sites
A few months ago we talked to the management of both Ninja & Zen Fire about migrating all of our work from Trade Station to Ninja and after expending much time, effort and expense we decided no way for a lot of reasons starting with issues we had with the data and on to the immaturity of Ninja.

 

The only thing we found really attractive about Ninja was the price and we believe that it will take at least several more years before Ninja is ready for prime time users.

 

We have been using products from Bill Cruz and his brother since long before there was a Trade Station and longer than any other Trade Station customer. Of course there are issues with Trade Station and always will be but we still find it the best around and so do others:

 

tsawards.jpg

 

The Cruz folks are also smart enough to know how to make money giving away bells and whistles for commissions to traders who can't make a dime with or without their product.

 

A much better business plan then risking capital like their customers.

Share this post


Link to post
Share on other sites
The Cruz folks are also smart enough to know how to make money giving away bells and whistles for commissions to traders who can't make a dime with or without their product.

 

A much better business plan then risking capital like their customers.

 

 

ZOSO,

 

Don't most of the customers at EVERY Brokerage lose money? Didn't they risk capital building Trade Station and their other ventures?

 

I don't understand your complaint/praise. Is it becasue they build good software, because some of their customers make money, because you can't make money using their software or just because you are feeling negative and not sure what about?

 

The Cruz brothers have built a substantial company with a very competitive platform that I, thousands of other customers, Barron's and "The Technical Analysis of Stocks and Commodities" find to be the best around. So what is it you are mad about?

 

tsawards.jpg

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • This should really be very easy, but I can't find an article or video to walk me through it. I picked 20 ticker symbols where the stocks are in a tight trading range. I got them all into one list I call "Channel". I'd like to add several indicators that apply to all, such as MACD, volume, 3 moving averages. Then I'd like to scroll through the list, adding trendlines, or horizontal lines to mark the top & bottom of the price channel for each. Then set an alarm for a breakout in each direction that indicates a breakout. Could you point me to an article or video that walks me through how to do this? ...or give me the steps? Thank you, RichardV2, Experienced stock trader back before the Internet was invented.😁
    • The Economic Proscription of U.S. Farmers by China Maybe Forever   Similar to a black eye on the face, it’s placing an indelible imprint. The retaliatory levies by China over U.S. commodity producers, such as soybeans, which seem to be forever. The moment such happens for the market it becomes irreversible.   It’s a dread numerous farmers from North Dakota to Mississippi have recognized for as far back as last year. They worry that they’ve put millions in soybean development on account of China. Since Chinese focus is now transferred towards Brazil rather, that market might be gone forever.   Once the confidence merchants have in the U.S. declines as a steady provider because of the trade dispute, the more vital its important for them to support and further broaden other avenues.   The developing danger for American agribusiness presently is that a great part of the piece of the overall industry lost throughout the year will be hard or difficult to win back at any point shortly, the Boston Consulting Group said in a detailed analysis discharged on Wednesday.   This is for the most part because of long term contracts that are regularly recorded among purchasers and sellers, contingent upon the item. The lesson from the analysis shows that U.S. farmers need to turn out to be less reliant on China, and simply trust in the best concerning those customers organizing a rebound sooner or later.   For the time being, China is going to Australia, Brazil, New Zealand, Russia, and also for its domestic producers as an option in contrast to American developed crops and animal proteins.   From the detailed analysis: “The risk that U.S. agribusinesses may for all time lose foreign market share of the overall industry isn’t only hypothetical. In past trade disputes, for example, one with China including beef, the US has not recaptured its lost share. As a result of the increase of U.S. crops and food materials more costly than other choices, high duties bring down the price to merchants who plan to expand. Also, the fewer confidence merchants have in the US as a steady provider, in perspective on the potential for future trade disputes, the more important it progresses toward becoming for them to support and further expand. After some time, merchants could loosen up complex associations with suppliers from the U.S.”   China Receives Blames for the Pressure And this is so because China is important to American farmers. China purchased $19.5 billion in U.S. agricultural items as of 2017, representing 14% of exports of farm produce, in light of BCS analysis. In July 2018, China slammed a 25% levy on U.S. agricultural items.   Exports at that point declined by an incredible 53% for the year. While exports to China have declined also for this year, over past years free fall.   There is another motivation behind why some China customers may not come back to the U.S. China is extending its very own crop acreage, particularly for soybeans. After some time, China will turn out to be progressively independent. Except if request increases generously, China will purchase its very own soybeans, regulating export development and under control in any case.   “Individuals in the business were in a condition of cheerfulness, believing that a bargain would soon be reached,” says Michael McAdoo, associate, and related executive for BCS in Montreal. “Our analysis demonstrates that regardless of whether there is a bargain, there is worry that a similar volume won’t return. They need to try different markets,” he declared.   Source: https://learn2.trade 
    • Trade Dispute Responsible for China’s Overwhelming Gold Purchase Rate   China has included more than 100 tons of gold to its stores since it continued purchasing in December, fortifying its position as one of the significant authority collectors as national banks load up on the valuable metal.   The People’s Bank of China grabbed progressively gold a month ago, raising reserves to 62.64 million ounces in September from 62.45 million in August, as per information on its site. In tonnage terms, the most recent inflow sums 5.9 tons and comes in as an expansion of about 99.8 tons over the earlier nine months.   Bullion hit the most noteworthy in over six years in September as more slow development, the trade dispute and rate reductions prodded financial specialist request. National banks have been significant purchasers as well, particularly in developing markets. Administrative demands will probably proceed as protectionist strategies and geopolitical concerns add to the request, as forecasted by Suki Cooper, the valuable metals investigator at Standard Chartered Bank.   “With the stressed partnerships with the U.S., China requires support against its enormous possessions of the dollar, and gold serves that capacity,” said Howie Lee, a financial specialist at Singapore-based Oversea-Chinese Banking Corp. “As China turns into a superpower in its very own right, I anticipate progressively gold-purchases.”   China’s High Gold Appetite The PBOC’s continuos running of bullion-purchasing has come against the difficult setting of the trade dispute with the U.S. furthermore, a stamped lull in development at home. While high-level discussions are set to continue in Washington this week, Chinese authorities are flagging they’re progressively hesitant to consent to an expansive bargain.   Spot gold spiked to as much as 0.4% to $1,511.31 an ounce on Monday and exchanged at $1,505.84 in early London exchange. While the value declined 3.2% in September, they remain high at 17% this year. The PBOC information was discharged at the end of the week. Alongside China, Russia has additionally been including generous amounts of bullion. In the initial half-year, national banks overall got 374.1 tons, supporting the overall gold request to a three-year high, the World Gold Council declared.   While a tenth straight month of amassing, shows an unfaltering purchasing trend for the PBOC, China has in the past gone for significant stretches without uncovering moves for its gold possessions. At the point the national bank declared a 57% bounce in savings to 53.3 million ounces in mid-2015, that was the first update in quite a while.   Source: https://learn2.trade   
    • GBPJPY Reverses Its Sell-Off Around the Level at 130.75  OCTOBER 9, 2019  Azeez Mustapha  No Comments   GBPJPY Price Analysis – October 9 In the prior session, the pair closed lower for the second day in a row, but currently, the GBPJPY displays a weakness further downside of the pair while retaining its wider medium-term outlook by temporal reversal on the level at 130.75.   Key Levels Resistance Levels: 148.66, 137.80, 135.774 Support Levels: 130.75, 128.68, 126.54   GBPJPY Long term Trend: Bearish In the bigger picture, the GBPJPY consolidation structure is still forming from the technical support zone on the level at 126.54 low.   A further upward move may be recorded towards the level at 146.57 and 148.66 in an extension where its resistance is glaring before completing the structure. However, the overall trend remains bearish while displaying an intact downtrend in the medium and long-term.   GBPJPY Short term Trend: Bearish On the 4-hour time frame, its price is trading narrowly between the moving average 5 and 13 close to the key technical support level at 130.44.   As it is presently, the intraday bias in GBPJPY remains on the downside at this point where a corrective rebound from the level at 126.54 low should have completed. Meanwhile, its 4-hour RSI is bearish and pointing lower suggesting further weakness.   Source: https://learn2.trade 
    • USDCHF Breaks Below Its near Term Support Zone on the Level at 0.9926 but Recovers Abruptly USDCHF Price Analysis – October 8 The FX pair breaks below the horizontal zone on the level at 0.9926 but reverses again after recovering from its early selling pressure. The USDCHF was able to find buyers again around the level at 0.9908.   Key Levels   Resistance Levels: 1.0231, 1.0126, 1.0015   Support Levels: 0.9897, 0.9870, 0.9843   USDCHF Long term Trend: Ranging The price of the pair has moved back towards the moving average of 5 and 13 areas on the level at 0.9950. This area requires to be broken to give buyers more upside potential to move higher.   However, the decisive break of the level at 1.0231 is required to indicate bullish resumption. Meanwhile, the medium and longer-term may remain neutral first.   USDCHF Short term Trend: Bearish After trending downwards to about 50 pips lower after the open, the forex pair managed to reverse during the session as bulls took control and may exit the day above its opening price.   The USDCHF’s pull back from the level at 1.0015 extends lower today but stays well above the lower horizontal zone on the level at 0.9843 support. While still in a long-term uptrend, the short trends have turned bearish already.   Source: https://learn2.trade   
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.