Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

cowcool

Best Strategy Backtesting Software

Recommended Posts

Many errors can occur when you back test your strategy. Postdictive error is one of them. It is vital to make sure that when you backtest a system that only information that is available in the past at that point in time is used in backtesting. With manual backtesting you can accomplish this quite easily, but with automated backtesting the postdictive error can sneak into your trading system.

 

There are more problems which trader can face during backtesting but it is hard for me to describe all of them in just a single post I will do it if needed.

No one strategy is best, no one is worst either. Its trader skill and experience, which make the worst into best and the best into worst.

Share this post


Link to post
Share on other sites

I wonder why you say avoid NeoTicker? It has a steep learning curve (some would say very steep) but it can do an awful lot of stuff Tradestation can't. The tick precise technology is particularly useful. Each to there own I guess. (Having said that I've not used it for years).

Share this post


Link to post
Share on other sites
Backtesting can be misleading:

 

For backtesting:

Avoid MT4.

Avoid Ninja.

Avoid Neoticker

Avoid Amibroker

Avoid MC .

TS - Is fine, if you know what you are doing.

 

Care to expand why to avoid everything but TS?

Share this post


Link to post
Share on other sites

TS from my experience seems to be terrible at backtesting. Only forward testing seems to provide a true picture of a system's performance, however, it's very time consuming and then when changes are needed, you have to forward test again. It's like constantly trying to hit a moving target travelling at the speed of light.

 

DaveDM

Share this post


Link to post
Share on other sites
TS from my experience seems to be terrible at backtesting. Only forward testing seems to provide a true picture of a system's performance, however, it's very time consuming and then when changes are needed, you have to forward test again. It's like constantly trying to hit a moving target travelling at the speed of light.

 

DaveDM

 

I am using TS 2000i and thought its backtesting is decent, but have not used any of the newer versions of TS. Why do you say it is terrible? Is it calculate results incorrectly, lacking features, or what? Can you provide a bit more detail what you find terrible about it?

Share this post


Link to post
Share on other sites
TS from my experience seems to be terrible at backtesting. Only forward testing seems to provide a true picture of a system's performance, however, it's very time consuming and then when changes are needed, you have to forward test again. It's like constantly trying to hit a moving target travelling at the speed of light.

DaveDM

 

 

Do you know another software that has more experience and more capabilities in backtesting than TradeStation?

 

 

LOL

Share this post


Link to post
Share on other sites

The problem here is not which software package. The issue is peoples' expectations from automation.

 

Markets continually change modes between vertical and horizontal activity. Without building something into a trading system that copes with this phenomenon, expectations will not be met as the forward testing data will most certainly be different to the backtested data on which the system was tuned.

Share this post


Link to post
Share on other sites

ts = very slow. does not take advantage of multicore.

also if it crashes say good bye to your results. no resuming.

 

i had this experience recently. i tested my start for 28 hours or so over 2 months on @ES with great results (28k for the two months). then it crashed. now i cannot get back to those results.

 

attached is the snapshot i was able to take. I was taking snapshots whenever i could but when it crashed i was at work so don t what happend after the above snapshot.

 

i tried multicharts which is able to take advantage of multicore but has a memory leak issues and also crashes eventually. they are both good for short term backtesting and/or limited inputs.

.

multicharts is highly recommended if 1. you have multicore cpu, a lot of memory, short time frame and a lot of parameters.

otherwise ts is good

 

this is just my experience and opinion good luck..

PS2.thumb.jpg.03d5bd56a7d3c78d5f27223dd4305bfb.jpg

Share this post


Link to post
Share on other sites

MultiCharts is very power in backtesting and optimization; it utilizes all the CPU cores available to the operating system.

 

Here's a screen shot of the TaskManager during one of my backtests.

 

10157d1239675263-backtesting-strategy-multicore.jpg

 

 

 

p.s. I have been using MultiCharts since 2006... never encountered memory leaks.

Share this post


Link to post
Share on other sites

Sorry for the delay in responding...

 

My problem with TradeStation are severalfold, and I admit it could be limitations on my part too, but here they are, as I see them...

 

- TS crashes and hangs a lot.

 

- Lots of data disconnects.

 

- Minor changes in system settings ie. switches, flags etc. that you setup for the way it tests or is supposed to calculate will completely throw off the results entirely and you never know if you have your system settings set properly. I'm refering to look inside back bar testing and intrabar order generation. It's quirky.

 

- It's great at coding up ideas relatively quickly and easily and getting an idea visually if things look good or not, don't get me wrong. I just think that after being in the market so long and as much experience as they have, they could make a more stable platform with better explaination of how the flags/settings affect results and how to configure for more accurate results.

 

- They could also explain simple concepts like "if your profit/loss per trade is under x number of dollars there's a good chance that the strategy won't work out".

 

- Depending on how well their data is coming through as well, I've had changes in backtesting results, this was really weird and caused major problems for me when coding.

 

Would I stop using TS? No, every product has their drawbacks. No system is perfect. It is expensive but has many good qualities, but definitely LOTS of room for improvement still after all these years.

 

Hope that makes sense.

 

BTW I think TS is great for coding indicators and such.

 

DaveDM

Share this post


Link to post
Share on other sites
Ninja Trader is good and free;)

 

 

Ninja Trader offers great support and a nice interface, however, I find that it uses a lot of resources....... the new version is supposed to reduce the use of resources.

Share this post


Link to post
Share on other sites
Does anyone know when the new NinjaTrader is due out?

 

A few months ago we talked to the management of both Ninja & Zen Fire about migrating all of our work from Trade Station to Ninja and after expending much time, effort and expense we decided no way for a lot of reasons starting with issues we had with the data and on to the immaturity of Ninja.

 

The only thing we found really attractive about Ninja was the price and we believe that it will take at least several more years before Ninja is ready for prime time users.

 

We have been using products from Bill Cruz and his brother since long before there was a Trade Station and longer than any other Trade Station customer. Of course there are issues with Trade Station and always will be but we still find it the best around and so do others:

 

tsawards.jpg

Share this post


Link to post
Share on other sites
Take a look at the videos of Investor/RT's backtesting capabilities on this page: Investor/RT - Video Library

 

From what I can see of Investor/RT is that it has long way to go and that I don't see the slightest hint of any feature that hasn't been in Trade Station for years plus I see many features in Trade Station that are not yet available in RT - Genetic Optimization routines and RT auto execution to name a couple - there are more.

 

Maybe in a few years it might catch up to where Trade Station is today but by then Trade Station wont still be where it is today.

 

Certainly, as a very long time user with over 4k indicators, functions, strategies and dll's that we have written for use in and around Easy Language we are very involved with the platform - But not so involved that we would hesitate to migrate if we thought the migration would add any significant value. Just a few months ago we took an in depth look at Ninja and found more problems than solutions for very little added value.

 

The only 2 issues we have with Trade Station are 1) the lack of granularity with their time stamp and 2) infrequent latency in the data. We have found ways around the time stamp issue and the latency issue is so small and so infrequent that it dosn't bother us.

Edited by UrmaBlume

Share this post


Link to post
Share on other sites

Genetic Optimization is available in Investor/RT (in the form of "express optimization") and auto-execution is available as well. The execution aspect is not a strength currently, but something that Linn Software is presently devoting a great deal of time to. Look for auto-execution to become a strength in the very near future (within a month or two).

 

In response to the OP, I guess it depends on what your needs are in regards to which is best. If you need execution, today, then I/RT probably is not the best for you. I think you'll find that it's much quicker/easier to code your system in Investor/RT using RTL than with "easy" language. For a taste of how easy RTL is, you can read through a tutorial I've been working on recently: RTL 101.

 

Just providing an alternative for the OP to look at.

Share this post


Link to post
Share on other sites
A few months ago we talked to the management of both Ninja & Zen Fire about migrating all of our work from Trade Station to Ninja and after expending much time, effort and expense we decided no way for a lot of reasons starting with issues we had with the data and on to the immaturity of Ninja.

 

The only thing we found really attractive about Ninja was the price and we believe that it will take at least several more years before Ninja is ready for prime time users.

 

We have been using products from Bill Cruz and his brother since long before there was a Trade Station and longer than any other Trade Station customer. Of course there are issues with Trade Station and always will be but we still find it the best around and so do others:

 

tsawards.jpg

 

The Cruz folks are also smart enough to know how to make money giving away bells and whistles for commissions to traders who can't make a dime with or without their product.

 

A much better business plan then risking capital like their customers.

Share this post


Link to post
Share on other sites
The Cruz folks are also smart enough to know how to make money giving away bells and whistles for commissions to traders who can't make a dime with or without their product.

 

A much better business plan then risking capital like their customers.

 

 

ZOSO,

 

Don't most of the customers at EVERY Brokerage lose money? Didn't they risk capital building Trade Station and their other ventures?

 

I don't understand your complaint/praise. Is it becasue they build good software, because some of their customers make money, because you can't make money using their software or just because you are feeling negative and not sure what about?

 

The Cruz brothers have built a substantial company with a very competitive platform that I, thousands of other customers, Barron's and "The Technical Analysis of Stocks and Commodities" find to be the best around. So what is it you are mad about?

 

tsawards.jpg

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • FUCK OFF and die in a ditch you communist drunken pig   https://www.rt.com/news/471252-juncker-emotional-council-goodbye/
    • Brexit Aftermath: The Market Reaction Of Bitcoin, Gold And Pound Sterling To Headline News In The EURO Zone   After the UK made it public to exit from the EURO bloc, the market cap for Bitcoin and Gold has increased almost by $133 billion and $1 trillion. Is this the Brexit aftermath?   As it is, the end may be near for Brexit. In the recent declaration an accord is reached between the British government and the EU, everyone is on the lookout for the final date Brexit will conclude. And based on this scenario, an analysis is drawn on the aftermath of this separation in the politics of the EURO bloc and the effect on the price of Bitcoin, Gold and pound sterling.   Bitcoin: Since the start of Brexit, Bitcoin’s market cap had spiked higher and recovered about $10 billion worth. Before Brexit, the cryptocurrency of the first choice had been stable in price after crashing to a market cap of about $2.9 billion low around January 2015. However, after the crash, the cryptocurrency had spiked to about 300% within 18 months while the next super halving of the project is expected on the network from 25 to 12.5 fresh Bitcoin’s per 10 minutes.   As of mid-2016, the most liquid GBP market was the London based Coinfloor exchange. The exchange did around 772 Bitcoins’ worth of volume that day, valued back then at around $4.9 million, with data from the technical back end at the Trading view.   The Pound Sterling: The British national currency had crashed by almost 20% on the night of the vote after hitting a momentary high of about $1.5 versus the USD for about 8 months. Since crashing to a low of about $1.2 as at March 2017, the Pound sterling had rallied 6% within a 4-week time frame, after the UK parliament decided to vote and activate the Article 50 while then the Brexit journey began for the UK taking it two years to discuss its planned exit from the EURO bloc.     Gold: The safe-haven asset also spiked higher around the same time frame from mid-March to mid-April 2017 with its price rising about 7% versus the USD. Nevertheless, this scenario didn’t play out on Bitcoin as in March 2017, beginning with its price at $1000, Bitcoin had surged to hit an all-time value of about $1300, as a result of markets expectation for a Bitcoin ETF being endorsed. However, after its nullification was declared on 10th March 2017, the cryptocurrency fell to a low of about $888 which occurred concurrently with the UK’s law passage for its exit from EURO bloc. Ever since then as the UK’s Brexit discussions with the EU raged on, so did the Pound against the US-dollar and Bitcoin gained more to its price.   Bitcoin, Gold, and Pound Sterling Reactions to Brexit During this timeframe transversing Brexit discussion and its process, the Pound lost the majority of its 15% gains recovered, to tumble from a high of $1.43 to hit $1.20 on 3 September. In a similar multi-day timeframe, gold broke out of its basic $1400 resistance level to rally 15% versus the US-dollar. While Bitcoin gained higher, then again, stayed on the level around $8,000—yet the genuine story of those 17 months incorporates the cryptocurrency crashing towards $3,000 (December 2018) preceding the move spiking to a high of almost $14,000 in June this year.   Source: https://learn2.trade     
    • Despite Running To The Highest Close In Six Months, GBPUSD May Fail To Reverse   GBPUSD Price Analysis – October 20 The GBPUSD had closed on Friday above its opening price after recovering from early selling pressure and trending higher for the 4th day consecutively in a row. After failing to reverse from its highs, the FX pair is unstable and due to weekend UK parliament vote on Brexit, with this scenario, the pair is likely to gap while it reopens on Monday morning in Asia (Sunday evening in the US).   Key Levels Resistance Levels: 1.3301, 1.3185, 1.2988   Support Levels: 1.2582, 1.2204, 1.1958   GBPUSD Long term Trend: Bullish On the daily picture, the bulls took charge in the previous session and exited the day above its opening price, however, the pair failed to move past the prior’s day’s trading range and the price likewise failed to reverse below the previous day’s range.   The GBPUSD had rallied upwards to as high as the level at 1.2988 last week, before forming a temporary top there. In the case of a reverse, the fall may be contained by the level at 1.2582 resistance turned support to bring rise resumption.     GBPUSD Short term Trend: Bullish An impermanent top is structured on the level at 1.2988 and intraday bias in GBPUSD stays on the upside. A few consolidations may be seen. Be that as it may, any pullback ought to be contained above the level at 1.2582 support to bring rise resumption.   Meanwhile, on the upside, a break of the level at 1.2988 will stretch out the recovery from the level at 1.1958 to 1.2582 from 1.2204 at 1.3185 next. Without bias analysis, the outlook is bullish and displaying an intact uptrend in the short and long-term.   Source: https://learn2.trade 
    • Date : 21st October 2019. MACRO EVENTS & NEWS OF 21st October 2019.The week ahead will definitely not be a quite one, with high anxiety on Brexit, the last ECB policy meeting before Mario draghi hand over the ECB presidency to Christine Lagarde and few significant US data prior FED on October 30.Monday – 21 October 2019   Producer Price Index (EUR, GMT 06:00) – The German PPI is expected to drop to -0.2% for September. As expected readings would result in a y/y loss of 0.3% for headline PPI, versus a 0.3% pace for August. Tuesday – 22 October 2019   Retail Sales (CAD, GMT 12:30) – Canadian sales are expected to have increased by 0.6% m/m in August compared to 0.4% m/m in July, with the ex-autos component down -0.3%. Existing Home Sales (USD, GMT 14:00) – Home sales have regained their status as an important indicator after the financial crisis and can have a strong effect on the markets. The release is expected to record a slight -0.2% pull-back in September to a 5.480 mln pace, after a bounce to 5.490 mln in August. In Q2, we saw an average sales pace of 5.287 mln, and we expect a better 5.463 mln pace in Q3. Thursday – 24 October 2019   Services and Manufacturing PMI (EUR, GMT 08:30-09:00) – September PMIs showed a marked contraction in manufacturing activity and a sharp slowdown in services sector growth. This picture is likely to be seen again in the preliminary readings for October, as German Manufacturing PMI has been forecast at 40 and composite at 49.2, which it is still below neutral. Meanwhile, Services PMI is expected to fall to 51.2. The overall Markit for Eurozone is seen at 49.4, signalling stagnation and highlighting the risk that the weakness in manufacturing sectors is spreading. Interest Rate Decision, Monetary Policy Statement and Press Conference (EUR, GMT 11:45 & 12:30) – The ECB is widely expected to keep policy settings on hold after Draghi’s parting shot at the last meeting. The outgoing president pushed through another deposit rate cut and an open ended asset purchase program against the opposition of some of the more senior national central bank heads and incoming president Lagarde will face the task of uniting the board and dealing with growing demands for a comprehensive revision of the ECB’s policy setting framework and in particular the inflation target. Draghi’s last press conference meanwhile will likely focus heavily on calls for fiscal measures to boost the economy in a challenging international environment. Durable Goods (USD, GMT 12:30) – Durable goods orders are expected to fall -1.8% in September, after gains of 0.2% in August, thanks to an expected transportation orders drop. Boeing orders rose to a still-lean 25 from 18 in August. Services and Manufacturing PMI (USD, GMT 13:45) – Preliminary Manufacturing are expected to slip in October, to 50.1 from 51.1, while Services PMIs are likely to rise to 51.3 from 50.9, indicating a slowdown in the sector that has been hit by global trade tensions. Friday – 25 October 2019   German IFO (EUR, GMT 08:00) – In September, the German IFO business confidence came in slightly higher than expected at 94.6. In October, however, the overall business climate reading is seen slightly lower at 94.4. The more forward looking expectations reading is anticipated at 91.8 from 90.8. Always trade with strict risk management. Your capital is the single most important aspect of your trading business.Please note that times displayed based on local time zone and are from time of writing this report.Click HERE to access the full HotForex Economic calendar.Want to learn to trade and analyse the markets? Join our webinars and get analysis and trading ideas combined with better understanding on how markets work. Click HERE to register for FREE!Click HERE to READ more Market news. Andria Pichidi Market Analyst HotForex Disclaimer: This material is provided as a general marketing communication for information purposes only and does not constitute an independent investment research. Nothing in this communication contains, or should be considered as containing, an investment advice or an investment recommendation or a solicitation for the purpose of buying or selling of any financial instrument. All information provided is gathered from reputable sources and any information containing an indication of past performance is not a guarantee or reliable indicator of future performance. Users acknowledge that any investment in FX and CFDs products is characterized by a certain degree of uncertainty and that any investment of this nature involves a high level of risk for which the users are solely responsible and liable. We assume no liability for any loss arising from any investment made based on the information provided in this communication. This communication must not be reproduced or further distributed without our prior written permission.
    • Perfect Trend Lines, PTL, is a short-term trend trading indicator. The lines showing the trend in this indicator is not straight lines like normal trend lines. PTL indicator calculation is simple. First take the 7 bar high and low, then the 3 bar high and low. If the close price is above the 7 bar high and 3 bar high, then an uptrend is identified. When the close price is below the 7 bar low and 3 bar low then a downtrend is identified. These bars are considered as strong trend bars. The magenta line is the 7 bar high or low depending on the trend. The cyan line is the 3 bar high or low depending on trend direction. When price is trading between these 2 lines trend strength is weak.   A magenta diamond shape appears when sell signal is generated. Cyan diamond shape appears for a buy signal. The magenta line can be used as stop loss. The cyan line provides a tighter stop loss level. Strong downtrend bars are marked by a magenta dot at the bar high and strong uptrend bars are marked by a cyan dot at the bottom of the bar.   PTL.zip
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.