Welcome to the Traders Laboratory Forums.
Futures Trading Laboratory Trading commodities and currency futures

Reply
Old 10-05-2011, 12:17 PM   #1

Join Date: Oct 2011
Posts: 3
Ignore this user

Thanks: 1
Thanked 0 Times in 0 Posts

Backtesting, Demo, and Live Trading

What is the difference between each?

We have all heard that 90% of traders lose money, so why are most people profitable on demo's but not in practice?

What changes?
What changes if it is an automated system?

thank you.
trelco is offline  
Reply With Quote
Old 10-05-2011, 01:01 PM   #2

Tams's Avatar

Join Date: Sep 2008
Location: Geelong
Posts: 3,779
Ignore this user

Thanks: 2,084
Thanked 1,477 Times in 912 Posts

Re: Backtesting, Demo, and Live Trading

Quote:
Originally Posted by trelco »
What is the difference between each?

We have all heard that 90% of traders lose money, so why are most people profitable on demo's but not in practice?

What changes?
What changes if it is an automated system?

thank you.
the core problem with backtest is, most backtest system do not replay the data as in live stream.

ie. to be real, you have to replicate the bid, ask, bid size, ask size, and trade size in the same quantity and timing as the real life.
__________________



Only an idiot would reply to a stupid post

Last edited by Tams; 10-05-2011 at 01:42 PM.
Tams is offline  
Reply With Quote
Old 10-05-2011, 01:32 PM   #3
zdo

Join Date: Nov 2007
Location: boonies
Posts: 1,349
Ignore this user

Thanks: 317
Thanked 355 Times in 256 Posts
Blog Entries: 104

Re: Backtesting, Demo, and Live Trading

trelco, (it may seem like this is a smart ass answer but it isn't)
The best way to find out the difference between real and sim trading is to go live and real now and find out the differences that are YOUR differences - before you get a bunch of well intended, but ultimately damaging, feedback from others about their differences!
zdo is offline  
Reply With Quote
The Following User Says Thank You to zdo For This Useful Post:
trelco (10-05-2011)
Old 10-05-2011, 02:59 PM   #4

Join Date: Oct 2011
Posts: 3
Ignore this user

Thanks: 1
Thanked 0 Times in 0 Posts

Re: Backtesting, Demo, and Live Trading

My systems account for 4-12 ticks of slippage (randomly selected) with much more than that (4-36 ticks) during extreme volatility. Those are usually capitulation days.

They also don't seriously depend on exact bid/ask size or trades for that 1 bar (assuming there are at least 100 contracts on book during recent years).

All of the strategies were developed during the last 3 months based on theories I had. None of them use "fitting."

They all outperform the S&P every year and meet my scalability and risk metric requirements (max drawdown, max length of losing streak, max sustainable drawdown, std deviation, Sharpe/Sortino/Beta/R-squared) *Am I missing anything here?*

The data used starts from 1981-1998 (depending on security) to the present.


Basically what I'm asking is what could I be missing that will mess up real world performance?


zdo: You are right. Knowing the types of problems others ran into or know about might help me and others find what may stand in the way of successful implementation though.
trelco is offline  
Reply With Quote
Old 10-06-2011, 08:37 AM   #5

Join Date: Aug 2011
Location: Gansevoort
Posts: 1
Ignore this user

Thanks: 0
Thanked 0 Times in 0 Posts

Cool Re: Backtesting, Demo, and Live Trading

Backtesting is not real money. Once emotions are involved, it's a whole different ballgame.
krohara is offline  
Reply With Quote
Old 10-06-2011, 11:10 AM   #6

Join Date: Nov 2010
Posts: 1
Ignore this user

Thanks: 0
Thanked 1 Time in 1 Post

Question Re: Backtesting, Demo, and Live Trading

Quote:
Originally Posted by trelco »
What is the difference between each?

We have all heard that 90% of traders lose money, so why are most people profitable on demo's but not in practice?

What changes?
What changes if it is an automated system?

thank you.
What really changes is YOU, Trelco, and that is everything. In a simulated environment, you have no emotion at play (that fear and greed thing that causes us not to follow our rules, aka taking profit too early or moving our stop loss in a wrong direction). Therefore whether your systeme looses $1 or a thousannd does not change your mood or thought or feelings. Once real money is involved and your position is in the red, they DO COME INTO PLAY and you throw the rationale behind your system down the drain. And I think that is also true even if you have an automated system because the market itself changes while your system does not. You would have to make adjustement to curve fit it or correct it according to the market and you are in a never ending adjudsting mode ....of an automated system...

Just my two cents

P.S- About TAMS' comments earlier, if you use Ninja Trader software, it allows you to record and replay the markets as it has happened with ticks and the like, thus allowing you to backtest your strategy and see how YOU would have performed if you would have recognized and taken the signals as they occured.
jdcool10 is offline  
Reply With Quote
The Following User Says Thank You to jdcool10 For This Useful Post:
windsurfer (10-06-2011)
Old 10-06-2011, 06:14 PM   #7

Join Date: Jan 2009
Location: London
Posts: 14
Ignore this user

Thanks: 4
Thanked 0 Times in 0 Posts

Re: Backtesting, Demo, and Live Trading

Back Testing is vanity, Forward Testing is sanity. After reading Mar Douglas' book Trading the in the zone I realised the importance of backtesting but also it's fallacy. Especially when you consider that there are so many variables that makes each point in the past unique and somewhat unrepeatable.

Now I appreciate more J Dalton's Mind over Market and itradepod's discretionary approach to trading based on inherent market mechanics rather that a purely mechanical system that heavily relies on backtesting.
juniorh is offline  
Reply With Quote
Old 10-07-2011, 01:35 PM   #8

Join Date: Oct 2011
Posts: 3
Ignore this user

Thanks: 1
Thanked 0 Times in 0 Posts

Re: Backtesting, Demo, and Live Trading

lol okay but it is basically people who can't manage their emotions that are trading on what they "think" (eg: this will come back to me or I need to take profits now +1tick). Also the fact that this seems to attract gambling types who take illogical risk.

My main problem if anything is that I hold winners too long and sell losers too early when I diverge from the system. Divergence generally only happens when I rush through the set up. This accounts for 3% of trades when I replay tested my system by hand for several years. This is unlikely to happen in real time because I won't have to get through 1000's of set ups in a day. The losses because of that are equivalent to taking 1 extra emergency stop per year. Relatively insignificant. The other part about forward testing: because of the way it was built that is already factored in/done.

So far today I am a little over +$2100 using 1 ES contract. After a couple of weeks like this I think I will increase size. I skipped NFP.

After all the zerohedge propaganda, poor retail performance studies, and general sub 100%+ returns people have posted with under 300k AUM I figured there had to be some mysterious market force that screwed people out of their money...

I guess even with all the resources of the internet there is a lot of dumb money floating around...
trelco is offline  
Reply With Quote

Reply

Thread Tools
Display Modes Help Others By Rating This Thread
Help Others By Rating This Thread:


Similar Threads
Thread Thread Starter Forum Replies Last Post
Demo Account Trading scg84 Beginners Forum 16 06-05-2011 11:52 AM
OEC Giving Free Demo Accounts to Live Account Holders (as Requested Previously) brownsfan019 Open E Cry 13 08-27-2010 05:23 PM
Open E-Cry Demo Issues... Does This Happen on the Live Platform? popstocks Brokers and Data Feeds 27 05-05-2009 09:57 AM
Choosing a Broker for Demo Trading Rafael Forex Trading Laboratory 1 04-20-2009 05:16 AM
Demo or Paper Trading for E-Mini Futures? Blu Bull E-mini Futures Trading Laboratory 6 04-11-2008 02:18 AM

All times are GMT -4. The time now is 01:27 PM.
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.
CS to VB integration by DeskLancer
©2006-2011 Traders Laboratory, All Rights Reserved.