Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

Dinerotrader

Extensive Historical Data

Recommended Posts

Okay. I have been looking into getting historical data in varying amounts but now I am thinking, "doesn't someone just offer all available historical data for each given future?" I just want all the data down to the tick level for a few different futures.

 

I trade oil a lot and say I want to go back to see how price reacted to weekly inventory numbers each week for the past 2 years. I don't want a day, hour, or a 5 minute chart. I want to be able to look at what price did sometimes at the tick level.

 

So my question is who offers this and how much should it cost? I guess it is just a bunch of data with a price and then from there you can just use any ol' charting software to show you charts of whatever time frame you want in whatever scale you want.

 

I get ideas for different trading strategies all the time that I simply cannot even start to evaluate because I don't have nearly enough data.

 

Also, is there a good way to start saving the data I do receive (I use OEC) so that I can keep tick level data even when OEC stops making it available on their service?

Share this post


Link to post
Share on other sites

usually the respective exchange offers the data for sale.

 

A friend recently bought 20 yrs of ag future data,

it set him back $900.

 

(I don't know how many symbols or exact # of contract months)

Share this post


Link to post
Share on other sites
usually the respective exchange offers the data for sale.

 

A friend recently bought 20 yrs of ag future data,

it set him back $900.

 

(I don't know how many symbols or exact # of contract months)

 

So I just call them up and say, "hey there, I am looking for a boat load of oil data, who do I need to haggle with to get a good price on 5 to 10 years of CL data?" or something to that effect.

 

Maybe I just need to find out if some other trader already bought this data and is willing to sell it to me. Thanks for the ideas.

 

Is there a specific charting service that is cheap that I can plug a bunch of expensive data into it and do my analysis?

 

attachment.php?attachmentid=16671&stc=1&d=1261005145

5aa70f845d016_12-16-20095.png.59b58fe23a9dbb4b736486fb27adf785.png

Edited by Dinerotrader

Share this post


Link to post
Share on other sites
So I just call them up and say, "hey there, I am looking for a boat load of oil data, who do I need to haggle with to get a good price on 5 to 10 years of CL data?" or something to that effect.

...

 

 

.........check their website under Market Data Service

data is intellectual property...selling data is a business

 

http://www.cmegroup.com/market-data/licensed-quote-vendors/index.html

 

 

you are not the first one, nor the last one, to look for historical data.

Edited by Tams

Share this post


Link to post
Share on other sites

Quite awhile ago I purchased some data and it wasn't that costly. For the life of me I can't recall the name of the site or company but somewhere (buried deeply) on TL is the link. I'll see if I can find it somewhere around here.

Share this post


Link to post
Share on other sites
Quite awhile ago I purchased some data and it wasn't that costly. For the life of me I can't recall the name of the site or company but somewhere (buried deeply) on TL is the link. I'll see if I can find it somewhere around here.

 

I figured someone would have already gone through this process and evaluated what is the easiest cheapest path.

 

CQP.com looks like the main google search result so far.

 

I need the CL globex, correct (noted below)?

 

attachment.php?attachmentid=16679&stc=1&d=1261018907

5aa70f848bf59_SNAG-12-16-200901.png.cb520b9280d9129f7475c57e8adc502e.png

Share this post


Link to post
Share on other sites

Dinero - another option would be to use TradeStation for this kind of stuff. I was on their site and here's what data is available: http://www.tradestation.com/strategy_testing/hist_market_data.shtm

 

Over 27 Years of Intraday Futures Data

TradeStation also provides the historical data you need to thoroughly test your futures trading strategies. You'll have access to 6 months of tick-by-tick data, plus over 27 years of intraday (minute and above) data for both continuous and individual contracts for the real-time exchanges you have chosen to receive. Click here for a list of available intraday data. Additionally, you'll have up to 48 years of daily data.

 

Custom Continuous Futures Contracts

 

You can now customize the rules that determine when and how your continuous futures contracts roll from one month to the next. This includes the ability to choose the specific months to include in the continuous contract, the data series on which to base the continuous data, the rollover trigger event, and the back adjustment method. You also have the option to "use this symbol for trading", which means that you will be able to automate a strategy that is applied to a chart with this symbol.

 

To create a custom continuous contract from a Chart Analysis or RadarScreen window simply open the Symbol Lookup dialog and click on the "Custom Futures" tab and specify the settings that you would like to use. Once you click on the OK button the platform will automatically create a custom continuous contract symbol based on the settings that you specified.

 

Tick data is very intensive, so I'm not surprised they only offer 6 months of it. You do get a ton of minute data (27 years). Perhaps you could just drill it down to a 1 minute chart and get the same effect you are after. If nothing else, you could see the price action.

 

It's times like this when having TradeStation is very nice. I would not use them as my primary broker by any stretch, but you can get the platform for free if you do 10 round turns per month. Depending on how much trading you are doing, that could literally be knocked out in 1 day. There will be data fees though, regardless of how many trades are being done.

 

So if you used TS and traded 10 round turns, you'd be looking at just data fees. Which isn't terrible if this is what you need/want for your trading. And there's nothing saying you have to stay w/ them forever. You might stay a month or two, get what you need and then close the account.

Share this post


Link to post
Share on other sites

Another option is to collect the data yourself and/or use a downloader. Years ago I used QCollector for that purpose with mixed results. It did permit you to download a lot of tick data unattended. Beware though, the data from your charting platform provider is not always what you would expect.

 

I've heard good things about Tickdata. Never used them and I think it is on the expensive side (which is probably relative).

 

If you choose tickdata.com, they offer something (that used to be) called "pick 15" and "pick 30". You get to pick 15 or 30 years of tick data in any combination of symbols/years, which is a less expensive entry point. Still pricey though.

 

I have used them for several years and never had any problems. Service and support is ok. They used to deliver tick data once a month (if you have a subscription), now you get it every day after market close.

 

There are cheaper (and more expensive options) out there. It all comes down to how important quality is to you, and what timeframe you are testing on. As always you get what you pay for. And to have any use of high quality data you probably need a platform that can use it in an efficient manner.

 

Best wishes

TB

Edited by TrueBalance

Share this post


Link to post
Share on other sites
I'm going to buy data from these guys:

 

FOREX Historical Data, Major Indices and Futures Historical Intraday and Daily Market Data - Through Download and on DVDs/CDs.

 

Will post what I think of it.

 

Would be good if anyone has any random months of tick data for quality comparison.

 

If you are looking for FX data you can find it for free at Oanda/FXTrade. The data is bid/ask, going back to Jan 1, 2004 and is what was actually used for trading. You need an FXTrade account with some minimum balance to be able to get it. They offer five pairs (and of course you can create synthetic pairs from the ones supplied).

 

To get some ideas on what constitutes quality data, check out High Frequency Data Filtering from tickdata.com. It is worth reading even though it was written by a vendor.

Edited by TrueBalance

Share this post


Link to post
Share on other sites

For the longest time I got all the info I wanted for free from finam. I downloaded years of back data in multiple time frames, right down to the minute time frame for data concerning all the emini futures products, no delay as well, real time. It was some Russian source I stumbled across, but I just today noticed they are asking for a subscription. I guess the free ride is over with them. If you're not too picky get the free stuff from CRB, it gives you about 6 months of free info which you can build upon. Pretty good source, as Tick Data provides for them Also give TimingCharts.com a try, not bad. Nowadays I just use Esignal at $25.00 per month plus an extra $10.00 for intraday back to Mar 2007. Anybody found any better?

Share this post


Link to post
Share on other sites

Hi dinotrader,

 

I'm curious to know what you are going to do with all that past data and how it's going to help you:roll eyes:. Oil is not something thats' heavily weighted like the S&P or NASDAQ. Maybe I'm wrong and I'll except the fact that it's possible. I just can't think of one reason why 27 years worth of news related data will help you trade todays markets. It's really not that serious. JMO

 

Happy Trading

 

Ektrader

Share this post


Link to post
Share on other sites
Hi dinerotrader,

 

I'm curious to know what you are going to do with all that past data and how it's going to help you:roll eyes:. Oil is not something thats' heavily weighted like the S&P or NASDAQ. Maybe I'm wrong and I'll except the fact that it's possible. I just can't think of one reason why 27 years worth of news related data will help you trade todays markets. It's really not that serious. JMO

 

Happy Trading

 

Ektrader

 

I wouldn't be looking for 27 years. More like 5-10 years. I have a fundamental belief that markets do some similar things over time and that you can learn from the past in order to determine what future movements have higher probabilities. I don't have the ability to trade using history but I would like to test some ideas that I have. For example, I would like to look at how oil prices reacted to the weekly oil inventory report going back over the past couple years. To do this I would need tick data since the moves are so fast when inventory comes out.

Share this post


Link to post
Share on other sites
I wouldn't be looking for 27 years. More like 5-10 years. I have a fundamental belief that markets do some similar things over time and that you can learn from the past in order to determine what future movements have higher probabilities. I don't have the ability to trade using history but I would like to test some ideas that I have. For example, I would like to look at how oil prices reacted to the weekly oil inventory report going back over the past couple years. To do this I would need tick data since the moves are so fast when inventory comes out.

 

I understand your rationale. Thing is, the markets, the economy, and volume levels have changed. Whos' to say that the same speculators and operators from 10 years ago still have interest in oil. Could be a whole new set of players. Anyway, not to discourage you. If that's what you want to do. Good luck with your analysis and your trading.

 

Happy Trading

 

Ektrader

Share this post


Link to post
Share on other sites

If you buy data from anyone, ensure that they have gone through and made sure the data is clean. There is a lot of stuff that is full of repeated days, gaps, etc;

the good stuff is not cheap. Make sure the data you receive is able to be changed because I guarantee there will be modifications needed.

eg; when is the close. As the exchange says, or the last recorded trade.

eg; when to the futures contract roll over months, to which month.

There will be big gaps.

 

I would suggest that if you want to look at announcements etc then tick data is overkill, its just noise. a 5 min chart would be plenty....but thats up to you.

Share this post


Link to post
Share on other sites
If you buy data from anyone, ensure that they have gone through and made sure the data is clean. There is a lot of stuff that is full of repeated days, gaps, etc;

the good stuff is not cheap. Make sure the data you receive is able to be changed because I guarantee there will be modifications needed.

eg; when is the close. As the exchange says, or the last recorded trade.

eg; when to the futures contract roll over months, to which month.

There will be big gaps.

 

I would suggest that if you want to look at announcements etc then tick data is overkill, its just noise. a 5 min chart would be plenty....but thats up to you.

 

Watch oil next time inventory comes out on Wednesday at 10:30 am ET and see how well a 5 min charts works for you.:)

Share this post


Link to post
Share on other sites

Hi Dinerotrade

i've just bought 2 years of data(tick) from HISTORICAL TICK DATA ? Historical tick data for stocks, equities, futures, options, indexes and indicators!

ES and XX , i'm satisfied about the data quality , i've checked with another data and it's all ok .

i sent email, several time,to the support center and always they replied quickly.

 

Tick Data - Available Futures Data

Share this post


Link to post
Share on other sites
Hi Dinerotrade

i've just bought 2 years of data(tick) from HISTORICAL TICK DATA ? Historical tick data for stocks, equities, futures, options, indexes and indicators!

ES and XX , i'm satisfied about the data quality , i've checked with another data and it's all ok .

i sent email, several time,to the support center and always they replied quickly.

 

Tick Data - Available Futures Data

 

Thanks for the post. Nice to here from a happy customer before I go spend some money.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • How's about other crypto exchanges? Are all they banned in your country or only Binance?
    • Be careful who you blame.   I can tell you one thing for sure.   Effective traders don’t blame others when things start to go wrong.   You can hang onto your tendency to play the victim, or the martyr… but if you want to achieve in trading, you have to be prepared to take responsibility.   People assign reasons to outcomes, whether based on internal or external factors.   When traders face losses, it's common for them to blame bad luck, poor advice, or other external factors, rather than reflecting on their own personal attributes like arrogance, fear, or greed.   This is a challenging lesson to grasp in your trading journey, but one that holds immense value.   This is called attribution theory. Taking responsibility for your actions is the key to improving your trading skills. Pause and ask yourself - What role did I play in my financial decisions?   After all, you were the one who listened to that source, and decided to act on that trade based on the rumour. Attributing results solely to external circumstances is what is known as having an ‘external locus of control’.   It's a concept coined by psychologist Julian Rotter in 1954. A trader with an external locus of control might say, "I made a profit because the markets are currently favourable."   Instead, strive to develop an "internal locus of control" and take ownership of your actions.   Assume that all trading results are within your realm of responsibility and actively seek ways to improve your own behaviour.   This is the fastest route to enhancing your trading abilities. A trader with an internal locus of control might proudly state, "My equity curve is rising because I am a disciplined trader who faithfully follows my trading plan." Author: Louise Bedford Source: https://www.tradinggame.com.au/
    • SELF IMPROVEMENT.   The whole self-help industry began when Dale Carnegie published How to Win Friends and Influence People in 1936. Then came other classics like Think And Grow Rich by Napoleon Hill, Awaken the Giant Within by Tony Robbins toward the end of the century.   Today, teaching people how to improve themselves is a business. A pure ruthless business where some people sell utter bullshit.   There are broke Instagrammers and YouTubers with literally no solid background teaching men how to be attractive to women, how to begin a start-up, how to become successful — most of these guys speaking nothing more than hollow motivational words and cliche stuff. They waste your time. Some of these people who present themselves as hugely successful also give talks and write books.   There are so many books on financial advice, self-improvement, love, etc and some people actually try to read them. They are a waste of time, mostly.   When you start reading a dozen books on finance you realize that they all say the same stuff.   You are not going to live forever in the learning phase. Don't procrastinate by reading bull-shit or the same good knowledge in 10 books. What we ought to do is choose wisely.   Yes. A good book can change your life, given you do what it asks you to do.   All the books I have named up to now are worthy of reading. Tim Ferriss, Simon Sinek, Robert Greene — these guys are worthy of reading. These guys teach what others don't. Their books are unique and actually, come from relevant and successful people.   When Richard Branson writes a book about entrepreneurship, go read it. Every line in that book is said by one of the greatest entrepreneurs of our time.   When a Chinese millionaire( he claims to be) Youtuber who releases a video titled “Why reading books keeps you broke” and a year later another one “My recommendation of books for grand success” you should be wise to tell him to jump from Victoria Falls.   These self-improvement gurus sell you delusions.   They say they have those little tricks that only they know that if you use, everything in your life will be perfect. Those little tricks. We are just “making of a to-do-list before sleeping” away from becoming the next Bill Gates.   There are no little tricks.   There is no success-mantra.   Self-improvement is a trap for 99% of the people. You can't do that unless you are very, very strong.   If you are looking for easy ways, you will only keep wasting your time forgetting that your time on this planet is limited, as alive humans that is.   Also, I feel that people who claim to read like a book a day or promote it are idiots. You retain nothing. When you do read a good book, you read slow, sometimes a whole paragraph, again and again, dwelling on it, trying to internalize its knowledge. You try to understand. You think. It takes time.   It's better to read a good book 10 times than 1000 stupid ones.   So be choosy. Read from the guys who actually know something, not some wannabe ‘influencers’.   Edit: Think And Grow Rich was written as a result of a project assigned to Napoleon Hill by Andrew Carnegie(the 2nd richest man in recent history). He was asked to study the most successful people on the planet and document which characteristics made them great. He did extensive work in studying hundreds of the most successful people of that time. The result was that little book.   Nowadays some people just study Instagram algorithms and think of themselves as a Dale Carnegie or Anthony Robbins. By Nupur Nishant, Quora Profits from free accurate cryptos signals: https://www.predictmag.com/    
    • there is no avoiding loses to be honest, its just how the market is. you win some and hopefully more, but u do lose some. 
    • $CSCO Cisco Systems stock, nice top of range breakout, from Stocks to Watch at https://stockconsultant.com/?CSCOSEPN Septerna stock watch for a bottom breakout, good upside price gap
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.