Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

madspeculator

Datafeed Recommendations

Recommended Posts

Hello Fellow Traders:

 

I am a futures trader who trades at CME/CBOT (cmegroup) and monitors ICE. I currently use CQG as my datafeed. Unfortunately, given my cashflow situation, CQG is getting too expensive. I am a swing trader: I need real-time data and daily/weekly historical data (both price and volume). As I dont use any indicators in my trading, the charting package provided by the datafeed provider is not important for me.

 

I was wondering if any of you would recommend a good datafeed (with API support) that is stable and reliable -- I was leaning towards esignal but I read that their daily volume info lags by a day, and they have roll-over and volume issues with continuous contracts?

 

Or is there a list of datafeed providers "somewhere-out-there" that I can use to evaluate datafeed providers? I would be more than happy to evaluate the providers if there is an already available list.

 

I look forward to your response.

 

Thank you.

 

Regards,

Madspeculator.

 

P.S: Soultrader: I am not sure if this is the correct place for this thread. Would it make sense to create a datafeed fourm under "Trader Resources" section where fellow traders can comment on their experiences with their datafeed(s)? Personally, I would like to see reviews of datafeeds separated out from the software provided by the datafeed providers (e.g., CQG's datafeed from their charting package; or esignal's datafeed from their charting pacakge).

Share this post


Link to post
Share on other sites

Hi madspeculator,

 

Please use this section for now until our review system is finished. This should create a good review list of all vendors. Once I implement that I will create a new section for datafeed comments based on current users.

 

Regarding datafeed, I am currently using IRT with IQFEED. I understand CQG is expensive. Perhaps you might want to look into it. I used esignal in the past but IQFeed seems to cost slightly less.

Share this post


Link to post
Share on other sites

I second DTN. While I think they may have had some problems in the past as I've read some negative reviews on them, I've had no problem at all.

If you just need good data there doesn't really seem to be any competition in their price range. They do also provide access to their API I believe.

Share this post


Link to post
Share on other sites

I've been running into a lot of headaches with datafeeds and also am looking for something reliable and cheap. Recently, I noticed that IB real time data looks different than the same data backfilled from IB, i.e. Price bars are different. Understanding that IB live data is sampled, I switched to OpenTick. I had done at that time a quick test to verify that OT live data was identical to the same data backfilled and sure enough the price bars "seemed" to be identical, so I switched.

BUT,

I started writing a decent system that used volume as an input and oddly it worked like a charm in forward tests (live) but as soon as I backfilled my data at the end of the day my indicators were all in the wrong places. All trades now were losses! It would seem that the volume data changed quite considerably.

 

So my question is, is there any data feed out there that is identical Live and backfilled (with of course a few exceptions like tick cleanup)?

 

Its almost impossible to write a system using Historical data knowing that Live is different and vice versa, anyone else in the same boat?

:crap:

Share this post


Link to post
Share on other sites
So my question is, is there any data feed out there that is identical Live and backfilled (with of course a few exceptions like tick cleanup)?

Its almost impossible to write a system using Historical data knowing that Live is different and vice versa, anyone else in the same boat?

:crap:

You will probably get more answers if you could please post a chart of live vs historical data and the chart/testing platform with one or two volume indicators. Volume data integrity is one of those dirty little secrets in data feeds. It is like making, or God forbid, eating sausages, you don't want to know how they make it :roll eyes:; but I guess you gotta know.

In the end, you may have to try different feeds until you find one that works with your strategy. I am guessing you are using NT, you may find Zenfire a good datafeed for your purpose.

Share this post


Link to post
Share on other sites

For example if you are doing analysis using tick charts, the volume could be aggregated differently over time so that the volume data looks quite different. Attached please find comparison of two charts from TS, one @ES and the other @ES.D (day session version of ES continuos futures); the magenta arrows show some of the differences. If you apply some indicators based on volume, you will get quite different looking signals.

 

Even the candles looked different. However, using a time chart, the differences are absent (not shown).

5aa70e467cfce_Volumedatadifferent2008-03-15_072548.gif.8b37d548a3efd69866dbc88fc9cc12fd.gif

Share this post


Link to post
Share on other sites

thrunner, thanks for the response. I will see if I can post some charts for analysis. At the moment, all my data ends up being backfilled for some reason or another. I will try to collect live, save it then backfill it to show the differences for the same symbol. Zen-fire sounds good and will look into it as soon as my system comes closer to completion. One point I would make between ES and ES continuous contract is that ES would be live ticks as they come in (ignoring backfilling for now) from the exchange whereas #ES would be created, massaged, and mucked with at the data provider. My guess would be #ES would end up with higher volume than ES simply because the data provider has the ability to aggregate volume as they wish. With constant volume updates throughout the day (playing catch up with the market) #ES would probably include this volume. Similar problem to the one I'm experiencing except that my symbol is YM compared to YM or #YM compared to #YM.

Will try to post some pics...

Share this post


Link to post
Share on other sites

madspeculator, how was your experience with CQG's datafeed and API? I am looking into it to do some order book analysis which requires every single order book update in the order it occured.

Share this post


Link to post
Share on other sites
madspeculator, how was your experience with CQG's datafeed and API? I am looking into it to do some order book analysis which requires every single order book update in the order it occured.

 

AgeKay:

 

I haven't used CQG's datafeed for order book analysis. Depending on what kind of information you need for your order book analysis, CQG might or might not work for you -- for example, if you need cancels CQG will not provide you. In general, I have found CQG to be very robost.

 

You might also want to check out a FIX interface. The information you get from a FIX interface is vastly superior to that from any prop. API provided by market data vendors.

 

Hope this is helpful.

 

All the best.

 

Regards,

MadSpeculator.

Share this post


Link to post
Share on other sites

MadSpeculator, thanks for your reply.

if you need cancels CQG will not provide you.

 

What do you mean with "cancels"?

 

You might also want to check out a FIX interface. The information you get from a FIX interface is vastly superior to that from any prop. API provided by market data vendors.

 

Right. Thanks for the suggestion. Do you know of a good data vendor that offers FIX that gets its data from the Eurex EBS interface or CEF ultra+ Eurex from Deutsche Börse? I know TT offers FIX and connects to EBS but my broker doesn't allow two platforms (I already have X_Trader and TT FIX counts as a platform).

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • Be careful who you blame.   I can tell you one thing for sure.   Effective traders don’t blame others when things start to go wrong.   You can hang onto your tendency to play the victim, or the martyr… but if you want to achieve in trading, you have to be prepared to take responsibility.   People assign reasons to outcomes, whether based on internal or external factors.   When traders face losses, it's common for them to blame bad luck, poor advice, or other external factors, rather than reflecting on their own personal attributes like arrogance, fear, or greed.   This is a challenging lesson to grasp in your trading journey, but one that holds immense value.   This is called attribution theory. Taking responsibility for your actions is the key to improving your trading skills. Pause and ask yourself - What role did I play in my financial decisions?   After all, you were the one who listened to that source, and decided to act on that trade based on the rumour. Attributing results solely to external circumstances is what is known as having an ‘external locus of control’.   It's a concept coined by psychologist Julian Rotter in 1954. A trader with an external locus of control might say, "I made a profit because the markets are currently favourable."   Instead, strive to develop an "internal locus of control" and take ownership of your actions.   Assume that all trading results are within your realm of responsibility and actively seek ways to improve your own behaviour.   This is the fastest route to enhancing your trading abilities. A trader with an internal locus of control might proudly state, "My equity curve is rising because I am a disciplined trader who faithfully follows my trading plan." Author: Louise Bedford Source: https://www.tradinggame.com.au/
    • SELF IMPROVEMENT.   The whole self-help industry began when Dale Carnegie published How to Win Friends and Influence People in 1936. Then came other classics like Think And Grow Rich by Napoleon Hill, Awaken the Giant Within by Tony Robbins toward the end of the century.   Today, teaching people how to improve themselves is a business. A pure ruthless business where some people sell utter bullshit.   There are broke Instagrammers and YouTubers with literally no solid background teaching men how to be attractive to women, how to begin a start-up, how to become successful — most of these guys speaking nothing more than hollow motivational words and cliche stuff. They waste your time. Some of these people who present themselves as hugely successful also give talks and write books.   There are so many books on financial advice, self-improvement, love, etc and some people actually try to read them. They are a waste of time, mostly.   When you start reading a dozen books on finance you realize that they all say the same stuff.   You are not going to live forever in the learning phase. Don't procrastinate by reading bull-shit or the same good knowledge in 10 books. What we ought to do is choose wisely.   Yes. A good book can change your life, given you do what it asks you to do.   All the books I have named up to now are worthy of reading. Tim Ferriss, Simon Sinek, Robert Greene — these guys are worthy of reading. These guys teach what others don't. Their books are unique and actually, come from relevant and successful people.   When Richard Branson writes a book about entrepreneurship, go read it. Every line in that book is said by one of the greatest entrepreneurs of our time.   When a Chinese millionaire( he claims to be) Youtuber who releases a video titled “Why reading books keeps you broke” and a year later another one “My recommendation of books for grand success” you should be wise to tell him to jump from Victoria Falls.   These self-improvement gurus sell you delusions.   They say they have those little tricks that only they know that if you use, everything in your life will be perfect. Those little tricks. We are just “making of a to-do-list before sleeping” away from becoming the next Bill Gates.   There are no little tricks.   There is no success-mantra.   Self-improvement is a trap for 99% of the people. You can't do that unless you are very, very strong.   If you are looking for easy ways, you will only keep wasting your time forgetting that your time on this planet is limited, as alive humans that is.   Also, I feel that people who claim to read like a book a day or promote it are idiots. You retain nothing. When you do read a good book, you read slow, sometimes a whole paragraph, again and again, dwelling on it, trying to internalize its knowledge. You try to understand. You think. It takes time.   It's better to read a good book 10 times than 1000 stupid ones.   So be choosy. Read from the guys who actually know something, not some wannabe ‘influencers’.   Edit: Think And Grow Rich was written as a result of a project assigned to Napoleon Hill by Andrew Carnegie(the 2nd richest man in recent history). He was asked to study the most successful people on the planet and document which characteristics made them great. He did extensive work in studying hundreds of the most successful people of that time. The result was that little book.   Nowadays some people just study Instagram algorithms and think of themselves as a Dale Carnegie or Anthony Robbins. By Nupur Nishant, Quora Profits from free accurate cryptos signals: https://www.predictmag.com/    
    • there is no avoiding loses to be honest, its just how the market is. you win some and hopefully more, but u do lose some. 
    • $CSCO Cisco Systems stock, nice top of range breakout, from Stocks to Watch at https://stockconsultant.com/?CSCOSEPN Septerna stock watch for a bottom breakout, good upside price gap
    • $CSCO Cisco Systems stock, nice top of range breakout, from Stocks to Watch at https://stockconsultant.com/?CSCOSEPN Septerna stock watch for a bottom breakout, good upside price gap
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.