Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

madspeculator

Datafeed Recommendations

Recommended Posts

Hello Fellow Traders:

 

I am a futures trader who trades at CME/CBOT (cmegroup) and monitors ICE. I currently use CQG as my datafeed. Unfortunately, given my cashflow situation, CQG is getting too expensive. I am a swing trader: I need real-time data and daily/weekly historical data (both price and volume). As I dont use any indicators in my trading, the charting package provided by the datafeed provider is not important for me.

 

I was wondering if any of you would recommend a good datafeed (with API support) that is stable and reliable -- I was leaning towards esignal but I read that their daily volume info lags by a day, and they have roll-over and volume issues with continuous contracts?

 

Or is there a list of datafeed providers "somewhere-out-there" that I can use to evaluate datafeed providers? I would be more than happy to evaluate the providers if there is an already available list.

 

I look forward to your response.

 

Thank you.

 

Regards,

Madspeculator.

 

P.S: Soultrader: I am not sure if this is the correct place for this thread. Would it make sense to create a datafeed fourm under "Trader Resources" section where fellow traders can comment on their experiences with their datafeed(s)? Personally, I would like to see reviews of datafeeds separated out from the software provided by the datafeed providers (e.g., CQG's datafeed from their charting package; or esignal's datafeed from their charting pacakge).

Share this post


Link to post
Share on other sites

Hi madspeculator,

 

Please use this section for now until our review system is finished. This should create a good review list of all vendors. Once I implement that I will create a new section for datafeed comments based on current users.

 

Regarding datafeed, I am currently using IRT with IQFEED. I understand CQG is expensive. Perhaps you might want to look into it. I used esignal in the past but IQFeed seems to cost slightly less.

Share this post


Link to post
Share on other sites

I second DTN. While I think they may have had some problems in the past as I've read some negative reviews on them, I've had no problem at all.

If you just need good data there doesn't really seem to be any competition in their price range. They do also provide access to their API I believe.

Share this post


Link to post
Share on other sites

I've been running into a lot of headaches with datafeeds and also am looking for something reliable and cheap. Recently, I noticed that IB real time data looks different than the same data backfilled from IB, i.e. Price bars are different. Understanding that IB live data is sampled, I switched to OpenTick. I had done at that time a quick test to verify that OT live data was identical to the same data backfilled and sure enough the price bars "seemed" to be identical, so I switched.

BUT,

I started writing a decent system that used volume as an input and oddly it worked like a charm in forward tests (live) but as soon as I backfilled my data at the end of the day my indicators were all in the wrong places. All trades now were losses! It would seem that the volume data changed quite considerably.

 

So my question is, is there any data feed out there that is identical Live and backfilled (with of course a few exceptions like tick cleanup)?

 

Its almost impossible to write a system using Historical data knowing that Live is different and vice versa, anyone else in the same boat?

:crap:

Share this post


Link to post
Share on other sites
So my question is, is there any data feed out there that is identical Live and backfilled (with of course a few exceptions like tick cleanup)?

Its almost impossible to write a system using Historical data knowing that Live is different and vice versa, anyone else in the same boat?

:crap:

You will probably get more answers if you could please post a chart of live vs historical data and the chart/testing platform with one or two volume indicators. Volume data integrity is one of those dirty little secrets in data feeds. It is like making, or God forbid, eating sausages, you don't want to know how they make it :roll eyes:; but I guess you gotta know.

In the end, you may have to try different feeds until you find one that works with your strategy. I am guessing you are using NT, you may find Zenfire a good datafeed for your purpose.

Share this post


Link to post
Share on other sites

For example if you are doing analysis using tick charts, the volume could be aggregated differently over time so that the volume data looks quite different. Attached please find comparison of two charts from TS, one @ES and the other @ES.D (day session version of ES continuos futures); the magenta arrows show some of the differences. If you apply some indicators based on volume, you will get quite different looking signals.

 

Even the candles looked different. However, using a time chart, the differences are absent (not shown).

5aa70e467cfce_Volumedatadifferent2008-03-15_072548.gif.8b37d548a3efd69866dbc88fc9cc12fd.gif

Share this post


Link to post
Share on other sites

thrunner, thanks for the response. I will see if I can post some charts for analysis. At the moment, all my data ends up being backfilled for some reason or another. I will try to collect live, save it then backfill it to show the differences for the same symbol. Zen-fire sounds good and will look into it as soon as my system comes closer to completion. One point I would make between ES and ES continuous contract is that ES would be live ticks as they come in (ignoring backfilling for now) from the exchange whereas #ES would be created, massaged, and mucked with at the data provider. My guess would be #ES would end up with higher volume than ES simply because the data provider has the ability to aggregate volume as they wish. With constant volume updates throughout the day (playing catch up with the market) #ES would probably include this volume. Similar problem to the one I'm experiencing except that my symbol is YM compared to YM or #YM compared to #YM.

Will try to post some pics...

Share this post


Link to post
Share on other sites

madspeculator, how was your experience with CQG's datafeed and API? I am looking into it to do some order book analysis which requires every single order book update in the order it occured.

Share this post


Link to post
Share on other sites
madspeculator, how was your experience with CQG's datafeed and API? I am looking into it to do some order book analysis which requires every single order book update in the order it occured.

 

AgeKay:

 

I haven't used CQG's datafeed for order book analysis. Depending on what kind of information you need for your order book analysis, CQG might or might not work for you -- for example, if you need cancels CQG will not provide you. In general, I have found CQG to be very robost.

 

You might also want to check out a FIX interface. The information you get from a FIX interface is vastly superior to that from any prop. API provided by market data vendors.

 

Hope this is helpful.

 

All the best.

 

Regards,

MadSpeculator.

Share this post


Link to post
Share on other sites

MadSpeculator, thanks for your reply.

if you need cancels CQG will not provide you.

 

What do you mean with "cancels"?

 

You might also want to check out a FIX interface. The information you get from a FIX interface is vastly superior to that from any prop. API provided by market data vendors.

 

Right. Thanks for the suggestion. Do you know of a good data vendor that offers FIX that gets its data from the Eurex EBS interface or CEF ultra+ Eurex from Deutsche Börse? I know TT offers FIX and connects to EBS but my broker doesn't allow two platforms (I already have X_Trader and TT FIX counts as a platform).

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • Question: To those that had/have cancer, what were the signs that made you think “something is not right here” to make you go see a doctor? Answer: So, 5/25/2018, I woke up, got ready for work, and as I walked to my car, I started gagging. Like something was stuck in my throat and I needed to clear it. And then it went away.   But 10 minutes after that, I was T-boned at 40mph on the driver side door. But what made me see a doctor was while my muscles felt better and bruises were going away, the gagging still continued, I started having fevers, my neck felt swollen, I was having such a hard time breathing, and I'd have random sharp pains in my chest, but not from where the seat belt saved me.   2 weeks after the accident, I finally see an urgent care doctor, who looks me over, tells me I'm fine, but luckily requests a neck X-ray. And I ask for a chest X-ray, which he rolls his eyes but let me have (most of my pain was in the neck, so I understand).   The very next day, he calls and says “So, that chest X-ray shows there's a 4 inch mass on your heart and lungs, and your lungs have been filling up with fluid, as well as in your pericardial (heart) wall. We need you to come in tomorrow.”   Turns out the big mass, due to the accident, caused my heart and lungs to tear and fill with fluid, the swollen neck and gagging was caused by 2 metastasized tumors, and the fevers and weight loss were symptoms. Stage 4b Hodgkin's Lymphoma.   But thankfully, we went very aggressive with chemo (and had a lot of bad side effects that don't normally happen to patients), and now I'm about 16 months cancer-free. Yay lucky X-rays! Rachel Jurina, Quora Source: https://www.quora.com/To-those-that-had-have-cancer-what-were-the-signs-that-made-you-think-something-is-not-right-here-to-make-you-go-see-a-doctor   Profits from free accurate cryptos signals: https://www.predictmag.com/  
    • As a man, the reality of life is the harshest part. I don’t mind looking older or becoming weaker over time; it’s nature.   Have you ever heard that the only people who will be loved unconditionally are women and children? Men will only be loved as long as they can provide until they are no longer needed. It doesn’t matter if you already did your best to get your kids to the best school or get the best things for them, if you stop before they’re done with it, there will be no thank you. The only thing they will remember is that they have to quit school at 15, ignoring all the previous 15 years of life you provided for them. The only people who will accept you, no matter what, are your parents. But in this situation, you might be that ungrateful child.   EDIT: Wow, I didn’t think this would get so much attention.   For those who disagree, I can only say that everyone has their problem. If you don’t get the chance to face such a thing, be grateful. Remember, sometimes what you throw in the garbage is something that someone wishes ever to have.” – ElZee, Quora   Profits from free accurate cryptos signals: https://www.predictmag.com/    
    • The good thing i had noticed so far is that the traderpot value is also on the rise..
    • yup its a gradual rollout the right way in my opinion, its really good and its exciting for the sto in 2027
    • there is no avoiding loses to be honest, its just how the market is. you win some and hopefully more, but u do lose some. 
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.