Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

friva

EXCEL: Downloading Market Data in Excel

Recommended Posts

Hi everybody,

 

I am making a little investigation on how to best pull market data for stocks and index futures into Excel, with an eye on minimising costs of course.

 

I have a special interest on German and Italian stocks and futures (eg DAX, FTSE-MIB) but I care for shares/futures in general.

 

I want to be able do two things:

A) download up to 12 months of High-Low-Last prices on an excel worksheet.

B) have the corresponding live quote on another worksheet.

 

To clarify what I mean I enclose a zipped excel file.

Sheet "Data" and "Data1" give u an idea on how dowload A should look like.

 

On sheet "Data" u can see Last daily prices while on "Data1" u can see High-Low-Last prices for one minute time intervals.

 

Sheet "Last" gives u have an idea of how download B looks like (Last daily prices = live quotes).

 

I am fine updating the prices on the sheet by pressing a "refresh" button.

 

I gathered some info about vendors. See below, but double check with them if u need to be sure.

 

Pls share any suggestion or experience about downloading market data into excel.

 

 

Best

F

 

CHECKED:

 

*E-SIGNAL: can download quotes for italian and german stocks/futures for USD 249/month (including 20% tax and exchange fees). 12 months in advance yield some discount. It's USD 2779/year for 12 months (includes tax and exch fees). Billing is direct to customer, no way to get the service through a broker that then rebate to E-signal some of the comms.

 

 

*IQ-FEED: they do not offer market data from european exchanges. Ref USA they charge USD 63/month without exchange fees to download raw prices for up to 500 US securities (unclear if tax is iuncluded). To download into Excel one can use software DTNIQ that comes at an additional USD 40/month. Also sofware Qcollector and Quotecore can be used to download into excel. Links to the software vendor can be found on IQ-Feed website.

 

 

*KINETICK-NINJA: I understand one can NOT download into Excel. They offer european market data only if one funds a IB account.

 

 

NOT CHECKED YET

 

*CQG: I have heard it is very good stuff, but haven't checked yet with them. Do you know if I can download market data into Excel ? Any idea of the costs ?

 

*INTERACTIVE BROKERS: can I download market data into Excel ? costs ?

 

*BARCHART.COM: download into Excel ? costs ?

 

*RANORDER: download into Excel ? costs ?

 

*TRADEBOLT: download into Excel ? costs ?

 

 

OTHERS ?

 

*DIRECT PURCHASE FROM THE EXCHANGE:

anybody managed to download market data into excel directly from the relevant exchanges ?

Share this post


Link to post
Share on other sites

InteractiveBrokers:

you can download any data you subscribed.

there is a minimum monthly commission fee.

some data are free,

some are almost free (eg. $1/month)

but all are below normal exchange cost or eSignal fees.

 

 

ps. IB provides an excel worksheet for you to pull data from them. You don't need to do any coding.

Share this post


Link to post
Share on other sites

I would like to pick up data (high, low, open, close) for a project that I have in work.

 

What I would be interested in: S&P 500 / 10min / back to 2004. I visited the CQG site and for what I want the price tag is $700 plus. I'm not far enough along in the project to justify that kind of cost.

 

If someone else was interested in the same data, possibly we could split the cost… it would hurt my sensibilities, but I could possibly justify half. If interested, send me a PM. I'm not tied to the CQG idea, but they have what I want… possibly we can collaborate research and find a better deal.

Share this post


Link to post
Share on other sites

if you just need historical data that you are then going to then build on, there are free options around (they might not be accurate enough)

and IB does offer such abilities but unless they have really improved in this regard they are not great for mass downloading - too many throttling issues and I have had bad data from them. They are good for on going recording data daily.

 

Esignal - the advantage they have is that they offer a broad range of instruments, and you will need Qlink to help gather that data unless you want to do it manually. A lot will depend on how many instruments you want to download.

 

The thing you will be wanting to take into consideration as well are issue with the on going data collection.....

eg; are you going to be able to download and add to your data base every day....

what happens if out of say 200 stocks - 5 of them have dubious data, or are closed.

what happens if you go on holiday and cant download - how do you fill in the missing data

 

How manual is it - and how many instruments are you going to use. You dont want to spend hours downloading and checking data every day.

what happens when you have public holidays - how easy is it to adjust the data?

What is the range of instruments - futures, FX, equities?

if its for back testing you will need dividend and futures adjusted data otherwise you are wasting your time doing inaccurate backtests. If its just for charting its not as important maybe.

 

Personally I use Esignal as it gives me a charting package and enough other facilities that make it worth while to not double up on things....and it supplies the data. To be honest I think there are better charting systems out there, but it gives me enough for what I need now.

Share this post


Link to post
Share on other sites

hi TAMS, good to know about IB's competitive pricing for live data.

 

I understand they charge EUR 56/month for DAX stocks. This is not directly comparable to e-signal's (USD 246/month including taxes for all german stocks) but it seems quite low.

 

For live prices I understand IB charges EUR 25/month for Level 1 DAX future prices, EUR 15/month for level 1 FTSE-MIB futures prices.

 

Cooms are low on futures: DAX and FTSE-MIB futures (EUR 1.41-2.00 / leg) compared to local brokers (EUR 3-10/leg).

 

Comms for stock trading are relatively high (avrg 10bips compared to locals charging as low as EUR 5 per trade).

 

thank u

 

F

Share this post


Link to post
Share on other sites

QuoteLink

 

XLQ

 

don't bother reading the rest of this post - it is just some pointless words 'cos apparently my message without these words is too short to allow me to post it. there. that should be enough waffle to do it.

Share this post


Link to post
Share on other sites

At first sight XLQ looks pretty user-friendly.

They say: "if u can use Excel you know how to use XLQ".

 

On the QuoteLink site I did not find comparable attempts to make it sound "easy": it might be the target users whit stronger coding capabilities.

 

XLQ can be used through VBA, so it can be automatically activated by an Excel routine.

The program provides a list of functions that can be run in Excel. Some of these return fundamental data like "Dividend Pay date" or "Institutional %". The functions offered in the lite version are in black font, the ones added on in the full version are in blue (scroll down in "XLQ Overview").

 

XLQ comes at USD 139/year in its full version (including xlqCompanion: an application that gives alerts and calculates trailing stops) and USD 84/year in its lite version.

 

 

QuoteLink I understand charges CHF 120/years for "quotes only" and CHF 300 for "professional". It is unclear to me what is the difference between the two,

Share this post


Link to post
Share on other sites

both offer (or at least offered) a decent free trial.

 

both have templates for the kind of thing you want to do from where you can copy the excel functions you want - if i remember i may have had to search around or even ask one of them to get the template so if you can't find it contact them. Both provide good support.

 

xlq works out less expensive but you pay one year upfront (i think you need the pro version of quotelink).

 

xlq seems to only let you have one timeframe (i.e. 5 mins or 60 mins but not both at the same time and may not offer timeframe less than 5 mins for interactive brokers - i can't remember exactly). quote link is more flexible in this respect. this is really the only major difference I found between them.

 

you need to be comfortable using excel functions. both have a learning curve putting the excel functions you require together, but I got the hang of it pretty quick and the templates help.

 

one, i can't remember which - xlq i think, had a problem with interactive brokers which meant the current close price was not showing the correct value but with a little help from the programmer it got sorted. i also think I had some similar kind of problem with quotelink and again it was sorted by the programmer.

 

I don't use either any more but when I did I found both good.

 

the best thing is to download a trial of both (ask if you can't get the historical ohlc you want in the trial or just pay one month 20 or 30 bucks) and see which you like best. you will need a datafeed (iqfeed or interactive brokers - they may also offer other datafeeds).

Share this post


Link to post
Share on other sites

I moved on to other things - still trying to piece together something that works for me consistently. but for the things I was trying both xlq and quotelink did the job well.

 

thank u sr100m.

I understand you do not download prices in Excel any more.

May I ask what replaced Excel in ur trading setup ?

 

best

F

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • Agreed since some of the new traders usually lose money in start and some loses more while chasing their lost money and eventually ends up blaming to their brokers part.
    • The crypto market are also in phase of maturing like the forex and other trading assets so we can do much more accurate analysis than before since early days it was purely a luck if the investments in crypto bears results because most of the coins or tokens never come to fruition. Some early birds were also able to make profits on these tokens or coins. e,g., like turtle coin starts with 1 satoshi and go up to 7 sathoshis, quite good rewards. another token lmgx now hovering at 10 started from 1, 
    • How's about other crypto exchanges? Are all they banned in your country or only Binance?
    • Be careful who you blame.   I can tell you one thing for sure.   Effective traders don’t blame others when things start to go wrong.   You can hang onto your tendency to play the victim, or the martyr… but if you want to achieve in trading, you have to be prepared to take responsibility.   People assign reasons to outcomes, whether based on internal or external factors.   When traders face losses, it's common for them to blame bad luck, poor advice, or other external factors, rather than reflecting on their own personal attributes like arrogance, fear, or greed.   This is a challenging lesson to grasp in your trading journey, but one that holds immense value.   This is called attribution theory. Taking responsibility for your actions is the key to improving your trading skills. Pause and ask yourself - What role did I play in my financial decisions?   After all, you were the one who listened to that source, and decided to act on that trade based on the rumour. Attributing results solely to external circumstances is what is known as having an ‘external locus of control’.   It's a concept coined by psychologist Julian Rotter in 1954. A trader with an external locus of control might say, "I made a profit because the markets are currently favourable."   Instead, strive to develop an "internal locus of control" and take ownership of your actions.   Assume that all trading results are within your realm of responsibility and actively seek ways to improve your own behaviour.   This is the fastest route to enhancing your trading abilities. A trader with an internal locus of control might proudly state, "My equity curve is rising because I am a disciplined trader who faithfully follows my trading plan." Author: Louise Bedford Source: https://www.tradinggame.com.au/
    • SELF IMPROVEMENT.   The whole self-help industry began when Dale Carnegie published How to Win Friends and Influence People in 1936. Then came other classics like Think And Grow Rich by Napoleon Hill, Awaken the Giant Within by Tony Robbins toward the end of the century.   Today, teaching people how to improve themselves is a business. A pure ruthless business where some people sell utter bullshit.   There are broke Instagrammers and YouTubers with literally no solid background teaching men how to be attractive to women, how to begin a start-up, how to become successful — most of these guys speaking nothing more than hollow motivational words and cliche stuff. They waste your time. Some of these people who present themselves as hugely successful also give talks and write books.   There are so many books on financial advice, self-improvement, love, etc and some people actually try to read them. They are a waste of time, mostly.   When you start reading a dozen books on finance you realize that they all say the same stuff.   You are not going to live forever in the learning phase. Don't procrastinate by reading bull-shit or the same good knowledge in 10 books. What we ought to do is choose wisely.   Yes. A good book can change your life, given you do what it asks you to do.   All the books I have named up to now are worthy of reading. Tim Ferriss, Simon Sinek, Robert Greene — these guys are worthy of reading. These guys teach what others don't. Their books are unique and actually, come from relevant and successful people.   When Richard Branson writes a book about entrepreneurship, go read it. Every line in that book is said by one of the greatest entrepreneurs of our time.   When a Chinese millionaire( he claims to be) Youtuber who releases a video titled “Why reading books keeps you broke” and a year later another one “My recommendation of books for grand success” you should be wise to tell him to jump from Victoria Falls.   These self-improvement gurus sell you delusions.   They say they have those little tricks that only they know that if you use, everything in your life will be perfect. Those little tricks. We are just “making of a to-do-list before sleeping” away from becoming the next Bill Gates.   There are no little tricks.   There is no success-mantra.   Self-improvement is a trap for 99% of the people. You can't do that unless you are very, very strong.   If you are looking for easy ways, you will only keep wasting your time forgetting that your time on this planet is limited, as alive humans that is.   Also, I feel that people who claim to read like a book a day or promote it are idiots. You retain nothing. When you do read a good book, you read slow, sometimes a whole paragraph, again and again, dwelling on it, trying to internalize its knowledge. You try to understand. You think. It takes time.   It's better to read a good book 10 times than 1000 stupid ones.   So be choosy. Read from the guys who actually know something, not some wannabe ‘influencers’.   Edit: Think And Grow Rich was written as a result of a project assigned to Napoleon Hill by Andrew Carnegie(the 2nd richest man in recent history). He was asked to study the most successful people on the planet and document which characteristics made them great. He did extensive work in studying hundreds of the most successful people of that time. The result was that little book.   Nowadays some people just study Instagram algorithms and think of themselves as a Dale Carnegie or Anthony Robbins. By Nupur Nishant, Quora Profits from free accurate cryptos signals: https://www.predictmag.com/    
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.