Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

friva

EXCEL: Downloading Market Data in Excel

Recommended Posts

Hi everybody,

 

I am making a little investigation on how to best pull market data for stocks and index futures into Excel, with an eye on minimising costs of course.

 

I have a special interest on German and Italian stocks and futures (eg DAX, FTSE-MIB) but I care for shares/futures in general.

 

I want to be able do two things:

A) download up to 12 months of High-Low-Last prices on an excel worksheet.

B) have the corresponding live quote on another worksheet.

 

To clarify what I mean I enclose a zipped excel file.

Sheet "Data" and "Data1" give u an idea on how dowload A should look like.

 

On sheet "Data" u can see Last daily prices while on "Data1" u can see High-Low-Last prices for one minute time intervals.

 

Sheet "Last" gives u have an idea of how download B looks like (Last daily prices = live quotes).

 

I am fine updating the prices on the sheet by pressing a "refresh" button.

 

I gathered some info about vendors. See below, but double check with them if u need to be sure.

 

Pls share any suggestion or experience about downloading market data into excel.

 

 

Best

F

 

CHECKED:

 

*E-SIGNAL: can download quotes for italian and german stocks/futures for USD 249/month (including 20% tax and exchange fees). 12 months in advance yield some discount. It's USD 2779/year for 12 months (includes tax and exch fees). Billing is direct to customer, no way to get the service through a broker that then rebate to E-signal some of the comms.

 

 

*IQ-FEED: they do not offer market data from european exchanges. Ref USA they charge USD 63/month without exchange fees to download raw prices for up to 500 US securities (unclear if tax is iuncluded). To download into Excel one can use software DTNIQ that comes at an additional USD 40/month. Also sofware Qcollector and Quotecore can be used to download into excel. Links to the software vendor can be found on IQ-Feed website.

 

 

*KINETICK-NINJA: I understand one can NOT download into Excel. They offer european market data only if one funds a IB account.

 

 

NOT CHECKED YET

 

*CQG: I have heard it is very good stuff, but haven't checked yet with them. Do you know if I can download market data into Excel ? Any idea of the costs ?

 

*INTERACTIVE BROKERS: can I download market data into Excel ? costs ?

 

*BARCHART.COM: download into Excel ? costs ?

 

*RANORDER: download into Excel ? costs ?

 

*TRADEBOLT: download into Excel ? costs ?

 

 

OTHERS ?

 

*DIRECT PURCHASE FROM THE EXCHANGE:

anybody managed to download market data into excel directly from the relevant exchanges ?

Share this post


Link to post
Share on other sites

InteractiveBrokers:

you can download any data you subscribed.

there is a minimum monthly commission fee.

some data are free,

some are almost free (eg. $1/month)

but all are below normal exchange cost or eSignal fees.

 

 

ps. IB provides an excel worksheet for you to pull data from them. You don't need to do any coding.

Share this post


Link to post
Share on other sites

I would like to pick up data (high, low, open, close) for a project that I have in work.

 

What I would be interested in: S&P 500 / 10min / back to 2004. I visited the CQG site and for what I want the price tag is $700 plus. I'm not far enough along in the project to justify that kind of cost.

 

If someone else was interested in the same data, possibly we could split the cost… it would hurt my sensibilities, but I could possibly justify half. If interested, send me a PM. I'm not tied to the CQG idea, but they have what I want… possibly we can collaborate research and find a better deal.

Share this post


Link to post
Share on other sites

if you just need historical data that you are then going to then build on, there are free options around (they might not be accurate enough)

and IB does offer such abilities but unless they have really improved in this regard they are not great for mass downloading - too many throttling issues and I have had bad data from them. They are good for on going recording data daily.

 

Esignal - the advantage they have is that they offer a broad range of instruments, and you will need Qlink to help gather that data unless you want to do it manually. A lot will depend on how many instruments you want to download.

 

The thing you will be wanting to take into consideration as well are issue with the on going data collection.....

eg; are you going to be able to download and add to your data base every day....

what happens if out of say 200 stocks - 5 of them have dubious data, or are closed.

what happens if you go on holiday and cant download - how do you fill in the missing data

 

How manual is it - and how many instruments are you going to use. You dont want to spend hours downloading and checking data every day.

what happens when you have public holidays - how easy is it to adjust the data?

What is the range of instruments - futures, FX, equities?

if its for back testing you will need dividend and futures adjusted data otherwise you are wasting your time doing inaccurate backtests. If its just for charting its not as important maybe.

 

Personally I use Esignal as it gives me a charting package and enough other facilities that make it worth while to not double up on things....and it supplies the data. To be honest I think there are better charting systems out there, but it gives me enough for what I need now.

Share this post


Link to post
Share on other sites

hi TAMS, good to know about IB's competitive pricing for live data.

 

I understand they charge EUR 56/month for DAX stocks. This is not directly comparable to e-signal's (USD 246/month including taxes for all german stocks) but it seems quite low.

 

For live prices I understand IB charges EUR 25/month for Level 1 DAX future prices, EUR 15/month for level 1 FTSE-MIB futures prices.

 

Cooms are low on futures: DAX and FTSE-MIB futures (EUR 1.41-2.00 / leg) compared to local brokers (EUR 3-10/leg).

 

Comms for stock trading are relatively high (avrg 10bips compared to locals charging as low as EUR 5 per trade).

 

thank u

 

F

Share this post


Link to post
Share on other sites

QuoteLink

 

XLQ

 

don't bother reading the rest of this post - it is just some pointless words 'cos apparently my message without these words is too short to allow me to post it. there. that should be enough waffle to do it.

Share this post


Link to post
Share on other sites

At first sight XLQ looks pretty user-friendly.

They say: "if u can use Excel you know how to use XLQ".

 

On the QuoteLink site I did not find comparable attempts to make it sound "easy": it might be the target users whit stronger coding capabilities.

 

XLQ can be used through VBA, so it can be automatically activated by an Excel routine.

The program provides a list of functions that can be run in Excel. Some of these return fundamental data like "Dividend Pay date" or "Institutional %". The functions offered in the lite version are in black font, the ones added on in the full version are in blue (scroll down in "XLQ Overview").

 

XLQ comes at USD 139/year in its full version (including xlqCompanion: an application that gives alerts and calculates trailing stops) and USD 84/year in its lite version.

 

 

QuoteLink I understand charges CHF 120/years for "quotes only" and CHF 300 for "professional". It is unclear to me what is the difference between the two,

Share this post


Link to post
Share on other sites

both offer (or at least offered) a decent free trial.

 

both have templates for the kind of thing you want to do from where you can copy the excel functions you want - if i remember i may have had to search around or even ask one of them to get the template so if you can't find it contact them. Both provide good support.

 

xlq works out less expensive but you pay one year upfront (i think you need the pro version of quotelink).

 

xlq seems to only let you have one timeframe (i.e. 5 mins or 60 mins but not both at the same time and may not offer timeframe less than 5 mins for interactive brokers - i can't remember exactly). quote link is more flexible in this respect. this is really the only major difference I found between them.

 

you need to be comfortable using excel functions. both have a learning curve putting the excel functions you require together, but I got the hang of it pretty quick and the templates help.

 

one, i can't remember which - xlq i think, had a problem with interactive brokers which meant the current close price was not showing the correct value but with a little help from the programmer it got sorted. i also think I had some similar kind of problem with quotelink and again it was sorted by the programmer.

 

I don't use either any more but when I did I found both good.

 

the best thing is to download a trial of both (ask if you can't get the historical ohlc you want in the trial or just pay one month 20 or 30 bucks) and see which you like best. you will need a datafeed (iqfeed or interactive brokers - they may also offer other datafeeds).

Share this post


Link to post
Share on other sites

I moved on to other things - still trying to piece together something that works for me consistently. but for the things I was trying both xlq and quotelink did the job well.

 

thank u sr100m.

I understand you do not download prices in Excel any more.

May I ask what replaced Excel in ur trading setup ?

 

best

F

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • NFLX Netflix stock, nice move, hit target 1, https://stockconsultant.com/?NFLX
    • NBIX Neurocrine Biosciences stock range breakout watch, https://stockconsultant.com/?NBIX
    • RTX stock, nice close with a flat top breakout above 102.77, https://stockconsultant.com/?RTX
    • Date: 8th May 2024. Market News – Stocks mixed; Yen support still on; Eyes on NFP & Apple tonight   Economic Indicators & Central Banks:   As the Fed maintained a “high-for-longer” stance, stocks gave up their gains with attention turning back to earnings. Chair Powell and the Fed were not as hawkish as feared and the markets reacted immediately and in textbook fashion to the still dovish policy stance. The Fed flagged that recent disappointing inflation readings could make rate cuts a while in coming, but Fed chief Jerome Powell characterized the risk of more hikes as “unlikely,” giving some solace to markets. Stocks traded mixed across Asia, while in Europe, DAX and FTSE futures are finding buyers and US futures are also in demand, after the Fed’s message. Yen: Another suspected intervention by authorities, this time in late New York trading, ran into resistance from traders keen to keep selling the currency. Swiss CPI lifted to 1.4% y/y in April from 1.0% y/y in the previous month. Headline numbers are still at low levels and base effects play a role, with the different timing of Easter this year also likely to distort the picture. That said, the numbers may not question the SNB’s decision to cut rates, but they do not support another rate cut in June. Financial Markets Performance:   The USDIndex has corrected to 105.58, but USDJPY is already inching higher again, after a sharp drop to a low of 153.04 on Tuesday that sparked fresh intervention speculation. The pair is currently trading at 155.38. Treasury yields plunged and were down over double digits before profit taking set in. USOIL finished with a -3.6% loss to $79.00, the lowest since March 12. Currently it is as $79.53. Gold was up 1.4% to $2319.55 per ounce, reclaiming the $2300 level. Market Trends:   Wall Street climbed initially with gains of 1.4% on the NASDAQ, 1.2% on the Dow, and 0.96% on the S&P500. The NASDAQ and S&P500 closed with losses of -0.3%, while the Dow was 0.23% firmer. The Hang Seng rallied more than 2%, and the ASX also posting slight gains, while CSI 300 and Nikkei declined. Apple’s earnings report is due after the US market closes today, will give investors a better sense of how the iPhone maker is weathering a sales slump, due in part to a sluggish China market. Always trade with strict risk management. Your capital is the single most important aspect of your trading business. Please note that times displayed based on local time zone and are from time of writing this report. Click HERE to access the full HFM Economic calendar. Want to learn to trade and analyse the markets? Join our webinars and get analysis and trading ideas combined with better understanding on how markets work. Click HERE to register for FREE! Click HERE to READ more Market news. Andria Pichidi Market Analyst HMarkets Disclaimer: This material is provided as a general marketing communication for information purposes only and does not constitute an independent investment research. Nothing in this communication contains, or should be considered as containing, an investment advice or an investment recommendation or a solicitation for the purpose of buying or selling of any financial instrument. All information provided is gathered from reputable sources and any information containing an indication of past performance is not a guarantee or reliable indicator of future performance. Users acknowledge that any investment in FX and CFDs products is characterized by a certain degree of uncertainty and that any investment of this nature involves a high level of risk for which the users are solely responsible and liable. We assume no liability for any loss arising from any investment made based on the information provided in this communication. This communication must not be reproduced or further distributed without our prior written permission.
    • Date: 7th May 2024. Dow Jones Close To 1-Month High, Eyes on Disney Earnings. The stock market trades at a 3-week high after significant support from the latest earning reports and US employment data. Economists continue to expect a rate cut no earlier than September 2024 despite the US unemployment rate rising to 3.9%. The US Dollar Index trades higher on Tuesday and fully corrects the decline from NFP Friday. Dow Jones investors wait for Disney to release their latest quarterly earnings data. The stock holds a weight of 1.93%. USDJPY – The US Dollar Regains Lost Ground The USDJPY is an interesting pair on Tuesday as the US Dollar is the best performing currency within the market while the Yen is witnessing the strongest decline. Investors will continue to monitor as we enter the European Cash Open to ensure no significant changes. The exchange rate has been declining since the 29th of April when the Japanese Government is believed to have intervened and strengthened the Yen. However, the US Dollar has been gaining over the past 24 hours. During this morning’s Asian Session, the exchange rate trades 0.44% higher. Currently the only concern for the US Dollar is the latest employment data which illustrates a potential slowing employment sector. However, investors are quick to point out that this cannot be known simply from 1 weak month. This is the first time the NFP data read lower since November 2023. No major data is in the calendar for the next two days which can influence the US Dollar. Despite the weaker employment data and lower wage growth, investors continue to predict a rate cut no earlier than September 2024. This is something which can also be seen on the CME FedWatch Tool, which shows a 34.3% chance of rates remaining unchanged in September. In regard to the Japanese Yen, most analysts expect the next rate increase in the second half of this year depending on a stable movement of inflation. In addition, investors are monitoring the actions of financial authorities, expecting new currency interventions from them against a weakening Yen. This is the main concern for investors speculating against the Yen. However, economists continue to advise the Yen will struggle to gain even with a small rate hike, unless the rest of the financial world starts cutting rates. USA30 – Investors Turn To Disney Earnings Data! The Dow Jones is close to trading at a 1-month high and is also trading slightly higher this morning. The index recently has been supported by the latest employment data which indicates a higher possibility of rate cuts by the Fed. Today investors focus on the quarterly earnings report for Disney. Disney stocks are trading 0.37% higher during this morning’s pre-trading hours indicating investors believe the report will be positive. So far this year the stock is trading 28.40% higher and is one of the better performing stocks. Yesterday, the stock rose by 2.47% but remains significantly lower than its all-time high of $197. Currently analysts believe the earnings data will either be similar to the previous quarter or slightly lower. If earnings and revenue read higher, the stock is likely to continue rising. The stock is the 22nd most influential stock for the Dow Jones and will only influence the USA30 and USA500, not the USA100. Currently, technical analysis continues to indicate a strong price sentiment. The price trades above the 75-bar EMA and above the VWAP. In addition to this, the RSI is trading at 68.11 which also signals buyers are controlling the market. The only concern for traders is retracements. A weaker retracement could decline to $38,703, whereas a stronger retracement can fall back to $38,571. Always trade with strict risk management. Your capital is the single most important aspect of your trading business. Please note that times displayed based on local time zone and are from time of writing this report. Click HERE to access the full HFM Economic calendar. Want to learn to trade and analyse the markets? Join our webinars and get analysis and trading ideas combined with better understanding on how markets work. Click HERE to register for FREE! Click HERE to READ more Market news. Michalis Efthymiou Market Analyst HFMarkets Disclaimer: This material is provided as a general marketing communication for information purposes only and does not constitute an independent investment research. Nothing in this communication contains, or should be considered as containing, an investment advice or an investment recommendation or a solicitation for the purpose of buying or selling of any financial instrument. All information provided is gathered from reputable sources and any information containing an indication of past performance is not a guarantee or reliable indicator of future performance. Users acknowledge that any investment in FX and CFDs products is characterized by a certain degree of uncertainty and that any investment of this nature involves a high level of risk for which the users are solely responsible and liable. We assume no liability for any loss arising from any investment made based on the information provided in this communication. This communication must not be reproduced or further distributed without our prior written permission.
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.