Welcome to the Traders Laboratory Forums.
Tools of the Trade Discussion forum for software, hardware, and computer related topics.

Reply
Old 11-16-2008, 10:21 PM   #17

Join Date: Nov 2008
Location: new york
Posts: 11
Ignore this user

Thanks: 3
Thanked 0 Times in 0 Posts

Re: Archiving Tick Data?

one other thought

has anyone considered reviewing tick data relative to the bid/ask and their quantites at the partucular point in time ?

I notie there are other threads on tape reading and some new fancy tools tlaked about, such as CQG's products.

My own interstis to analyze their relationships in historical and then can easily set up a real time monitor forthese situations, so it is not so much trying to watch the tape, as it does move quite fast
any thoughts?
davla is offline  
Reply With Quote
Old 11-23-2008, 11:36 AM   #18

Join Date: Aug 2008
Location: New York
Posts: 16
Ignore this user

Thanks: 0
Thanked 4 Times in 4 Posts

Re: Archiving Tick Data?

I save tick data from eSignal using QCollector. I have it configured to save separate ascii files for each futures contract I follow, e.g. YGZ8_0.csv , and when those files approach 2Gb I rename to YGZ8_yymmdd.csv (where yymmdd is the last day of full data) and then start collecting a new YGZ8_0.csv file. I configured the file content as:
yymmdd,hhmmss,<trade_pric e>,<trade_volume>,,,,
yymmdd,hhmmss,,,<bid>,<bi d_size>,<ask>,<ask_size>
the contents are CSV as either trades or quotes with best bid/ask
When a contract is a back month I compress it with gzip, so
for example ESH8_0.csv becomes ESH8_0.csv.gz .
Gzip seems to achieve about an 8:1 compression on these ascii files.
My applications recognize the .gz file extension and either decompress the files
when needed or else directly read the .gz files (e.g. java GZIPInputStream).
AldPixto is offline  
Reply With Quote
The Following User Says Thank You to AldPixto For This Useful Post:
davla (11-23-2008)
Old 01-16-2010, 07:33 PM   #19

Join Date: Sep 2009
Posts: 34
Ignore this user

Thanks: 40
Thanked 3 Times in 3 Posts

Re: Archiving Tick Data?

[media]http://www.oracle.com/database/docs/Berkeley-DB-v-Relational.pdf[/media]
SNYP40A1 is offline  
Reply With Quote

Reply

Thread Tools
Display Modes Help Others By Rating This Thread
Help Others By Rating This Thread:


Similar Threads
Thread Thread Starter Forum Replies Last Post
TICK lows on the Russell TICK, not NYSE TinGull Trading Videos 7 10-28-2011 03:00 AM
Will the YM Data Feed be included with the Globex E-mini Data Feed The Bear E-mini Futures Trading Laboratory 1 01-19-2008 01:05 PM
TICK Hook's and TICK Candles Soultrader Technical Analysis 2 04-21-2007 04:22 PM
YM Tick Data TinGull E-mini Futures Trading Laboratory 6 03-18-2007 03:17 PM
Gap Fill Data for ES Soultrader E-mini Futures Trading Laboratory 2 01-11-2007 06:03 PM

All times are GMT -4. The time now is 09:22 PM.
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.
CS to VB integration by DeskLancer
©2006-2011 Traders Laboratory, All Rights Reserved.