Jump to content

Welcome to the new Traders Laboratory! Please bear with us as we finish the migration over the next few days. If you find any issues, want to leave feedback, get in touch with us, or offer suggestions please post to the Support forum here.

  • Welcome Guests

    Welcome. You are currently viewing the forum as a guest which does not give you access to all the great features at Traders Laboratory such as interacting with members, access to all forums, downloading attachments, and eligibility to win free giveaways. Registration is fast, simple and absolutely free. Create a FREE Traders Laboratory account here.

skan

Check Missing Data from Strategy

Recommended Posts

Hello

 

How can I check from a easylanguage strategy or indicataor if some data is missing?

 

I'm trying to code a pair trading strategy. Sometimes the data from one of the instruments has gaps but the other one is still continuous.

Some of these gaps are right because of a weekend or holiday but sometimes is because of data feed problems.

Either way, I need to detect it from the code.

 

If my strategy is running on the the "continuous" instrument and waiting for data from the one with gaps in order to exit I could have a serious problem.

 

What easylanguage instruction can check if data is missing?

 

thanks

Share this post


Link to post
Share on other sites
Hello

 

How can I check from a easylanguage strategy or indicataor if some data is missing?

 

I'm trying to code a pair trading strategy. Sometimes the data from one of the instruments has gaps but the other one is still continuous.

Some of these gaps are right because of a weekend or holiday but sometimes is because of data feed problems.

Either way, I need to detect it from the code.

 

If my strategy is running on the the "continuous" instrument and waiting for data from the one with gaps in order to exit I could have a serious problem.

 

What easylanguage instruction can check if data is missing?

 

thanks

 

instead of asking "What easylanguage instruction can check if data is missing?"

try to think, what would you be looking for if you were looking at the data manually?

what would constitute a "bad" data?

what would raise a red flag in your head?

what would sound an alarm in your ears?

Share this post


Link to post
Share on other sites

Hi

 

Maybe something as simple as

If Close > 0 then ....

 

But Maybe there is something more correct.

Some other languages has some instruction to detect nonnumeric numbers or missing data.

Share this post


Link to post
Share on other sites
Hi

 

Maybe something as simple as

If Close > 0 then ....

 

But Maybe there is something more correct.

Some other languages has some instruction to detect nonnumeric numbers or missing data.

 

do you need something more "sophisticated" than what you have written above?

 

note: I am not saying you do, or you don't. This is just the continuation of the thinking process in programming. Remember, you are teaching the computer to think like you.

Edited by Tams

Share this post


Link to post
Share on other sites

If the chart were supposed to be continuous I could check that the current bar's datetime is exactly equal to the previous one plus the bar interval. But this is not as simple because there are weekends, holidays, trading hours,...

Share this post


Link to post
Share on other sites
If the chart were supposed to be continuous I could check that the current bar's datetime is exactly equal to the previous one plus the bar interval. But this is not as simple because there are weekends, holidays, trading hours,...

 

ok, you are bringing more clarity to the table.

what now do you think you need to do? or what EasyLanguage "should" do?

can you articulate it in a step by step process?

Share this post


Link to post
Share on other sites

Hi

I don't know it, that's why I'm asking.

I need to know what to write within an IF expression in order to check if a price doesn't exist on the current bar.

Something like is.na() on R.

Edited by skan

Share this post


Link to post
Share on other sites

Ah, data verification, the bane of any attempt to back test. Not only are you probably missing data, how exactly do you know that the data you do have is correct. You don't. So, now your faced with the nasty task of cross-referencing your data against a different data source. And then that leads to having to further cross-reference to yet another source since you'll inevitably find differences. And then you realize, there's enough differences in all the data such that it's going to materially impact the results of any back test. Now whatcha gonna do? Probably what most do, ignore it...pretend it doesn't matter or that your data is the "real" data.

Share this post


Link to post
Share on other sites

Yes, I quickly moved on from your initial concern, but the answer was implied. It sounds like your relying on one data source. You need another source (i.e., you need at a minimum 2 sources from different providers and preferably 3-4 total different sources if you're serious about the ultimate results) so as to do the comparison and flag the differences. Missing data is easy to isolate. Then just cut and paste until you build your own "reliable" data set. But it won't be quite that simple. You'll likely see many other differences when you start your comparisons (and it's then that you'll realize you need more than 2 sources). From there you'll begin to better understand my initial post.

Share this post


Link to post
Share on other sites

Hello.

I think we are not speaking about the same thing.

 

Checking data quality is very important but is not what I need to do now.

I just need to check if a bar has a price associated or not.

 

Imagine I have a chart with data1= 15min EURUSD forex

and data2=15min TF.

Even If all my data were correct I'll have many bars were data1 exist and data2 doesn't, because data2 has shorter opening sessions and TS or MC fills data2 chart with gaps.

 

If a try to calculate something, such as exit stop, from data2 there will be moments in which my system won't be able to do anything.

I need to detect this gaps on data2 in order to exit from data1, just in case. Or in order to make different calculations.

Share this post


Link to post
Share on other sites

I will look into the on-line broker http://www.thinkorswim.com that has a strategy builder called prodigio. There a cci cross over strategy setup where you can modify to suite your needs, No programming language is required. All done through drag-and-drop system in prodigio.

 

if you open a funded account with thinkorswim, you can use the prodigio strategy builder for free. it can autotrade foe you.

Share this post


Link to post
Share on other sites

back checking in TS forums - there were wireless connectivity issues especially with EUREX at times (i.e. it is on your side not the transmission side), and also Norton Antivirus causes some issues.

Share this post


Link to post
Share on other sites

No algorythm can be programmed to fix bad data which wont introduce a new adverse side effect somewhere. There is no substitute for good information. Redundant data sources are essential to correct bad data. You need to merge them by taking the best inside quotes that don't cross each other.

Last trade info can be filtered by comparing it to the best inside quotes. This will clean up spike and gaps in poor quality data.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


  • Topics

  • Posts

    • Be careful who you blame.   I can tell you one thing for sure.   Effective traders don’t blame others when things start to go wrong.   You can hang onto your tendency to play the victim, or the martyr… but if you want to achieve in trading, you have to be prepared to take responsibility.   People assign reasons to outcomes, whether based on internal or external factors.   When traders face losses, it's common for them to blame bad luck, poor advice, or other external factors, rather than reflecting on their own personal attributes like arrogance, fear, or greed.   This is a challenging lesson to grasp in your trading journey, but one that holds immense value.   This is called attribution theory. Taking responsibility for your actions is the key to improving your trading skills. Pause and ask yourself - What role did I play in my financial decisions?   After all, you were the one who listened to that source, and decided to act on that trade based on the rumour. Attributing results solely to external circumstances is what is known as having an ‘external locus of control’.   It's a concept coined by psychologist Julian Rotter in 1954. A trader with an external locus of control might say, "I made a profit because the markets are currently favourable."   Instead, strive to develop an "internal locus of control" and take ownership of your actions.   Assume that all trading results are within your realm of responsibility and actively seek ways to improve your own behaviour.   This is the fastest route to enhancing your trading abilities. A trader with an internal locus of control might proudly state, "My equity curve is rising because I am a disciplined trader who faithfully follows my trading plan." Author: Louise Bedford Source: https://www.tradinggame.com.au/
    • SELF IMPROVEMENT.   The whole self-help industry began when Dale Carnegie published How to Win Friends and Influence People in 1936. Then came other classics like Think And Grow Rich by Napoleon Hill, Awaken the Giant Within by Tony Robbins toward the end of the century.   Today, teaching people how to improve themselves is a business. A pure ruthless business where some people sell utter bullshit.   There are broke Instagrammers and YouTubers with literally no solid background teaching men how to be attractive to women, how to begin a start-up, how to become successful — most of these guys speaking nothing more than hollow motivational words and cliche stuff. They waste your time. Some of these people who present themselves as hugely successful also give talks and write books.   There are so many books on financial advice, self-improvement, love, etc and some people actually try to read them. They are a waste of time, mostly.   When you start reading a dozen books on finance you realize that they all say the same stuff.   You are not going to live forever in the learning phase. Don't procrastinate by reading bull-shit or the same good knowledge in 10 books. What we ought to do is choose wisely.   Yes. A good book can change your life, given you do what it asks you to do.   All the books I have named up to now are worthy of reading. Tim Ferriss, Simon Sinek, Robert Greene — these guys are worthy of reading. These guys teach what others don't. Their books are unique and actually, come from relevant and successful people.   When Richard Branson writes a book about entrepreneurship, go read it. Every line in that book is said by one of the greatest entrepreneurs of our time.   When a Chinese millionaire( he claims to be) Youtuber who releases a video titled “Why reading books keeps you broke” and a year later another one “My recommendation of books for grand success” you should be wise to tell him to jump from Victoria Falls.   These self-improvement gurus sell you delusions.   They say they have those little tricks that only they know that if you use, everything in your life will be perfect. Those little tricks. We are just “making of a to-do-list before sleeping” away from becoming the next Bill Gates.   There are no little tricks.   There is no success-mantra.   Self-improvement is a trap for 99% of the people. You can't do that unless you are very, very strong.   If you are looking for easy ways, you will only keep wasting your time forgetting that your time on this planet is limited, as alive humans that is.   Also, I feel that people who claim to read like a book a day or promote it are idiots. You retain nothing. When you do read a good book, you read slow, sometimes a whole paragraph, again and again, dwelling on it, trying to internalize its knowledge. You try to understand. You think. It takes time.   It's better to read a good book 10 times than 1000 stupid ones.   So be choosy. Read from the guys who actually know something, not some wannabe ‘influencers’.   Edit: Think And Grow Rich was written as a result of a project assigned to Napoleon Hill by Andrew Carnegie(the 2nd richest man in recent history). He was asked to study the most successful people on the planet and document which characteristics made them great. He did extensive work in studying hundreds of the most successful people of that time. The result was that little book.   Nowadays some people just study Instagram algorithms and think of themselves as a Dale Carnegie or Anthony Robbins. By Nupur Nishant, Quora Profits from free accurate cryptos signals: https://www.predictmag.com/    
    • there is no avoiding loses to be honest, its just how the market is. you win some and hopefully more, but u do lose some. 
    • $CSCO Cisco Systems stock, nice top of range breakout, from Stocks to Watch at https://stockconsultant.com/?CSCOSEPN Septerna stock watch for a bottom breakout, good upside price gap
    • $CSCO Cisco Systems stock, nice top of range breakout, from Stocks to Watch at https://stockconsultant.com/?CSCOSEPN Septerna stock watch for a bottom breakout, good upside price gap
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.