Hang Seng Index: Unbelievably Easy to Work on

iStock_000010552687XSmall

I am working on trading models for trading the Hang Seng Index. It is a cooperation project among multiple parties. I am quite excited by the idea that I am taking my financial technologies and trading experience to challenge the best minds in the Asian arena.

To my surprise, in the initial phase of this project, for which I expected a lot of difficulties in terms of data collection and information gathering, it is so much easier than working with the S&P indices.

For S&P 500 and the other related indices, one of the challenges is to figure out all the historical components of the indices and the exact time for which these components are part of the index calculations. S&P makes it so hard to figure this out even though it is something that should be made available to the public. It took investigative work to track down all the changes that I explained in one of the chapters of Market Breadth Primer.

However, working on Hang Seng Index, it is so easy to gather such information because Hang Seng Index has its own official website with everything you need to know about the indices are made available. I have to praise those working there that they are doing such a great job that S&P should be ashamed.

So why venture into trading the Hang Seng?

Well, I can see that the financial system is not going to be stable going into the future. Counter-party risk will be again in the spotlight soon. That means trading European markets is definitely not a good idea. Trading only instruments in North America is also not a good idea if bad things happen to the brokerages and clearing houses here. So, having presence in Asia now and eventually building this up to include more countries there will be a very good way to take my trading to the next level.

How Scientific Approach to Meditation Revolutionizes this Gift from Our Ancient Past

image

Meditation, the mystical practice that has gained so much recognition lately from the Internet, has been around for literally thousands of years in various forms and styles. It gained its flame because of the supposedly superpower you can unlock within yourself like becoming wiser, calmer and perform better in almost everything. However, for normal people who tried to learn this, more than half of them are likely not able to benefit from practicing meditation. In fact, it is creating more frustration and confusion than helping out these people to live a better life. After all, it was called a mystical skill for a good reason. Well, thanks to latest scientific research and technology, this ancient technique of training our mind is now much more learnable than ever.

I touched on this subject of meditation over the years but I tried to minimize the coverage because of several factors. First, it was much less acceptable to even talking about meditation just ten years ago. It was even namely as “evil” when you whisper the name to someone whose religious background somehow tainted by bad information. Second, self learning meditation is always difficult because there is no easy way to track one’s progress in such training. Unlike learning a subject with scientific facts that you can be quizzed later on to see how much you remember or understand, a normal person do not have a simple way to self assess the improvements they have made from practicing meditation.

Modern meditation techniques introduced by many famous gurus actually helped a lot more people because they simplified the whole concept down to something much more tangible. For example, the famous one-moment meditation has been helping so many people in dealing with their everyday stress and hectic lives. There are many scientific researches made public that help people to understand that being more mindful (through meditation) can benefit them so much that their brains are rewired in a good way.

So we now know meditation helps people in a very meaningful way. Its health benefits are tremendous. But these researchers have not been able to solve the biggest obstacle of making meditation something accessible to everyone, until now.

I reviewed a product called Inner Balance at my other site, Essence of Trading, focuses on its benefit on trading performance. This product is basically a portable heart rate monitor that connect to your cell phone through Bluetooth. What makes it special is that it can track your heart rate variability (HRV) in real-time giving the user instant feedback of their current state of calmness. Yep, you read this right. For the first time, there is a way for anyone who does not have access to a good trainer to learn the foundation of meditation, which is slowed down breathing, to finally learn the skill properly, quickly with much less frustration.

Heart Rate Variability (HRV) is a pretty good indicator of one’s calmness which was very difficult to measure before the discovery and deeper understanding of how our heart lung functions are affected by our mood swings. Maybe, in the future there will be even better measurement tools discovered along the way. But why wait if we already have something on hand that can help us now.

Anyone interested in getting Inner Balance can go to their site and check out the products offered there.

(Affiliate disclosure: I have signed up to become an affiliate after I gave out a whole bunch of this device as gifts and see the amazing results on my friends and family)

I will try not to repeat what I wrote in the review here. Anyone interested in that can read it later.

What I like to say here is that many traditional practices from our ancestors could be labelled as mystical but not all of them are bad. Once we start to understand more how they work, the mysticism dissolves, resulting in a more accurate view of what they really are. Meditation, now with enough scientific researches done on the subject, is shining through with real life practical use in medical treatments like reducing anxiety, lowering high blood pressure and improving performance from sports to trading. It is a real gift from our ancient past.

The Lack of Educational Resources for Traders in Hong Kong and Rest of Asia

image

I wrapped up my trip to Asia on schedule earlier this week. I did not anticipated that though because there is always something coming up from this type of business trips that you have to extend it until everything is taken care of. Very nice that I get to take a break now going into New Year for much needed rest and relax before the hectic work schedule I planned for next year.

During my stay in Asia I squeezed time to check out various bookstores in every major city I went to. I was trying to find some trading books that are of decent quality to be recommended to my Asian readers. And if possible, I could just buy a whole stack and give them out as holiday gifts. Sadly, I could not find one book that really meet my expectations. It is quite disappointing given last year I learned about the financial scams still rampaging in these countries.

image

In many of these bookstores, there is really just one or two columns of books on investments. And trading, being a sub-category of investment, has probably one to two rows of books. These books on trading are mainly translated from books originally written in English. My not so in-depth attempt to browse through some of these books leaves me with a pretty bad impression as I have read the originals and I am quite sure the translated versions of these books are not delivering the correct message to the readers.

Another very interesting phenomenon is that Warren Buffett is over represented in every bookstore I visited. First, if you are a normal person, you should not invest like Warren Buffett. I am willing to go all the way to say that if you are not Warren Buffett, you should never invest like him. It is a very sensitive topic which deserves a complete article written on just this issue alone. I guess I have to do that in the future so that I do not need to answer this same question again and again.

There are rows and rows of books, both translated and originally written ones, on Warren Buffett’s “investment secrets” and “financial wisdoms”. This is classic cult following mentality where these books are there to attract casual readers to buy them on impulse. They do not provide any real value to the readers yet I know they must be selling very well because there are multiple copies of these books on the shelf while other books you see only one copy there most of the time.

I can see the huge potential of trading / investing education market in Asia. Only by lifting the overall standard in investors sophistication in the region will eliminate the continuous scamming activities there. Better education for traders will also reduce the number of tragedies related to gambling in the financial markets that I see dominating the retail trading scene in Asia.

Time to Slack Off 2017

image

As a follow up to my Time to Slack Off series, I like to report my results and what I think going forward I will do with my trading. Many doors opened this year for which I am very grateful for and that I get to try out different ideas in such a short period of time is both exciting and exhausting. It is time for me to reflect and plan for the coming year.

Transformation of My Trading

I have achieved my trading goal for myself and for my clients as a money manager back in early October already. Due to serious pile up of all kinds of tasks, I did not get the time to write about it until now. This year is fundamentally different from the years of trading I have done due to the drastic changes of my trading goals and the new responsibility of managing a completely different kind of funds.

Many readers who follow me for years know that I used to trade through the complete US market open hours. I did take breaks during lunch but I tended to squeeze as much profit from the market as possible back then. Last two years my personal trading goals have changed to a more moderate approach for which I am driving for consistent returns with much reduced stress and effort. That took a lot of work outside of trading to further improve my mechanical trading models. More importantly, I came up with an even better trading framework for handling the current trading environment.

Hence I spent a lot less time in front of the screen and more time outside of it. I now usually sit at the screen to watch the open but I can choose not to because my mechanical models would take care of the orders anyway. Even though I have open positions by 11 am (Eastern Time) I can walk away since the positions are managed automatically. In my opinion, the performance is actually better based on the relatively shorter amount of time spent in front of the screen.

My Experiment on Running a Different Type of Fund

Last year I started to manage in a small scale funds that demand stable return in low-teens percentage with a time window of 3 years (or more) of lock-in period. As oppose to classic fundamental based fund managers who bet on fairy-tale information, or those big swingers with so-called macro view that ignores the market dynamics, my approach is to day trade with mechanical strategies that I know are rock solid concepts working consistently over the past 20 years. By controlling the leverage, I make it possible to produce consistent returns without the so-called volatility swings with those funds that have overnight risk. It is a great idea that worked out very well.

In comparison, the responsibility as a money manager managing client accounts, my objective is often maximizing the return with risk precisely defined. I can assure you that it is not an easy task. Although I have been doing my part for years, it is still challenging as the financial markets evolve rapidly.

The Birth of a Private Fund

Inevitably, after the success of the experiment, I am being asked to reconsider my position to run a fund among close friends and families. It is not even going to be the size of a tiny hedge fund. It is just money that a few close friends can spare for speculation purpose (something I called burnable). Since I am so restrictive on the amount of money they should put into the pool relative to what they have and that I am imposing the same 3 to 5 years lock-in period, I am glad that they choose to keep their individual commitment small. Now that the word is out, I have requests from friends everywhere asking me to do the the same.

This is, kind of, completely deviating from my original plan. My original intention was to run this private fund with just my own money and possibly some from my partner. Once the first year return is booked, I will try to convert the individual accounts that I manage for my long term clients into the same pool so that I can streamline the whole operation. That is a longshot though, because my clients really dislike publicity of any kind. Still, I hope to convert them to believe in my new hands off approach.

Anyhow, I planned to launch this no later than February next year. Just the explanation of the risk involved in my kind of trading can take hours to each individual interested in this. It will keep me very busy until then.

Mix and Match of Trading Signals

So what does all these developments have to do with daytradingbias.com? After all I tagged this post with it.

Well, part of the trading models I developed for my private fund will also be made available at daytradingbias.com thru real-time trading assistant and other means. I have looked into many other ways to delivery the signals. The viable ones will be added one by one.

For those interested in managing their own accounts with a subset of signals picked from the set, documentation / a complete course will be made available so that they can adapt the strategies to create a trading plan that fits their risk tolerance. This is what I am planning so far but I do not know if the plan will change again down the road.

On the Road Again

I am heading to Asia as mentioned in my post back in October coming weekend. Once I have internet access there I will continue to post. I will get the chance to meet with many people from the financial industry there. If anything interesting comes up, I will definitely write about them.

 

Past Time to Slack Off Posts

Time to Slack Off 2014

Time to Slack Off 2013

Time to Slack Off 2012

Busy Schedule Ahead

It has been weeks of chaos so far in the development front on deploying my trading models. Unforeseen troubles in live trading of the models forced us to twist our code to handle all kinds of issues like sudden disconnect from brokerage server. Unlike co-location server based solutions, we have now proven retail level client side automation has many issues that cannot be taken care of easily.

Nonetheless, I am still going to push forward with these projects to see how much we can accomplish. In the meantime, I am busy writing up the documentation / instructions on trading these strategies effectively.

While all these things are happening, coming two weeks we are setting up a new remote data centre. This is not our first attempt though. Some of the premium members may remember that the first try was a complete disaster. Once the remote data centre is up and running, I will phase out the current one in Toronto.

Adding to all that, I am also going to hit the road again later this year due to an interesting development that I may work on a special project involving a number of trading firms and financial institutions in Asia. I am not sure what my exact travel plan will be at this point. For those of you in Asia, I will get in touch.

Have a nice weekend all!

My Journey to Fully Automate My Trading: AI vs. KISS

Thinker

The latest round of buzz about AI (Artificial Intelligence), particularly the new meme Machine Learning, has triggered many talks on its applications in trading and investing. It is very interesting how it suddenly becomes the latest holy grail in trading. Is it really that much better? Not necessary.

What AI is Good at

AI is very good at picking up patterns from large amount of data based on the framework we have provided them. It also gives AI the advantage to find patterns that human often miss since we are born to identify visual anomalies only. In other words, AI can assist us to uncover useful information from large amount of data. From the game of chess or online games, to industrial design of cars and equipment, AI helps us resolve many difficult problems in much faster and efficient manner comparing to human based discovery approach.

When I use the word “pattern” above, it is not limited to visual or statistics based patterns. It can be patterns of rules that govern a dynamic system. For example, the machine learning process may discover that certain set of rules are failing to produce the expected results, and that they all belongs to the same category of underlying patterns in the data.

By applying this meta logical pattern on the rules, AI can develop new rules itself. This is the technological direction, namely self reprogramming and self refinement, that Elon Musk is so worried about. Think about an AI based program deployed to defend a country that has built-in self management rules to improve itself. What if one day the system produced a new rule that it is better to launch all the missiles to guarantee winning a war, or chose to delete a rule that emphasize on minimizing the casualties of civilians?

AI in Trading

AI has been applied to trading ever since it was introduced many years ago. The earlier approaches are mainly developed to capture patterns in price and related financial data (e.g. PE ratio) to make forecast on individual stock and markets. Later on we have seen successful trading models built for short term trading on indices using patterns recognized from large amount of data including price patterns and market breadth data. The concept behind the development of these models, however, are still very human centric. We were using AI to discover patterns and then we apply the patterns in our trading. In short, we decide what discoveries made by the computer are applied in our trading.

The latest round of AI application in trading, however, is taking on a different direction. Many professional traders and trading firms are now testing fully automated trading models that are managing themselves. What I mean is that human factor is reduced down to the initial feeding of data into the computer with an overall theme specification and subsequent risk management only. In short, we are teaching the computer to trade by themselves instead of teaching human to do the job because we prefer traders to have little or no emotion at all for better performance.

The advantage of these new approach to AI based trading does not stop there. Models will continue to evolve on their own, either in live or simulation environment (which human still have control). This helps proprietary trading firms tremendously with much better control over the consistency in performance.

Context Matters

It is obvious that AI is best fit for trading in short term environment as the amount of data to be processed can be too much for human to analyze. It is also clear that the AI models that self manage can pick up subtle changes in the data much faster than human can. This ability to teach itself to adapt to a changing environment can be a double-edged sword though.

For a changing environment, say, a news driven shock to the markets, can be very short term. Given enough historical examples feed to the AI systems, they will figure out a way to handle these situations. The catch is, however, that certain longer term environment change never repeats themselves, yet they produced all the major characteristic changes that affect the markets for years. As there is never enough historical data on these situations, AI cannot really learn from them nor can they incorporate safety measures to safe guard themselves properly when such tide turning events happen in the future.

In other words, the adaptive AI based trading systems are doing exactly opposite of what many classic (and successful) trading models do. Instead of exploiting one specific bias to extract profit from the market with money management strategies to protect the profits like the classic trading models, the new self learning AI systems keep tuning themselves to outsmart the markets. This approach is not that different from what we called routine re-optimization of deployed trading models. Since we do not know if the set of parameters we use on a trading model would perform best in the future, by optimizing the models based on a subset of the historical data, usually the most recent part, on a regular basis, it gives us a way to tune the model to better fit the current trading environment. The self learning AI systems basically does that themselves.

Human Factor Still Key to Success

Hence, it is important more than ever that the trainer / designer of an AI system to understand the various potential drivers in a market. There are things the AI system would never be able to learn or to adapt to. There are things the AI system should never adapt to. The boundaries necessary to make the AI system safe to trade have to be provided by human.

Seriously, everyone can train their generic AI toolbox to deploy trading models to trade real money. In fact, I am sure every model deployed has a pretty darn good historical performance. But, it is not how good a system perform that matters. As the old saying goes, “If you avoid the losers, the winners take care of themselves”. It is how the system react to adverse situations and not losing too much money in the process that really counts. Only those designers who are well aware of defensive money management principles would do this correctly right from the beginning.

The bottom line is clear – it is still the person behind the machine based trader that matters most.

KISS Still Shines

“Keep It Simple, Stupid!” believe it or not, still holds true even in this heavily bots populated trading environment.

As I explained many times over the years, with more bots trading, the markets evolved into something much more predictable in a very sarcastic sense. Yes, older style of trading no longer produces good performance. And yes again, many trading methods are neutralized by the existence of bots. However, new patterns emerges from the very existence of these bots because they all behave in a very similar way. AI systems are no different. Given the technology are all based on similar toolbox, and that the obvious patterns are picked up by the AI systems one way or another, it is likely the AI systems will all behaviour similarly and go after very similar biases identified by them. In aggregation, they produce consistent footprints just like any other market participants.

So it is not necessary to stay at the forefront of technology or employing the latest trading gadget to make money in the markets. It is your overall approach to the market that matters. KISS still shines in the current trading environment. I know many size traders still focus on a few simple trading setups to make their living. The existence of these smarter AI bots changes the characteristics of many markets in the smallest timeframes only.

A Common Misconception About Day Trading Models

Lots of people spend all their time to discover or fine tuning a strategy so that it trades so many times to give them stellar performance like 300% or even 500% return per year. That may work but it is also dangerous to put all money on such models.

As I explained before in last instalment of this series, it is much better to emulate a good day trader who has multiple trading setups for which each one offers its own independent risk reward profile. It is the combination of these trading setups that produce a balanced approach to trading. With the right combination of these strategies, you get the same spectacular performance with much lower risk of complete melt down in performance like the single strategy approach.

Here is also the main concern with AI based bot traders. Unless you have a way to dissect the trading approach, you do not know the risk profile of each individual decision made by the system. You just know, as a whole, the machine trader you have on hand somehow perform great on the historical data. But we know they their were trained on those data, of course they would perform well on those data. You cannot throw a evolved model back in time to see if they would do well by the same reason.

If you train an AI system with certain part of the historical data, keeping the model not adaptive, it is then just the same old machine assisted discovery method. If you let the system retrain itself from time to time with new data, it is similar to the re-optimization mentioned above with the drawback of not able to gauge the historical performance. I think you get the point – machine learning is not perfect.

Summary

AI based bot traders are sexy for many reasons but they are far from perfect. If you know nothing about the underlying data and its characteristics, using AI to speed up your research is definitely the future as we are going to amass a lot more data going forward. However, it is not going to do you any good if you are an amateur in trading hoping that you can simply train the machine to do the job for you. Your have to be a good trainer (not necessary good trader) to make your trading bot a good trader.

At this point, it should be quite clear where I stand on the subject. I use AI to assist my research. I also use AI based models to warn me of potential changes in the market dynamics. I like the technology as it saves me time on data mining and other tasks in research. But I do not deploy trading models that are based on AI only. I prefer the KISS approach because I need the transparency and consistency with the models so that they are much easier to manage. It is a matter of personal preference. Maybe I have paranoia on AI just like Musk.

Better Time Management, Back to Content Curation and the Big Secret Projects

golden egg

Over the past several weeks, I have reorganized many things that I do into tasks delegated to either my team or contracted outside companies. The goal is to further reduce the amount of time I spend on managing the websites and day to day responsibilities in running these sites and services. I think I have achieve the milestone of taking back my time finally where I can focus more on what I deem most important going forward.

Part of this saved time will allow me to restart the content curation for Essence of Trading. Many of you enjoy the videos and product reviews I did in the past. They are precious resources of all traders and especially true for beginner traders. Now that I have some time on hand, I will be able to add new content and finding ways to better organize the site for future expansion. I am doing this also because of its practical purpose. Seriously, I don’t think I can ever write enough on the subject of trading and managing one’s trading business. Having the site dedicated to providing useful information for traders makes it much easier for me to point the aspiring traders to a centralized resource.

Here is the first new video for a long time.

This gets me thinking. Maybe the academia links I used to provide in the Daytradingbias user forum should be moved here too. After all, those are very valuable trading related research too. Will see what I am going to do with this soon.

Many readers and friends have been asking why there has been nearly no new posts on DaytradingBias but mainly the monthly newsletter and special updates. Well, I am not lazy and let the site goes autonomous. What happened is something quite interesting that has taken a life on its own.

I was writing a whole set of articles on trading Emini / SPY and forex some two years ago. And things were going very well. They were written with focus around two main themes – fully mechanical trading models based on a framework and long term consistency in trading performance. One way or another, as the work keep expanding, the articles turned into two organized projects that is way beyond just articles to be published on the site.

Part of this project is now in experiment for live trading which formed the foundation of my re-organized trading service for my clients. This firm focuses on providing long term stable return that is built on short term consistency in trading performance. I am very excited with the potential.

These two projects are still under development. Most likely I will release them in some form of training course or webinar. Lots of work still before I can release them but I know they will change the landscape in trading training forever.

Trading Product Reviews Have a New Home

The moving of the trading product reviews from DaytradingBias.com to EssenceofTrading.com is now completed. It took a while because the rating system has to be replaced and the formatting of the posts have to be manually revised. Anyway it is now done so we are going to proceed with the next step of the revision process.

Major changes to the front page will be next as we remove all the sections there that are retired from the site. The clean up has been a slow and painful process since the site was built some 10 years ago and has been evolving on the same older platform since. Upgrading the site into something more mobile friend should improve the overall usability going forward.

For more advanced searching options on the trading product reviews, they will be addressed separately.

Feeling Stupid

iStock_000012711518XSmall

We were working on a computer with Multicharts to test our trading models on a live trading account this morning. But we were stuck at the very first step. We just couldn’t get the damn thing to connect to CQG for some mysterious reason. My team freaked out as that computer was completely clean installed for just this purpose. And it was working perfectly several months ago. Once we have it working we never look at it again until now.

So WTF gone wrong?

I was told that it was not working earlier in the morning so I simply asked my team to figure it out. I thought it must be something trivial and told them so.

The first thing they tried was looking for help. My team talked to technical support with the brokerage. They recommended us to turn off the firewall, opening ports with our routers and even turning off our anti-virus program. All things were done. Nothing helped.

My team were so desperate that they literally tweaked everything they could before talking to me again that they could not fix the problem.

I then joined them walking through everything they had done so far.

Something did not feel right though … and I popped the question,

“Is everything up-to-date?”

Shockingly, that damn Multicharts installed on the computer was on version 9.1 BETA.

I asked my team to check with the brokerage again to make sure that version still works. Of course, it is not and the currently supported version is version 10. My team waited anxiously over the next few moments for the download to complete and rushed to do the installation.

Voila! Problem solved.

What a reminder of overthinking and missing the most basic things by a group of accomplished programmers and engineers. Not just them, same goes for the support with the brokerage.

If I were the first person handling the situation, I would probably do the same whole routines of messing with the computer and the network. Lucky me that I was the one who sit out of the diagnosis process and got to join them later with a fresh look. Otherwise we would still be struggling at this point.

At the end, everyone has a laugh though.

Site Revision Progress

This week we have completed the move of one set of articles from DaytradingBias.com into a separate website, Essence of Trading. Obviously, the site is for the publishing of the article series bearing the same name. I expected to write more articles for the site whenever I find the right topic.

The original Essence of Trading articles are now redirected to the new site to avoid duplication. So don’t be alerted that you are redirected there. In the meantime, I have the tedious task of reviewing and editing the articles on the new site to make sure they have the correct formatting, etc.

In the future, I will invite other successful professional traders to pen articles for Essence of Trading. Many of my trader friends are not the type who enjoy the spotlight hence don’t hold me responsible when I come up empty handed on this pursuit.

More changes are coming to DaytradingBias.com as we are streamlining the design to prepare for the launch of the new real-time trading signals and trading models.

I will keep you all posted.

Have a nice weekend all!