My Journey to Fully Automate My Trading: Peaceful Launch of My Automated Trading on TradeStation

image

This past Monday, Feb 25th, I finally managed to get small part of my automated trading strategies ready for live trading on TradeStation. It was one hell of a long journey to convert my algorithms from my custom trading platforms onto a retail broker platform. I learned a lot from the process and gained incredible insights into some many areas in trading that I thought I already know.

As the Chinese proverbs say,

The journey of a thousand miles begins with one step –  Tao Te Ching, Laozi

千里之行,始於足下 – 道德經, 老子

The moment I decided to move onto this path, I know it is going to be a huge commitment on my part to get to the finish line. So many obstacles and road blocks making this project such a huge challenge. I just looked up my blog posts and found that the earliest post about my intention was back in March 2017. That was two years ago.

I was so overwhelmed by the difficulties that I kind of giving up to write about the progress. There are just so many issues to tackle in various areas of trading making it hard to decide on what to write about. I did not write about it but I do keep notes on everything. That’s my habit all these years. I even recommended the practice to all traders in my writings all the time.

This is not the end of the journey though since my goal is to convert multiple sets of algorithms into live trading strategies that work on various retail platforms so more work has to be done.

I am very glad that I have chosen to walk down this path. At this point of the journey, majority of the technical issues are now taken care of. I am at a happy place to say that the rest of the journey will focus on more strategic development of my automated trading. I will have time freed up to catch up with writing about this amazing experience.

I am setting up a page in my blog for this series finally,

https://thelawrencechan.com/my-journey-to-fully-automate-my-trading/

Enjoy the show!

Back to Canada

Aircraft

I came back to Canada last weekend. Lucky that I do not have jet lag since I had to jump on top of several issues that night I landed. Been ultra busy since to catch up with so many things. At 2 am Saturday, this is the first moment I have some quietness to sit down and reflect on my experience from the trip.

What I Did in Asia

For majority of people travelling to Asia from North America during the year end holiday season, they are taking a vacation break. For me, it was essentially 12 hours work day pretty much everyday since the first day my flight landed in Hong Kong. Those exceptions are taking a detour to Singapore and other destinations, attended a wedding and had a special medical check-up.

Outside of trading, I invest in start-ups and do deals that interest me. Many people want to meet with me to see if there is any business opportunities. Others are looking for macro level financial advice from someone who is well connected and really know what is going on around the world. And occasionally, there are others with special reasons that have very interesting stories worth telling when I get the chance.

Going to Singapore to meet with several DaytradingBias.com members was the highlight of the trip. Very happy to see some new faces and those I met with the year before. It is nice to get to know you all better in person!

The Dilemma of Hong Kong

Hong Kong is in a very difficult position now than ever.

The unaffordability of living spaces for the middle to lower income families continue to get worse. Imagine how difficult it is to live in the city when the lower bound of around $18,000 HKD per month for a tiny 200 to 300 sq. ft. apartment in an average location. The same amount of money in Canadian Dollar is about $3,000 which can get you a decent space in a good location for a 1,800 sq. ft. condominium or an even bigger town house. Such compression of available living space has squeezed the life out of the people in Hong Kong. The so called middle class is now long gone.

Yet Hong Kong is still ranking as one of the top cities in the world for business opportunities. However these opportunities may not be accessible easily to those who are struggling at the bottom. Hong Kong is still a good playground for people who has the right connections and the necessary capital.

Everyone there seems to be more sensitive to opportunities in making money than anywhere else I have visited on Earth.

YouTube

I did a pro bono presentation titled “Investment Outlook 2019 according to STOPD” in Hong Kong at the Rotary Club of Kowloon Tong meeting on Jan 7th. It lasts about 2 hours and I did a powerpoint presentation for the event. The participants tried to capture the session in video. However, the voice recording was not as good as we hope for. Lessons learned from the experience and next time I will use a mic for direct recording separately.

The presentation was done in Cantonese so not everyone can understand it. If you want to watch the video (it is just me talking without the powerpoint slides), follow this link.

I am having the powerpoint presentation redesigned for YouTube. Once it is ready it will be uploaded. I will write a short article to explain some of the slides that may not be self explanatory.

If this approach works out well, I will try to do more videos in the future.

Planning Ahead

I have a line up of projects to be completed this first quarter. Talking about being busy in Asia, that was mainly meetings and brainstorming sessions. Here, back home, it is actual work to be done.

The 2nd edition of Trading Success Blueprint was ready …. until it is not. The trouble with the file format issue (Thanks Microsoft!) set me back couple of weeks until the pictures in the manual are restored back to the correct places within the manual. It will be done eventually.

Trading account applications that I thought was taken care of before I leave for Asia turned out to be half done. There is no mistake on my part, just that the brokerage side somehow were in party mode by the end of the year and failed to handle the matters properly. More waiting on this front.

The last pair of VIX based real-time trading signals / day trading strategies will be released for Emini S&P. This is under testing in real-time. So far so good, everything looks on track.

The manual that I expected to publish on these VIX based trading strategies is now going to be split into two manuals as suggested by one of the early readers. I am convinced because he actually did the split up for me and showed me that I was mixing up two different things into one. Namely, there is about 100 to 150 pages of manuscript written on day trading strategy design and principles that has nothing to do with the VIX trading methodology. He suggested that I turn that part into an independent volume with day trading strategies illustrating how it is done with just price data alone.

I think it is a great idea. So back to the drawing board and more work to be done. The good thing is, this additional manual will definitely resolve many issues for traders and giving them a head start in the day trading game. I will make sure it becomes an important trading manual for all Emini traders.

Good to be Home

I was asked how can I take on so many projects at the same time. Well, first, I am not doing all these things by myself. There are many others helping me out making all these things possible.

During the trip, my exercise regime is disrupted and my diet is not optimal to say the least. And I was loaded up with coffee throughout the day making me hyper (as evident in the presentation video). I just slowly re-introduce myself back into my rigorous routines since I have several goals related to health and physical fitness that I like to achieve. Will write about this front when I get the time.

I thought I would have time during the trip to post something. I ended up taking notes that filled one whole notebook with no time to spare. Interesting experience to pick up the pace and doing as much as I can with limited amount of time.

Feels great to be home.

For those of you who celebrate the season, Happy Chinese New Year!

On the Road Soon. Meet Up and Gathering Anyone?

close up of burning fireplace at home

I expect to hit the road next week. I will be going to Hong Kong and Singapore to meet with my business partners and give out talks about the markets and trading. My schedule is not as crazy as the last few trips. So, here I am letting you all know that if you are interested, we can meet up in Hong Kong or Singapore.

It does not need to be all intense discussions about trading and market directions. We can just chill and get to know everyone.

It will be fun!

Busy Busy Busy … Waiting for 2019 in Excitement!

03F34236

I have not posted for a long while here in my own blog. Feel kind of guilty for being so quiet. Here’s an update of what is going on in every front.

The Site Update

DaytradingBias.com has finally got its long deserved update. It is now mobile friendly and ready for the next level of client support. I am very happy with the result so far. I have in store big plans for the site in year 2019. I will announce the new services and products when they become available.

Trading Success Blueprint 2nd Edition

My trading course Trading Success Blueprint has been very well received since its launch. Many long time premium members sent me feedback that something important is missing from the manual. I hear you all and I have just completed three new sections to the manual for its second edition release. Once they are edited properly, it will be made available to everyone who bought the first edition.

In fact I am turning TSB into a live project! I am offering lifetime update for free to anyone who purchased the course. I am also making available a special support area online so that users can download strategy code and other things much more easily. And third edition of TSB is already planned. It will fulfill another request – a forex day trading strategy example.

My Fund

My work on my fully automated fund is 99% ready. I have decided to launch it sometime in January. It is very difficult to port trading strategies created in NeoTicker into various trading platforms. So much of my time was wasted in recreating the multiple timeframe framework in these other platforms. Right now I have everything necessary to move forward with this project.

My Trading Service

A version of the trading model will be made available through brokerages. I will have more details once I have completed the process. For those who expressed interest in the past and present asking me to manage their money, I am very flattered. I think this will be the best way going forward allowing everyone to participate. Due to liquidity issue, the model will be released with strict control on the number of contracts I will allow through the brokerages.

Yet to be Named Course on Advanced Trading Strategy Design using VIX

For those of you who want to learn more on how to create these trading strategies I am using myself, I am still working on the course right now. It is already longer than the 2nd edition of TSB excluding those appendix stuff. It is like an extension of TSB with focus on how to design trading strategies suitable for day trading purpose. I also provided an in-depth look into VIX and its leading properties for swing trading and day trading. It will be the next most important course for anyone interested in building their trading career.

Workaholic? Maybe …

Over the past 2 years, due to various reasons from computer issues to platform glitches, many of the projects I am working on were grind to a halt. Well, by pushing things forward slowly with patience, the efforts finally pay off. It is very exciting to see so many things getting through the finish line at the same time.

When Everybody is Wrong

image

My Big Picture Summary for DaytradingBias.com Market Bias Observer newsletter, Aug 2018 issue. With charts!

The large hedge funds have been underperforming the markets for several years already. They look so bad that many gurus out there came out slamming the industry as a whole. Well, even David Eihorn’s Greenlight has reported his fund is down about 19% for the year. Is the era of big hedge funds really over?

Don’t forget that these funds have all the resources to hire the best to work for them. They have access to information that retail investors and even institutional investors do not have. Yet, the results clearly pointing to something going wrong. So what goes so wrong?

My understanding is that these famous hedge fund managers are actually very good in what they are doing. The main problem is that they all depends on the framework of top-down analysis based on their specific macro view to allocate their resources. If their macro views do not lead to the correct forecast of the market environment, everything they do, will be at best crapshoot. That’s the very essence of trading and speculations. You do not win on every single trade.

image

Since the year 2013 when the S&P 500 is set up to breakout above that long time boundary at 1600 and that Nasdaq 100 making new all time high, we have entered a new era where the prior 20 years of trading environment is transformed into something new. That shift of expectations created a unique situation for which the shorter timeframes have now dominated the price movements of almost every financial market.

image

We have seen such environment before, and the pros who are not close enough to the price actions suffer. For example back in year 1999, majority of the pros working for big firms were laughed at because they cannot make money in the so-called easiest trading environment because the stock market went up pretty much every day. Pros are beaten up so bad back then many even give up their career in the industry.

But we all know what happened afterwards. When the new era eventually run its course, like in year 2000, the normal environment would return. The shift will cause chaos and the pros will be the ones who survive.

I dare to say this, when even the best hedge fund managers are not doing well in shorter timeframes, it is a sign that the bull market is going to end pretty soon.

So Many Things Finally Done, So Many More Things to Get Done

top1_investing_amazon

Last few months has been the most productive ones over the past two years. So many projects that have been stuck were finally completed. What a relief!

For one, my book The Art of Chart Reading is now finally published at Amazon. Thanks to everyone who support the book this week, I am proud to announce that, as of this Friday, it is the Top #1 book at Amazon in Investing and Investing Basic categories and also being one of Top 20 Nonfiction books. It is a great start for the book.

The paperback version of the book is still being worked on. If all goes well, the paperback edition will be available by end of this month.

And the site The Art of Chart Reading Online is also in development. It will take a lot more to make it good for the purpose I envisioned.

On DaytradingBias.com side, the move to the new direction has finally started. It was planned at least a year ago but almost everything that could go wrong, did. Although the process has started, it is not even half way through.

It is great that the Trading Success Blueprint is finally completed. It is the grand summary of my knowledge and experience in mentoring traders over the past 20 years. From now on, I have a reference that I can point aspiring traders to if they want to build a trading career the right way.

Yet, the trading signals and trading tools that I have planned to release have been delayed for so long. I could not just roll them out without proper testing. Due to the frequencies of these trading strategies, they do not happen everyday. I need to make sure they are working correctly. It is not only necessary. It is a responsibility as well since people will put money on the line based on these tools. Thus, I have to be patient and get them ready one by one.

On money management side, the process of fully automating the trading has started too. However, it was the most eventful two months we have seen in a long time. Be that North Korea related matters, or all these explosive news about Trump, they swing the markets hard. All these happening while I am manually testing these strategies. It is a huge challenge for someone like me because I created these trading models.

The golden rule of mechanical trading is to follow the rules exactly. But being the creator of the models made me want to override them. After the fact, my interventions worked 9 out of 10 times. But the 10th time is a disaster. In short, if I had followed the rules completely, the performance will be about the same as what I have now. Being 20% better with all the crazy maneuvers is not worth it.

Again, a lot more to do to complete the transition.

oh well, challenges make life interesting.

Story of My Book The Art of Chart Reading

Finally, after three long years of wait, my book The Art of Chart Reading will be available at Amazon in couple of days. I am very excited about the release of the book. But at the same time it feels like putting an end to a very difficult period in my past. Very difficult to explain how I feel at this moment.

aocr_3d_small

I have created a website for the book called The Art of Chart Reading Online. The purpose of the site is to showcase charts that I study and how they work out afterwards. Since I do my homework studying the charts all the time anyway. This should not put too much workload on my tight schedule.

This book would not be possible without Priscilla’s suggestion some 15 years ago. She knows very well how I feel about the financial industry and how much I hate seeing decent people being rip off in the stock market. She popped the idea that if I can do something about it what would it be. I told her it has to be a complete instruction manual on how to read the charts because it is the only tool that the retail traders have access to that is objective without spins or lies.

Priscilla became the first reader and my collaborator on the foundation sections. Only until I was able to make her understand exactly how the charts work, that those explanations are kept in the book. That’s how I know other people will understand the framework too.

Surprisingly Smooth Transition into Windows 10

image

I spent the past two weeks setting up a new laptop due to the unfortunate event that my original laptop being crushed in the plane while I was traveling back to Canada. Since I do not need my laptop during this period of time, I can use my desktop computer while setting up the new laptop slowly. The experience with the transition from a Windows 8 laptop into Windows 10 is, surprisingly, good.

The Incident

I use a backpack when I travel and my laptop is stored in the part for which thick protection foam is there all around it. I thought it is safe from physical harm. I could not be more wrong this time though. First my backpack was moved away from the overhead compartment where I put it due to someone else having a huge luggage forced the flight attendants to move luggage around to accommodate that. My backpack was moved somewhere else before i can even try to grab it back.

By the time the flight was over, I tried to locate my backpack. It was squeezed down under two hard surface carry on trolleys. I thought it should be alright because nothing bad really happened to my laptop ever through all these flights over the years. I could not be more wrong.

When I arrived home, I found a corner of my laptop was totally crushed. Amazingly, the laptop is still functional and boot up fine. The catch is that two of the ports I needed most are no longer usable.

A hard lesson learned – never store your laptop in a soft shell container.

Finding a Replacement

I am never comfortable with new versions of Windows. I wrote about that many times over the years. Microsoft is infamous in destroying compatible with everything from hardware to software with new versions of Windows. My experience was so bad I never buy a new computer with new versions of Windows. This time, however, I have no choice.

Microsoft has determined that they cannot continue to support their older versions of Windows. Windows XP and the major disgrace Vista are now discontinued from normal support. Windows 7 is still supported but probably not for long. Hence, it is very diffficult to buy any new laptop with older versions of Windows.

First, I would not want to buy a laptop with Windows 8 ever again. That leaves me with only Windows 10 to choose from. I thought, what the heck, Windows 10 is around for sometime already. Everything should be working fine now. Is it?

The Transition

It is not that easy for a road warrior to switch to a new laptop. This is especially true for professional traders. We have so many applications to install onto a computer, it takes a lot of time to get it done. This time around, it took me like a week to have all the necessary configuration done on Windows and the essential applications installed. The more auxiliary applications can wait.

Core applications like Microsoft Office has to be installed. I am very glad that my Office Enterprise 2010 still works on Windows 10. There was a point in time that Microsoft tried to force everyone to use the stupid Office 365. As a paid customer, I seriously cannot accept their proposition that I have to pay up again, as a subscription, that has no added value to my need. As far as I recall, I have been a paying customer of the Microsoft Office software since I was studying in university. Microsoft has to give me a very good reason to pay for another upgrade.

Many other applications are not working well on Windows 10 due to the Smart Scaling issue. That includes quite a number of trading applications. Smart scaling is the changing of pixel density dynamically so that the display device can show you things that you can really read. Given the laptop I get has 4K resolution, if the application is displaying its content using the pixel based method, it will be so small that I cannot see what is displayed at all.

Luckily, Windows 10, after several updates, has find a way to resolve this issue by offering multiple compatibility display options. I got two trading platforms working but one is still in trouble. I will not name names here. I think it is better I report the issues to the developers and see if they manage to come up with anything like a workaround or a quick new release to address the issue.

My Impression

I like Windows 10 a lot on this new laptop. Well, part of the reason is that the new laptop is very impressive on hardware basis alone. On the other hand, Windows 10 gives me a much more comfortable feel in terms of control and flexibility. Windows 10 is delivering what Windows 8 intended to do but failed to do so – a new paradigm without sacrificing the core power of Windows over platforms like Macs. Windows has always been a workhorse type of platform and it is the favorite platform for businesses and large enterprises. Windows 8 deviated from that (so did Vista) and it has been part of Microsoft’s painful memory since.

The truth is that I have to make a lot of adjustments to my usage routines from the last laptop but I am happy to make the transition this time. Unlike last time when I was forced to switch to Windows 8 and took the plunge to change all its settings to mimic Windows 7, I am happily learning to work within the new Windows 10 workflow. Part of this obviously thanks to all the software companies making the transition easier by having Windows 10 compatibility taken into account. The other part is that Microsoft learned from its users what has to be done to make Windows 10 functional.

Email Server Down

Those of you trying to reach me through email have to wait until my team finish repairing the email server.

Looks like hardware problem so until the faulty hardware is replaced I am stuck on web access to my email which can be a pain in the neck to actually find the real emails to response to.

My guess is that it can take another day or two.

When Card Counting Fails: Learn to Walk Away While You Can

roulette2

When I was in Europe last month, it was inevitable that I had to go out and socialize with my business associates. One such night we ended up going to a club with blackjack tables. One of my friends there knows very well I am an avid card counter and would like to see if I can beat the house. So there I was, sitting at one of the blackjack tables with couple hundreds of euro in chips to play the game.

The Game

I asked the dealer like how many decks are there and started playing.

I did my usual counting and noticed that the cards dealt out were collected and put back into the card dealing machine. I knew something was not right but I could not recall exactly what it was at the time, partly due to all night wine and dine activities.

Needless to say, I got cleaned out.

Whenever I tried to increase my bet size, thinking that it was the right time to do so, I encountered significant losses.

The chance for me to count wrong was very low. So low that I knew something did not add up. After I lost my last chips, I recalled exactly what I should have remembered before I started playing.

My associates asked me to keep on going so that I can win the money back. I told them I don’t want to do that because I was low on cash. In reality I had more than enough cash to keep going but I knew better not to. My friends even tried to pool together more cash for me to do it again because they probably feel bad that I lost money.

I ended up telling them the truth. I pointed out the machine on the table is something I cannot beat. Since I do not like playing blackjack to lose money, I told them we should do something else instead. They were quite upset and were afraid that I was unhappy. I had to assure and reassure them that I am perfectly alright.

I was secretly relieved that I did not need to grind at the table. I was happy because I knew this is the right decision.

The Machine

The issue I pointed out being the card dealing machine was not an excuse. This type of card dealing machines is designed to save time for the dealer, prevent cheating through manual card shuffling and, most important of all, to beat card counting. Cards are consistently redistributed back into the shoe hence the chance of these cards showing up again, say, five hands later, would be the same as all the other cards within the machine. There is no more distribution imbalance that a card counter can rely on. Thus, all card counting strategies based on the cards not being reused until next complete reshuffle would fail.

I should have walked away the moment I sit down at the table and noticed that the machine is in place for dealing cards. But I did not.

I suspect that my inability to recall the important fact about the card dealing machine is my commitment bias. I changed my Euros for chips. I sat down at the table. And most important of all, I have a crowd around me watching. My mind swing from being a careful pro into a casual player.

The Crowd

Emotions ran high when the crowd saw the dealer’s hand busted at the fourth and fifth card. Emotions ran even higher when someone on the table getting 21 on the fifth card.

Of course, emotions swing low when the dealer managed to clean the table with 20 or 21 even though many players had pretty strong hands.

Everyone has been participating in the game, with emotions invested into every card being dealt out.

I could see on the face of everyone that they were emotionally exhausted about an hour into the game.

Isn’t it interesting that we all know this is a game of chance yet we would cheer on wishing the dealer to go bust, or that some players were so anxious that it took them forever to decide whether to hit or to stand?

Maybe this is the very reason some people love gaming.

They enjoy the emotional rides and excitement that these games bring to them.

The Odds

Going a bit technical here, I will explain what the difference is between a normal Las Vegas style blackjack and the one I played with the card dealing machine.

In short, the Las Vegas style dealing will give the house a very slight edge over the players if the player is not counting cards, while exercising all normal cautions like not to hit when you cards already total at 20. With a good card counting strategy, a player can, at times, having a significant edge over the house when many high cards are left in the shoe leading to very uneven distribution.

For the card dealing machine I played, it actually offers the players a very minute edge, as long as the player is exercising the normal cautions. This means, if you have a big enough bank roll, you can win a small percentage of your capital as long as you are betting with the same size. Obviously, the goal of using these machines is not to beat the players. These machines are installed for the purpose of facilitating a service, to keep the guests entertained.

However, if a card counter is not aware of the design, the uneven betting based on the wrong projection of the existence of a bias distribution, will lead to unnecessary losses.

The Lesson

It is a good reminder to us, the professional traders, that we manage to make money in trading because we have good strategies and game plan in place. However, we have to be aware of the changes to the game itself that may completely alter the odds of our trading strategies. Keeping up with the environment change is very much part of our responsibility as a pro trader.