SteadyOptions is an options trading forum where you can find solutions from top options traders. TRY IT FREE!

We’ve all been there… researching options strategies and unable to find the answers we’re looking for. SteadyOptions has your solution.

When Can You “Trust” a Backtest?


There's a joke in the financial industry that "nobody has ever seen a bad backtest". There certainly are bad ones, but nobody ever markets them. They just get thrown in the trash. Even academics can fall prey to this.

Although they may not be selling a strategy or investing concept to investors, they do have incentives to get their research published in academic journals that their peers may read and respect. There is also the financial incentive of job security by earning tenure at their university, for it’s“Publish or Perish” as the phrase goes. This means few, if any, are immune from the incentives to create an attractive looking backtest.


Does this mean we should dismiss all backtests? Certainly not, it just means we need a process, or series of scientific tests, that we run all our backtests through in order to keep ourselves out of trouble and from falling prey to good stories told by good salesmen. I must give credit where it’s due here. Both Dimensional Fund Advisors and the books and writings of Larry Swedroe have influenced my thinking when it comes to this topic. It might be more accurate to say they’ve basically taught me everything I know. For those who want to go deeper, I recommend reading Larry Swedroe’s book, “Your Complete Guide to Factor-Based Investing.”


The 5 characteristics to look and test for when considering investments are:

  1. Persistent across time. The strategy or factor can be tested on long periods of historical data to increase statistical confidence. Larry Swedroeoften points out that the average investor thinks three years is a long time, five years is a really long time, and 10 years is an eternity...yet if you ask academics, they will tell you that 10 years is nothing more than random noise. For example, the S&P 500 returned -1%/year from 2000-2009. Would that have been a good indication of long term expected returns for buying large cap US stocks? Since then, the S&P 500 has compounded at more than 12% per year, which is better than its long-term average. This is similar to how in August of 1979 BusinessWeek wrote a cover story called “The Death of Equities” after the S&P 500 had experienced a similarly long period of poor performance. The S&P 500 went on to compound at more than 17.5% annualized for the next two decades, turning $100,000 into more than $2.6 million.
     
  2. Pervasive across markets and geographies. The strategy or factor holds up when tested on other markets and countries. For example, the momentum effect has been found to exist in stocks, bonds, commodities and currencies. It’s also pervasive across sectors and in the historical data of nearly every country.
     
  3. Robust to various definitions. An effect should still show up when constructed with similar parameters. For example, the value effect is both persistent and pervasive as well as robust to alternative specifications. Whether it's price to book, price to sales, price to earnings, price to dividends, price to just about anything...you find in the historical data that value stocks (low price relative to fundamental measurements) outperform growth stocks (high price relative to fundamental measurements) over the long term all across the world.
     
  4. Investable. The strategy exists not just on paper but survives real world issues such as manager fees and realistic assumptions for transaction costs. Many anomalies discovered in the historical data persist simply because they are difficult to implement at size in the real world. Academics refer to this as "limits to arbitrage,” where an anomaly persists in the data because it's difficult or impossible to actually implement at scale and therefore it’s really only a paper illusion.
     
  5. Intuitive. Does the strategy make intuitive sense with (preferably) a simple risk-based explanation or,at minimum, a logical behavioral based explanation? For example, the market factor (stocks producing higher returns than T-bills) has persisted for decades even though it's as "well known" as anything there is. Since everybody knows about it, why doesn't it get arbitraged away? The Sharpe Ratio of a total stock market portfolio has historically been around 0.4 which means that it works over time, not every time. Not only do stocks occasionally underperform cash over 3, 5, and 10-year periods, they can do so by A LOT (S&P 500 example in #1). The same is true of all other academically accepted factors like size, value and momentum.  For this reason, investors who have a sufficient time horizon and self-control should invest for these higher expected return investments.

Now, which factors pass all five of these tests to give investors sufficient confidence that the effect being captured is at least likely to persist in the future (although not necessarily to the same degree as in the past)?Larry Swedroe only recommends constructing a portfolio with a handful of well-researched factors including (but not limited to):

  • The market factor (stocks have higher expected returns than cash and bonds). Risk based explanation.
  • The term factor (bonds with longer maturities have higher expected returns than bonds with shorter maturities). Risk based explanation.
  • The size factor (small caps have higher expected returns than large caps). Risk based explanation.
  • The value factor (value stocks have higher expected returns than growth stocks). Both risk and behavioral based explanations.
  • The trend/momentum factor (stocks and asset classes that have outperformed over the last 6-12 months have near term higher expected returns than stocks and asset classes that have underperformed). Behavioral based explanation.
  • The volatility risk premium factor (also known as the insurance risk premium…selling financial insurance in the form of puts and calls has positive expected returns). Risk based explanation.

Conclusion

When investors understand the concepts discussed in this article, your investing life will never be the same. Using this checklist dramatically improves the odds of success and can keep investors from falling prey to a good sales pitch or chasing short term performance.
 

The real opportunity now becomes the portfolio construction process. We now know that the pursuit of traditional active management is largely a waste of time and money, because any manager or backtest performance can be largely explained by exposure to these well-known factors that can now be accessed at low or at least fair costs. These factors discussed have low correlations to one another, so diversifying broadly across them dramatically reduces the risk of your total portfolio. So much so that modest amounts of leverage may be appropriate for those with the patience and perspective to seek higher expected returns.

The biggest risk of a portfolio diversified by factors becomes more behavioral, where your portfolio will at times perform far differently than conventional market benchmarks that are only exposed to the single factor of market beta. Since the purpose of investing should be to achieve your long-term goals with the least risk possible, this should be an acceptable tradeoff for a well-educated and well-behaved investor.

 

Jesse Blom is a licensed investment advisor and Vice President of Lorintine Capital, LP. He provides investment advice to clients all over the United States and around the world. Jesse has been in financial services since 2008 and is a CERTIFIED FINANCIAL PLANNER™ professional. Working with a CFP® professional represents the highest standard of financial planning advice. Jesse has a Bachelor of Science in Finance from Oral Roberts University. Jesse manages the Steady Momentum service, and regularly incorporates options into client portfolios.

 

 

What Is SteadyOptions?

Full Trading Plan

Complete Portfolio Approach

Diversified Options Strategies

Exclusive Community Forum

Steady And Consistent Gains

High Quality Education

Risk Management, Portfolio Size

Performance based on real fills

Try It Free

Non-directional Options Strategies

10-15 trade Ideas Per Month

Targets 5-7% Monthly Net Return

Visit our Education Center

Recent Articles

Articles

  • Bullish Short Strangles

    A bullish short strangle sounds like a complicated strategy, but it’s really quite simple for those familiar with option terminology. A short put is combined with a short call to where the position starts with some amount of positive delta overall. This distinguishes itself from a delta neutral strangle, where both the short put and short call are sold at the same delta.

    By Jesse,

    • 0 comments
    • 51 views
  • Eight Mistakes Every Forex Trader Should Avoid

    The forex market is currently the largest financial market in the world and, due to its highly liquid nature and low barriers to entry, is only expected to grow. Becoming a forex trader requires minimal effort and with a decent internet connection, a laptop or computer, and some spare money to invest, you can start in no time.

    By Kim,

    • 0 comments
    • 47 views
  • Put/Call Parity - Two Definitions

    Put/call parity is a term options traders use to mean one of two things. The simplest definition and the one most applicable to most options traders compares the similarity in the bid/ask spread and the net debit or credit resulting from this.

    By Michael C. Thomsett,

    • 0 comments
    • 229 views
  • Put Selling: Strike Selection Considerations

    When selling puts, such as we do in our Steady Momentum PutWrite strategy, there are many questions a trader must answer: What expiration should I use? What strike should I sell? Should I choose that strike based on delta or percentage out of the money?

    By Jesse,

    • 0 comments
    • 260 views
  • What Can We Learn From UBS YES Lawsuit?

    News followers may have seen the recent stories on UBS being sued by its clients and investors who participated in UBS’s “Yield Enhancement Strategy (YES).”  Evidently, numerous UBS clients signed up to participate in an iron condor strategy that lost a lot of money.They’re angry, and they’re filing a lawsuit.

    By cwelsh,

    • 2 comments
    • 866 views
  • Pinning Down the ‘Option Pinning’

    What many people on SO have in common is that they have read the books of Jeff Augen on options trading. Although written a decade ago they continue to be an interesting source of strategies for the retail investor. Retail investors have particular constraints that make most of the broad theoretical musings on options rather moot.

    By TrustyJules,

    • 0 comments
    • 369 views
  • Holding Positions into Expiration

    "Every once in a while you must go to cash, take a break, take a vacation. Don't try to play the market all the time. It can't be done, too tough on the emotions." - Jesse Livermore

    By Mark Wolfinger,

    • 0 comments
    • 294 views
  • Tales Of How Big Trades Went Wrong

    One way to learn from your past mistakes is having to go through the painful and challenging experience of explaining them. Another way is to listen to others who might have lived through some disgruntling trades. Joseph Trevisani goes deep into the rationale he followed during the volatile EUR/JPY days of 2007 in this article.

    By Kim,

    • 0 comments
    • 303 views
  • Covered Straddle Explained

    The covered straddle is a perfect strategy for those all too common sideways-moving trends. When a company’s stock is in consolidation, how can you make trades? No directional trend exists, so most traders simply wait out this period.

    By Michael C. Thomsett,

    • 0 comments
    • 454 views
  • Why Doesn't Anchor Roll The Long Calls?

    Recently, an Anchor subscriber asked, “Why don’t we roll the long calls in the Leveraged Anchor portfolio after a large gain and take cash off the table?”  This question has a multi-part answer, from taxation to how the delta on a position works.

    By cwelsh,

    • 0 comments
    • 284 views

  Report Article

We want to hear from you!


There are no comments to display.



Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account. It's easy and free!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now

Options Trading Blogs