Smart-beta funds don't live up to the backtesting

Smart-beta funds don't live up to the backtesting
An academic study finds strategies that outperformed on paper disappoint once they're packaged as ETFs
SEP 03, 2020

It’s every quant’s nightmare: Trades that look good on paper break down in the real world. And in the $1 trillion business of smart-beta investing, it’s happening on an industrial scale.

According to a new study, hundreds of strategies that showed significant outperformance in backtesting are failing to live up to their hype once they're packaged and sold as exchange-traded funds.

The average above-market return for smart-beta strategies is 2.77% per year before they are listed. That flips to a loss of 0.44% after fees once they actually become ETFs, according to researchers Yang Song at the University of Washington and Shiyang Huang and Hong Xiang at the University of Hong Kong.

“The Smart Beta Mirage,” by Shiyang Huang, Yang Song, and Hong Xiang. Via SSRN.com.

“Stellar performance only exists in backtests and has no indicative power for ‘real’ performance,” the authors wrote. “We find strong support that data mining in backtests accounts for the performance deterioration.”

In other words, ETF sponsors are finding strategies that worked brilliantly according to their historic data -- but that aren’t working now.

Of more than 700 U.S.-listed smart-beta ETFs, about 60% have undershot their indexes since the start of this year, according to data compiled by Bloomberg. The median fund has lost about 1.5% on a total return basis, compared with a more than 10% gain for the Vanguard Total Stock Market ETF.

UNDER FIRE

The booming smart-beta industry accounts for more than a fifth of the $4.8 trillion U.S. ETF market.

It’s a blend of active and passive investing that seeks to deploy popular quant strategies in an ETF wrapper. Rather than weight stocks simply by market capitalization like a vanilla index fund, it typically uses factors such as how cheap they are or their growth potential.

“The Smart Beta Mirage,” by Shiyang Huang, Yang Song, and Hong Xiang. Via SSRN.com.

The research, titled “The Smart Beta Mirage,” is the latest in a series of criticisms leveled at industry, but smart beta still has plenty of advocates. The strategies used by the investing style are designed to work over the long term, so periods of underperformance are expected and deviation from the benchmark is practically by design.

Smart beta fans like Rob Arnott of Research Affiliates have repeatedly argued that the basic concept of breaking the link between market capitalization and weighting in a portfolio still holds good -- even if the industry’s breakneck growth has stretched the definition.

Nonetheless, the new study’s findings echo much earlier observations in the ETF sphere.

white paper from Vanguard Group in 2012 identified a pattern among indexes created for fund launches using backfilled performance data in which most fared well before inception but generated weaker returns once turned into ETFs.

Latest News

FINRA eyes fraud 'speed bump' rule doubling hold to 10 business days
FINRA eyes fraud 'speed bump' rule doubling hold to 10 business days

FINRA's proposed rule filing would create a new 10-day fraud delay and nearly triple the maximum hold period for exploited senior investors

MAI Capital pushes into Atlanta with Waypoint Wealth deal
MAI Capital pushes into Atlanta with Waypoint Wealth deal

Fueled by a recent shot in the arm from private equity firm Carlyle, MAI adds a $490 million Atlanta RIA as it keeps building out its national footprint.

Georgia advisor gets maximum – 20 years – for $400 million Ponzi
Georgia advisor gets maximum – 20 years – for $400 million Ponzi

“Todd Burkhalter organized what is likely the largest Ponzi scheme in Georgia history,” said one FBI official.

Carson taps Osaic recruiting veteran as independent channel expansion continues
Carson taps Osaic recruiting veteran as independent channel expansion continues

With experience from Goldman Sachs and TD Ameritrade, the RIA's newest SVP hire adds to a recent wave of executive departures from hybrid Osaic.

Mesirow acquires part of flexPATH in second retirement deal of 2026
Mesirow acquires part of flexPATH in second retirement deal of 2026

Chicago-based Mesirow Fiduciary Solutions adds flexPATH's plan-level outsourced fiduciary book, boosting its retirement market reach to $164 billion.

SPONSORED Direct indexing webinar targets tax-loss harvesting amid market swings

Northern Trust’s Ken Lassner shows advisors how to convert volatility into after-tax portfolio gains

SPONSORED Who builds the income when the pension disappears?

Dan Biagini of American Equity says the steady decline of pensions, longer lifespans and a reset in interest rates are rewriting how advisors build retirement income