AMONG THE MORE notable studies published in recent years is a paper by Hendrik Bessembinder titled “Do Stocks Outperform Treasury Bills?” His key finding: Between 1926 and 2016, just 4% of stocks accounted for all of the U.S. market’s net gain. As a group, the other 96% delivered returns that were no better than Treasury bills, which returned just 2% a year over the period.
It was a surprising result. The implication: Diversification is even more important than most investors realized, because a portfolio that missed out on just a handful of the market’s best performers—the next Apple or Amazon—could suffer significant underperformance. The solution, of course, was easy: Because they cast such a wide net, total stock market index funds ensure that investors won’t miss out on the market’s next star performers.
But Bessembinder’s research posed a problem for investors interested in an investment strategy known as direct indexing, which has been growing in popularity. If you aren’t familiar with it, this is how direct indexing works: Suppose an investor wanted to own the S&P 500 but preferred to avoid certain stocks or industries—tobacco, for example.
With a direct indexing service, this investor could purchase all of the individual stocks in the S&P 500 with the exception of the two cigarette makers, Philip Morris and Altria. The portfolio would then consist of the other 498 stocks. With direct indexing, investors can customize portfolios along dozens of dimensions, screening out companies they prefer not to be associated with.
Direct indexing has been around for years. But because of the number of trades required to build a portfolio, and the associated brokerage commissions, it was too expensive for all but the wealthiest investors. That changed in 2019, when a host of brokerage firms dropped commissions on stock trades. Since then, a number of firms, including Charles Schwab, Fidelity Investments and Vanguard Group, have rolled out direct indexing platforms. This created a price war, which has made direct indexing accessible to more individual investors.
Investors interested in direct indexing, however, have faced a bit of a conundrum, thanks to Bessembinder’s finding that just a tiny fraction of stocks are responsible for essentially all of the market’s returns. If a directly indexed portfolio happened to exclude one of the market’s highflying 4%, the performance penalty could be steep.
Imagine a portfolio had excluded Nvidia over the past five years, when it has returned more than 1,700%. Through that lens, direct indexing looks potentially risky. But how significant is that risk? This has been an open question. But a recently published paper, “Exclude With Impunity” by Yin Chen and Roni Israelov, provides some insight.
Chen and Israelov employed a methodology known as back-testing to assess the risk posed by direct indexing. Using stock market data for a nearly 60-year period ending in 2021, the researchers compared the returns of the overall market—as measured by the 1,500 largest stocks—to the hypothetical returns of a portfolio that excluded some number of those stocks. They looked first at the results of excluding just one stock, then five, 10, 30, 50 and more, all the way up to 500. They then repeated the exercise 1,000 times, with a different set of stocks excluded each time.
The results were counterintuitive: Among the 1,000 scenarios tested, the median portfolio delivered results no worse than the overall index. This was true, surprisingly, even when several hundred stocks were excluded. Problem is, in “bad luck” scenarios—the worst decile of results where, for example, more than one Apple or Amazon was excluded—the results did indeed trail the index. The impact, though, was far more modest than Bessembinder’s work might have led us to believe. With 100 stocks excluded, the bad-luck scenarios resulted in a mere 4% reduction in portfolio value over a 58-year period. It was an almost immaterial difference.
There are some important caveats, though. While the impact of excluding 100 stocks was surprisingly modest, the results did deteriorate in the bad-luck scenarios when more stocks were excluded. With 300 stocks excluded, for example, the ending portfolio value in bad-luck scenarios was about 10% lower than if no stocks had been excluded. Chen and Israelov also looked at the impact of excluding entire industries. There, the range of results was wider, because the relative performance of industries is so different.
The bottom line: If you’re considering direct indexing for your portfolio, this new research should provide a degree of comfort. Suppose you’d like to exclude a handful of stocks or perhaps a few industries from your portfolio. The data indicate that you might not incur much of a performance penalty, if any. The key, however, is to be sure the exclusions you choose aren’t too numerous.
Want to exclude the two tobacco companies in the S&P 500? That’s unlikely to dent performance much. According to the “Exclude with Impunity” data, you could leave out as many as several dozen stocks from an index of 1,500 without introducing too much risk. But as a rule of thumb, looking at the data, I would draw the line at 100. Or if you go the route of excluding entire industries, I wouldn’t exclude more than four industries, out of the 49 total. This should limit the performance impact, even if one of the stocks excluded turns out to be one of Bessembinder’s star 4%.
If you’re still on the fence about direct indexing, there’s one more factor to consider: Direct indexing typically delivers a tax benefit which may help offset any impact from excluding stocks. Because a directly indexed portfolio consists of individual stocks, it’s much easier to sell tax-efficiently. Imagine you purchased shares in an S&P 500 index fund 10 years ago. If you wanted to sell some of those shares today, you’d be somewhat hemmed in. Because of the market’s strong run, the S&P 500 is up about 220% over the past 10 years, meaning you’d incur substantial gains on each share sold.
On the other hand, if you owned all 500 stocks in the index individually, you’d have far more flexibility. That’s because of the nature of averages. While the index has gained 220% overall, approximately 250 stocks have gains smaller than that. Indeed, 30 stocks have losses over the past 10 years. The upshot: If you owned these 500 stocks individually and were looking to sell shares, you’d have much more ability to control your tax bill. At the same time, if you were charitably inclined, you’d be able to select the most highly appreciated shares to donate to charity, thus sidestepping capital-gains taxes.
Adam M. Grossman is the founder of Mayport, a fixed-fee wealth management firm. Sign up for Adam’s Daily Ideas email, follow him on X @AdamMGrossman and on Threads, and check out his earlier articles.
Want to receive our weekly newsletter? Sign up now. How about our daily alert about the site's latest posts? Join the list.
In Schiller’s financial markets course at Yale (available on coursera), he discusses the question slightly differently. The question he asks is how many stocks (diverse investments) it takes to realize most of the benefits of diversification. The figures I remember him citing are 90% of the benefit for 20 and 95% for 25. (Yes, I know! Not even 100, much less 500 or 2000.)
While the fear of missing out is real and I don’t own Nvidia, I can say that there has been no great difference between my list, the S&P 500, and the DJI over various time frames.
It is interesting to me that investors will balance their portfolio with bonds, but not be content with an investment like SCHD (dividend ETF, owns 100 stocks) that strikes a middle road between the “whole market” however it is defined and the radical diversity of owning both bonds and stocks.
While I do benefit from selective tax decisions, the main benefit I find in direct “indexing” is my ability to lower my fundamental risk (at some expense to my statistical risk!) while still reaping an aggressive return.
For the buy and hold investor direct “indexing” was a reasonable possibility for a moderately large portfolio size in the years when commissions were discounted but still charged, say the decade or two before 2019.
Constructing an “index” is helped by the fact that very large companies are themselves extremely diversified, with properties, markets, and products spanning the globe, vertically integrated, et al. In addition, any investment analysis, like what Schwab offers for free, will provide a list of ten or so categories of companies in the indexes and an indicator of how any portfolio compares to the overall market.
Thanks for sharing, Steve. I appreciate the comments.
I haven’t seen Bob Shiller’s lecture. But it’s important to distinguish volatility from tracking error. With 20 individual stocks, you can create a portfolio that isn’t much more volatile than the broad market. But you may still get annual returns that differ sharply from the broad market’s — for better or worse.
Increasingly, I believe simple is good.
World index funds, some bonds, a little bit of cash…..re-balance once/year.
Long term.
Simple and boring.
Agreed, JGarrett. Slow and steady.
The important thing is to save money, and invest in something. A wide variety of strategies will give you good returns. So what if you under-perform the so-called market – OK, you have $5 million instead of the $9 million you could have had. Is that so bad? There are many ways to make money through investing, and the important thing is to do the saving, and then invest using a strategy you feel comfortable with.
It’s a good point, Ormode. It’s important for folks to remember that, if they can just focus on the basics (i.e., save more than you spend and keep adding those savings into low-cost index funds), they should end up well ahead of the game.
I chime in with praise for Adam on this and his other articles. One question is if investing in an S&P 500 index risks missing another Nvidia that might be outside the S&P 500.
A related issue is that some index funds don’t invest in all the stocks of the index they’re tracking. Take Vanguard VTI, total stock market index ETF. The prospectus says it tracks the “CRSP US Total Market Index (the Index), which represents approximately 100% of the investable U.S. stock market.” But the ETF doesn’t invest in the whole index, “meaning that it holds a broadly diversified collection of securities that, in the aggregate, approximates the full Index in terms of key characteristics.” One of the “principal risks” identified of this is “Index sampling risk, which is the chance that the securities selected for the Fund, in the aggregate, will not provide investment performance matching that of the Fund’s target index.” It seems sampling the total stock market risks excluding another Nvidia.
Great points, Boss Hogg. I haven’t compared it holding-by-holding, but I do believe VTI’s index is very comprehensive and wouldn’t use sampling for at least the very largest holdings. In other words, it won’t leave out something like NVDA. But you ask a good question. It’s always important to look under the hood and to not rely on a fund’s name when making investment decisions.
I doubt such a company would be missed for very long.
Another good one Adam.
I’ve recently been introduced to a service Fidelity offers in which they tax manage an account of individual stocks for tax efficiency. It’s not exactly direct indexing; they hold about half the index so there’s something to buy when a holding is sold to harvest a capital loss.
I find it intriguing but for a few reasons probably won’t do it. The biggest is that Fidelity would likely immediately sell most of the holdings I would fund it with, thereby generating a big capital gains bill.
Thanks so much for taking time to comment, Michael! I’ve seen those services offered from other big name brokers as well — sometimes with not-so-insignificant fees associated as well.
Interesting, as always.
Direct indexing’s complexity violates my simplicity principle which is a core part of how I need to invest. Even if I had tools to manage so many holdings I wouldn’t want to even try.
Thanks for the kind words, David. I’m a big fan of the KISS principle as well, and as I’ve mentioned in other posts, low-cost index funds are the way to go for most people, most of the time. That said, direct indexing does offer some unique benefits for folks who have the time and inclination to employ the strategy, or who have specific ESG objectives.
David Powell,
My thoughts 100%!
I’ve been retired for a while now.
Holding only cash and keeping it under my mattress is simple … but …
So I’m like you. Low expense Index funds may not have the highest return but they sure are a simple way to invest.